2026-02-24T07:57:23.041 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T07:57:23.061 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:57:23.146 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67646 branch: main description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/radosbench-high-concurrency} email: null first_in_suite: false flavor: debug job_id: '67646' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: crimson_allow_pg_split: false enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* sha1: ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: ff63f3d997e38f69382fd23ac0206f07f7b05017 thrashosds: min_in: 4 workunit: branch: wip-shraddhaag-enable-cephadm-tests env: CRIMSON_COMPAT: '1' sha1: a78040ddef3ba5a489697ca2fe95df59a7d8bd08 owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com priority: 49 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - client.0 - node-exporter.a - - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 5980 sha1: ff63f3d997e38f69382fd23ac0206f07f7b05017 sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-shraddhaag-enable-cephadm-tests suite_path: /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa suite_relpath: qa suite_repo: https://github.com/shraddhaag/ceph.git suite_sha1: a78040ddef3ba5a489697ca2fe95df59a7d8bd08 targets: trial105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC39T2yC74x+4Df639Z6cQL+RSxKbi6u3PAePNIKYvmPs+L5sxbZmAKPeqd3bsUUK7r5eI714TCGdW4S+lGKlUA= trial165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDq6rQ2iBQiOhhTxQR+SFx/RGlRWj1fvqMkQ6ZGtaCTsSDz4znU0HuM6zxh8BssfXh5j2xUXLe71sk7HXCqep6w= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 debug osd: 10 osd_type: crimson - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_pgnum_grow: 2 chance_pgpnum_fix: 1 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 2 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_06:51:01 tube: trial user: shraddhaag verbose: false verify_ceph_hash: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T07:57:23.146 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa; will attempt to use it 2026-02-24T07:57:23.146 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa/tasks 2026-02-24T07:57:23.147 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T07:57:23.148 INFO:teuthology.task.internal:Saving configuration 2026-02-24T07:57:23.156 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T07:57:23.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T07:57:23.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial105.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67646', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 07:53:54.687513', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC39T2yC74x+4Df639Z6cQL+RSxKbi6u3PAePNIKYvmPs+L5sxbZmAKPeqd3bsUUK7r5eI714TCGdW4S+lGKlUA='} 2026-02-24T07:57:23.282 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial165.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67646', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 07:53:54.686801', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDq6rQ2iBQiOhhTxQR+SFx/RGlRWj1fvqMkQ6ZGtaCTsSDz4znU0HuM6zxh8BssfXh5j2xUXLe71sk7HXCqep6w='} 2026-02-24T07:57:23.282 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T07:57:23.294 INFO:teuthology.task.internal:roles: ubuntu@trial105.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-24T07:57:23.294 INFO:teuthology.task.internal:roles: ubuntu@trial165.front.sepia.ceph.com - ['osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-24T07:57:23.294 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T07:57:23.425 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4355952ac0>, signals=[15]) 2026-02-24T07:57:23.426 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T07:57:23.437 INFO:teuthology.task.internal:Opening connections... 2026-02-24T07:57:23.437 DEBUG:teuthology.task.internal:connecting to ubuntu@trial105.front.sepia.ceph.com 2026-02-24T07:57:23.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:57:23.501 DEBUG:teuthology.task.internal:connecting to ubuntu@trial165.front.sepia.ceph.com 2026-02-24T07:57:23.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:57:23.562 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T07:57:23.575 DEBUG:teuthology.orchestra.run.trial105:> uname -m 2026-02-24T07:57:23.590 INFO:teuthology.orchestra.run.trial105.stdout:x86_64 2026-02-24T07:57:23.590 DEBUG:teuthology.orchestra.run.trial105:> cat /etc/os-release 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:NAME="CentOS Stream" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:VERSION="9" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:ID="centos" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:ID_LIKE="rhel fedora" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:VERSION_ID="9" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:PLATFORM_ID="platform:el9" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:ANSI_COLOR="0;31" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:HOME_URL="https://centos.org/" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T07:57:23.645 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T07:57:23.646 INFO:teuthology.lock.ops:Updating trial105.front.sepia.ceph.com on lock server 2026-02-24T07:57:23.710 DEBUG:teuthology.orchestra.run.trial165:> uname -m 2026-02-24T07:57:23.725 INFO:teuthology.orchestra.run.trial165.stdout:x86_64 2026-02-24T07:57:23.725 DEBUG:teuthology.orchestra.run.trial165:> cat /etc/os-release 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:NAME="CentOS Stream" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:VERSION="9" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:ID="centos" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:ID_LIKE="rhel fedora" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:VERSION_ID="9" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:PLATFORM_ID="platform:el9" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:ANSI_COLOR="0;31" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:HOME_URL="https://centos.org/" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T07:57:23.781 INFO:teuthology.orchestra.run.trial165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T07:57:23.782 INFO:teuthology.lock.ops:Updating trial165.front.sepia.ceph.com on lock server 2026-02-24T07:57:23.856 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T07:57:23.869 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T07:57:23.881 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T07:57:23.882 DEBUG:teuthology.orchestra.run.trial105:> test '!' -e /home/ubuntu/cephtest 2026-02-24T07:57:23.884 DEBUG:teuthology.orchestra.run.trial165:> test '!' -e /home/ubuntu/cephtest 2026-02-24T07:57:23.899 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T07:57:23.911 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T07:57:23.911 DEBUG:teuthology.orchestra.run.trial105:> test -z $(ls -A /var/lib/ceph) 2026-02-24T07:57:23.939 DEBUG:teuthology.orchestra.run.trial165:> test -z $(ls -A /var/lib/ceph) 2026-02-24T07:57:23.955 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T07:57:24.107 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T07:57:24.127 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-24T07:57:24.127 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'osd.2': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-24T07:57:24.127 DEBUG:teuthology.orchestra.run.trial105:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T07:57:24.127 DEBUG:teuthology.orchestra.run.trial165:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T07:57:24.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:57:24.142 DEBUG:teuthology.orchestra.run.trial105:> uname -r 2026-02-24T07:57:24.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:57:24.143 DEBUG:teuthology.orchestra.run.trial165:> uname -r 2026-02-24T07:57:24.197 INFO:teuthology.orchestra.run.trial105.stdout:5.14.0-681.el9.x86_64 2026-02-24T07:57:24.197 INFO:teuthology.task.kernel:Running kernel on trial105: 5.14.0-681.el9.x86_64 2026-02-24T07:57:24.197 DEBUG:teuthology.orchestra.run.trial105:> sudo yum install -y kernel 2026-02-24T07:57:24.198 INFO:teuthology.orchestra.run.trial165.stdout:5.14.0-681.el9.x86_64 2026-02-24T07:57:24.198 INFO:teuthology.task.kernel:Running kernel on trial165: 5.14.0-681.el9.x86_64 2026-02-24T07:57:24.198 DEBUG:teuthology.orchestra.run.trial165:> sudo yum install -y kernel 2026-02-24T07:57:24.947 INFO:teuthology.orchestra.run.trial165.stdout:CentOS Stream 9 - BaseOS 24 MB/s | 8.9 MB 00:00 2026-02-24T07:57:28.446 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.9 MB 00:03 2026-02-24T07:57:31.628 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-24T07:57:40.264 INFO:teuthology.orchestra.run.trial165.stdout:CentOS Stream 9 - AppStream 1.8 MB/s | 27 MB 00:14 2026-02-24T07:57:42.543 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - CRB 954 kB/s | 8.0 MB 00:08 2026-02-24T07:57:43.381 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - Extras packages 175 kB/s | 20 kB 00:00 2026-02-24T07:57:45.573 INFO:teuthology.orchestra.run.trial165.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 8.0 MB 00:02 2026-02-24T07:57:46.102 INFO:teuthology.orchestra.run.trial105.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 20 MB 00:02 2026-02-24T07:57:47.343 INFO:teuthology.orchestra.run.trial165.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-24T07:57:49.298 INFO:teuthology.orchestra.run.trial105.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-24T07:57:50.323 INFO:teuthology.orchestra.run.trial105.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T07:57:50.324 INFO:teuthology.orchestra.run.trial105.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T07:57:50.343 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T07:57:50.344 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T07:57:50.345 INFO:teuthology.orchestra.run.trial105.stdout: Package Architecture Version Repository Size 2026-02-24T07:57:50.345 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T07:57:50.345 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T07:57:50.345 INFO:teuthology.orchestra.run.trial105.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T07:57:50.345 INFO:teuthology.orchestra.run.trial105.stdout:Installing dependencies: 2026-02-24T07:57:50.345 INFO:teuthology.orchestra.run.trial105.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T07:57:50.345 INFO:teuthology.orchestra.run.trial105.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T07:57:50.346 INFO:teuthology.orchestra.run.trial105.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T07:57:50.346 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T07:57:50.346 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T07:57:50.346 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T07:57:50.346 INFO:teuthology.orchestra.run.trial105.stdout:Install 4 Packages 2026-02-24T07:57:50.346 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T07:57:50.346 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 89 M 2026-02-24T07:57:50.346 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 135 M 2026-02-24T07:57:50.346 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T07:57:50.467 INFO:teuthology.orchestra.run.trial105.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 14 MB/s | 901 kB 00:00 2026-02-24T07:57:50.630 INFO:teuthology.orchestra.run.trial105.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 76 MB/s | 17 MB 00:00 2026-02-24T07:57:50.978 INFO:teuthology.orchestra.run.trial105.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 69 MB/s | 40 MB 00:00 2026-02-24T07:57:51.269 INFO:teuthology.orchestra.run.trial105.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 39 MB/s | 31 MB 00:00 2026-02-24T07:57:51.270 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:57:51.270 INFO:teuthology.orchestra.run.trial105.stdout:Total 96 MB/s | 89 MB 00:00 2026-02-24T07:57:51.460 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T07:57:51.662 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T07:57:51.662 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T07:57:52.045 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T07:57:52.045 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T07:57:53.152 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T07:57:53.440 INFO:teuthology.orchestra.run.trial105.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:57:53.463 INFO:teuthology.orchestra.run.trial105.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:57:56.008 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:57:56.040 INFO:teuthology.orchestra.run.trial105.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:57:59.083 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:57:59.089 INFO:teuthology.orchestra.run.trial105.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:58:02.138 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:58:19.614 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:58:19.634 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:58:19.818 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:58:19.818 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:58:19.818 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:58:19.818 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:58:19.876 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:58:19.876 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T07:58:19.876 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T07:58:19.876 INFO:teuthology.orchestra.run.trial105.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T07:58:19.876 INFO:teuthology.orchestra.run.trial105.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T07:58:19.876 INFO:teuthology.orchestra.run.trial105.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T07:58:19.877 INFO:teuthology.orchestra.run.trial105.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T07:58:19.877 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T07:58:19.877 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T07:58:19.937 DEBUG:teuthology.orchestra.run.trial105:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:58:19.966 INFO:teuthology.orchestra.run.trial105.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:58:19.967 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:58:19.967 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T07:58:19.968 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T07:58:19.968 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T07:58:19.968 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-24T07:58:19.968 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial105.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T07:58:19.968 DEBUG:teuthology.orchestra.run.trial105:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:58:20.034 INFO:teuthology.orchestra.run.trial105.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:58:20.035 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:58:20.036 DEBUG:teuthology.orchestra.run.trial105:> sudo rpm -qi grub2-tools 2026-02-24T07:58:20.106 INFO:teuthology.orchestra.run.trial105.stdout:Name : grub2-tools 2026-02-24T07:58:20.106 INFO:teuthology.orchestra.run.trial105.stdout:Epoch : 1 2026-02-24T07:58:20.106 INFO:teuthology.orchestra.run.trial105.stdout:Version : 2.06 2026-02-24T07:58:20.106 INFO:teuthology.orchestra.run.trial105.stdout:Release : 120.el9 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Architecture: x86_64 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Group : Unspecified 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Size : 9108611 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:License : GPLv3+ 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Packager : builder@centos.org 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:Vendor : CentOS 2026-02-24T07:58:20.107 INFO:teuthology.orchestra.run.trial105.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T07:58:20.108 INFO:teuthology.orchestra.run.trial105.stdout:Summary : Support tools for GRUB. 2026-02-24T07:58:20.108 INFO:teuthology.orchestra.run.trial105.stdout:Description : 2026-02-24T07:58:20.108 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T07:58:20.108 INFO:teuthology.orchestra.run.trial105.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T07:58:20.108 INFO:teuthology.orchestra.run.trial105.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T07:58:20.108 INFO:teuthology.orchestra.run.trial105.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T07:58:20.108 INFO:teuthology.orchestra.run.trial105.stdout:hardware devices. 2026-02-24T07:58:20.108 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T07:58:20.108 INFO:teuthology.orchestra.run.trial105.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T07:58:20.109 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T07:58:20.110 INFO:teuthology.task.kernel:Updating grub on trial105 to boot 5.14.0-686.el9.x86_64 2026-02-24T07:58:20.110 DEBUG:teuthology.orchestra.run.trial105:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T07:58:20.173 INFO:teuthology.orchestra.run.trial105.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T07:58:20.174 DEBUG:teuthology.orchestra.run.trial105:> sudo command -v grubby && echo yes || echo no 2026-02-24T07:58:20.239 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/grubby 2026-02-24T07:58:20.241 INFO:teuthology.orchestra.run.trial105.stdout:yes 2026-02-24T07:58:20.241 DEBUG:teuthology.orchestra.run.trial105:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T07:58:20.306 INFO:teuthology.orchestra.run.trial105.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T07:58:20.307 DEBUG:teuthology.orchestra.run.trial105:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T07:58:20.380 DEBUG:teuthology.orchestra.run.trial105:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T07:58:20.585 INFO:teuthology.orchestra.run.trial105.stderr:Generating grub configuration file ... 2026-02-24T07:58:20.653 INFO:teuthology.orchestra.run.trial105.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T07:58:20.659 INFO:teuthology.orchestra.run.trial105.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T07:58:20.912 INFO:teuthology.orchestra.run.trial105.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T07:58:20.919 INFO:teuthology.orchestra.run.trial105.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T07:58:20.953 INFO:teuthology.orchestra.run.trial105.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T07:58:20.959 INFO:teuthology.orchestra.run.trial105.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T07:58:20.990 INFO:teuthology.orchestra.run.trial105.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T07:58:20.996 INFO:teuthology.orchestra.run.trial105.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T07:58:21.020 INFO:teuthology.orchestra.run.trial105.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T07:58:21.026 INFO:teuthology.orchestra.run.trial105.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T07:58:21.113 INFO:teuthology.orchestra.run.trial105.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T07:58:21.121 INFO:teuthology.orchestra.run.trial105.stderr:done 2026-02-24T07:58:21.124 DEBUG:teuthology.orchestra.run.trial105:> test -d /sys/firmware/efi 2026-02-24T07:58:21.140 DEBUG:teuthology.orchestra.run.trial105:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T07:58:21.207 INFO:teuthology.orchestra.run.trial105.stdout:/boot/efi/EFI/BOOT 2026-02-24T07:58:21.207 INFO:teuthology.orchestra.run.trial105.stdout:/boot/efi/EFI/centos 2026-02-24T07:58:21.209 DEBUG:teuthology.orchestra.run.trial105:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T07:58:21.273 INFO:teuthology.orchestra.run.trial105.stdout:no 2026-02-24T07:58:21.274 DEBUG:teuthology.orchestra.run.trial105:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T07:58:21.339 INFO:teuthology.orchestra.run.trial105.stdout:yes 2026-02-24T07:58:21.339 DEBUG:teuthology.orchestra.run.trial105:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T07:58:21.405 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial105 2026-02-24T07:58:21.405 DEBUG:teuthology.orchestra.run.trial105:> sudo bash -c ' 2026-02-24T07:58:21.405 DEBUG:teuthology.orchestra.run.trial105:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T07:58:21.405 DEBUG:teuthology.orchestra.run.trial105:> ' 2026-02-24T07:58:51.447 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-24T07:58:51.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-24T07:58:51.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:59:05.728 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-24T07:59:14.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-24T07:59:14.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:59:50.792 DEBUG:teuthology.orchestra.run.trial105:> true 2026-02-24T07:59:50.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-24T07:59:50.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-24T07:59:50.959 DEBUG:teuthology.orchestra.run.trial105:> uname -r 2026-02-24T07:59:51.015 INFO:teuthology.orchestra.run.trial105.stdout:5.14.0-686.el9.x86_64 2026-02-24T07:59:51.015 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T07:59:51.015 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T07:59:51.015 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T07:59:52.016 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-24T07:59:52.017 DEBUG:teuthology.orchestra.run.trial105:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T07:59:52.047 INFO:teuthology.orchestra.run.trial105.stdout:ttyS1 2026-02-24T07:59:52.068 DEBUG:teuthology.parallel:result is None 2026-02-24T08:00:44.562 INFO:teuthology.orchestra.run.trial165.stdout:Extra Packages for Enterprise Linux 117 kB/s | 20 MB 02:57 2026-02-24T08:00:47.728 INFO:teuthology.orchestra.run.trial165.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-24T08:00:48.741 INFO:teuthology.orchestra.run.trial165.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T08:00:48.741 INFO:teuthology.orchestra.run.trial165.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T08:00:48.761 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:00:48.761 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:00:48.761 INFO:teuthology.orchestra.run.trial165.stdout: Package Architecture Version Repository Size 2026-02-24T08:00:48.761 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout:Installing dependencies: 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout:Install 4 Packages 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 89 M 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 135 M 2026-02-24T08:00:48.762 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:00:49.743 INFO:teuthology.orchestra.run.trial165.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 978 kB/s | 901 kB 00:00 2026-02-24T08:00:50.214 INFO:teuthology.orchestra.run.trial165.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 12 MB/s | 17 MB 00:01 2026-02-24T08:00:50.719 INFO:teuthology.orchestra.run.trial165.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-24T08:00:51.473 INFO:teuthology.orchestra.run.trial165.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 18 MB/s | 31 MB 00:01 2026-02-24T08:00:51.473 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:00:51.473 INFO:teuthology.orchestra.run.trial165.stdout:Total 33 MB/s | 89 MB 00:02 2026-02-24T08:00:51.664 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:00:51.864 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:00:51.864 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:00:52.248 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:00:52.248 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:00:53.363 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:00:53.654 INFO:teuthology.orchestra.run.trial165.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T08:00:53.676 INFO:teuthology.orchestra.run.trial165.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T08:00:56.235 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T08:00:56.268 INFO:teuthology.orchestra.run.trial165.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T08:00:59.503 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T08:00:59.509 INFO:teuthology.orchestra.run.trial165.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:01:02.556 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:01:19.904 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:01:19.925 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:01:20.109 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:01:20.110 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T08:01:20.110 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T08:01:20.110 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T08:01:20.166 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:01:20.166 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:01:20.167 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:01:20.167 INFO:teuthology.orchestra.run.trial165.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T08:01:20.167 INFO:teuthology.orchestra.run.trial165.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T08:01:20.167 INFO:teuthology.orchestra.run.trial165.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T08:01:20.167 INFO:teuthology.orchestra.run.trial165.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T08:01:20.167 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:01:20.167 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:01:20.227 DEBUG:teuthology.orchestra.run.trial165:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T08:01:20.256 INFO:teuthology.orchestra.run.trial165.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T08:01:20.256 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T08:01:20.256 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T08:01:20.256 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T08:01:20.257 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T08:01:20.257 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2026-02-24T08:01:20.257 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial165.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T08:01:20.257 DEBUG:teuthology.orchestra.run.trial165:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T08:01:20.322 INFO:teuthology.orchestra.run.trial165.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T08:01:20.324 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T08:01:20.324 DEBUG:teuthology.orchestra.run.trial165:> sudo rpm -qi grub2-tools 2026-02-24T08:01:20.392 INFO:teuthology.orchestra.run.trial165.stdout:Name : grub2-tools 2026-02-24T08:01:20.392 INFO:teuthology.orchestra.run.trial165.stdout:Epoch : 1 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:Version : 2.06 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:Release : 120.el9 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:Architecture: x86_64 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:Group : Unspecified 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:Size : 9108611 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:License : GPLv3+ 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T08:01:20.393 INFO:teuthology.orchestra.run.trial165.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:Packager : builder@centos.org 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:Vendor : CentOS 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:Summary : Support tools for GRUB. 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:Description : 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout:hardware devices. 2026-02-24T08:01:20.394 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:01:20.395 INFO:teuthology.orchestra.run.trial165.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T08:01:20.396 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T08:01:20.396 INFO:teuthology.task.kernel:Updating grub on trial165 to boot 5.14.0-686.el9.x86_64 2026-02-24T08:01:20.396 DEBUG:teuthology.orchestra.run.trial165:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T08:01:20.459 INFO:teuthology.orchestra.run.trial165.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T08:01:20.460 DEBUG:teuthology.orchestra.run.trial165:> sudo command -v grubby && echo yes || echo no 2026-02-24T08:01:20.523 INFO:teuthology.orchestra.run.trial165.stdout:/sbin/grubby 2026-02-24T08:01:20.524 INFO:teuthology.orchestra.run.trial165.stdout:yes 2026-02-24T08:01:20.525 DEBUG:teuthology.orchestra.run.trial165:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T08:01:20.590 INFO:teuthology.orchestra.run.trial165.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T08:01:20.591 DEBUG:teuthology.orchestra.run.trial165:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T08:01:20.664 DEBUG:teuthology.orchestra.run.trial165:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T08:01:20.869 INFO:teuthology.orchestra.run.trial165.stderr:Generating grub configuration file ... 2026-02-24T08:01:20.937 INFO:teuthology.orchestra.run.trial165.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T08:01:20.944 INFO:teuthology.orchestra.run.trial165.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T08:01:21.194 INFO:teuthology.orchestra.run.trial165.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T08:01:21.201 INFO:teuthology.orchestra.run.trial165.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T08:01:21.236 INFO:teuthology.orchestra.run.trial165.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T08:01:21.242 INFO:teuthology.orchestra.run.trial165.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T08:01:21.273 INFO:teuthology.orchestra.run.trial165.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T08:01:21.279 INFO:teuthology.orchestra.run.trial165.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T08:01:21.303 INFO:teuthology.orchestra.run.trial165.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T08:01:21.309 INFO:teuthology.orchestra.run.trial165.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T08:01:21.395 INFO:teuthology.orchestra.run.trial165.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T08:01:21.404 INFO:teuthology.orchestra.run.trial165.stderr:done 2026-02-24T08:01:21.405 DEBUG:teuthology.orchestra.run.trial165:> test -d /sys/firmware/efi 2026-02-24T08:01:21.420 DEBUG:teuthology.orchestra.run.trial165:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T08:01:21.485 INFO:teuthology.orchestra.run.trial165.stdout:/boot/efi/EFI/BOOT 2026-02-24T08:01:21.486 INFO:teuthology.orchestra.run.trial165.stdout:/boot/efi/EFI/centos 2026-02-24T08:01:21.487 DEBUG:teuthology.orchestra.run.trial165:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T08:01:21.552 INFO:teuthology.orchestra.run.trial165.stdout:no 2026-02-24T08:01:21.553 DEBUG:teuthology.orchestra.run.trial165:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T08:01:21.617 INFO:teuthology.orchestra.run.trial165.stdout:yes 2026-02-24T08:01:21.618 DEBUG:teuthology.orchestra.run.trial165:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T08:01:21.680 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial165 2026-02-24T08:01:21.681 DEBUG:teuthology.orchestra.run.trial165:> sudo bash -c ' 2026-02-24T08:01:21.681 DEBUG:teuthology.orchestra.run.trial165:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T08:01:21.681 DEBUG:teuthology.orchestra.run.trial165:> ' 2026-02-24T08:01:51.724 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2026-02-24T08:01:51.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial165.front.sepia.ceph.com' 2026-02-24T08:01:51.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T08:02:06.015 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.165 2026-02-24T08:02:15.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial165.front.sepia.ceph.com' 2026-02-24T08:02:15.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T08:02:51.010 DEBUG:teuthology.orchestra.run.trial165:> true 2026-02-24T08:02:51.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial165.front.sepia.ceph.com' 2026-02-24T08:02:51.168 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-686.el9.x86_64"... 2026-02-24T08:02:51.168 DEBUG:teuthology.orchestra.run.trial165:> uname -r 2026-02-24T08:02:51.224 INFO:teuthology.orchestra.run.trial165.stdout:5.14.0-686.el9.x86_64 2026-02-24T08:02:51.224 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T08:02:51.225 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T08:02:51.225 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T08:02:52.226 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2026-02-24T08:02:52.226 DEBUG:teuthology.orchestra.run.trial165:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T08:02:52.255 INFO:teuthology.orchestra.run.trial165.stdout:ttyS1 2026-02-24T08:02:52.292 DEBUG:teuthology.parallel:result is None 2026-02-24T08:02:52.292 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T08:02:52.304 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T08:02:52.304 DEBUG:teuthology.orchestra.run.trial105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T08:02:52.317 DEBUG:teuthology.orchestra.run.trial165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T08:02:52.347 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T08:02:52.362 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T08:02:52.375 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T08:02:52.375 DEBUG:teuthology.orchestra.run.trial105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T08:02:52.376 DEBUG:teuthology.orchestra.run.trial165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T08:02:52.409 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T08:02:52.419 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T08:02:52.419 DEBUG:teuthology.orchestra.run.trial105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T08:02:52.432 DEBUG:teuthology.orchestra.run.trial165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T08:02:52.455 INFO:teuthology.orchestra.run.trial105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T08:02:52.464 INFO:teuthology.orchestra.run.trial105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T08:02:52.467 INFO:teuthology.orchestra.run.trial165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T08:02:52.476 INFO:teuthology.orchestra.run.trial165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T08:02:52.477 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T08:02:52.488 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T08:02:52.488 DEBUG:teuthology.orchestra.run.trial105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T08:02:52.507 DEBUG:teuthology.orchestra.run.trial165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T08:02:52.542 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T08:02:52.560 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T08:02:52.560 DEBUG:teuthology.orchestra.run.trial105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T08:02:52.573 DEBUG:teuthology.orchestra.run.trial165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T08:02:52.597 DEBUG:teuthology.orchestra.run.trial105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T08:02:52.705 DEBUG:teuthology.orchestra.run.trial105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T08:02:52.728 DEBUG:teuthology.orchestra.run.trial105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T08:02:52.853 DEBUG:teuthology.orchestra.run.trial105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T08:02:52.879 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:02:52.879 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T08:02:52.942 DEBUG:teuthology.orchestra.run.trial165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T08:02:53.054 DEBUG:teuthology.orchestra.run.trial165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T08:02:53.079 DEBUG:teuthology.orchestra.run.trial165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T08:02:53.255 DEBUG:teuthology.orchestra.run.trial165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T08:02:53.280 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:02:53.280 DEBUG:teuthology.orchestra.run.trial165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T08:02:53.345 DEBUG:teuthology.orchestra.run.trial105:> sudo service rsyslog restart 2026-02-24T08:02:53.347 DEBUG:teuthology.orchestra.run.trial165:> sudo service rsyslog restart 2026-02-24T08:02:53.374 INFO:teuthology.orchestra.run.trial105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T08:02:53.412 INFO:teuthology.orchestra.run.trial165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T08:02:53.717 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T08:02:53.730 INFO:teuthology.task.internal:Starting timer... 2026-02-24T08:02:53.730 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T08:02:53.755 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T08:02:53.773 DEBUG:teuthology.orchestra.run.trial105:> sudo service auditd rotate 2026-02-24T08:02:53.801 INFO:teuthology.orchestra.run.trial105.stdout:Rotating logs: 2026-02-24T08:02:53.803 DEBUG:teuthology.orchestra.run.trial165:> sudo service auditd rotate 2026-02-24T08:02:53.833 INFO:teuthology.orchestra.run.trial165.stdout:Rotating logs: 2026-02-24T08:02:53.835 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T08:02:53.835 DEBUG:teuthology.orchestra.run.trial105:> /usr/sbin/getenforce 2026-02-24T08:02:53.859 INFO:teuthology.orchestra.run.trial105.stdout:Permissive 2026-02-24T08:02:53.859 DEBUG:teuthology.orchestra.run.trial165:> /usr/sbin/getenforce 2026-02-24T08:02:53.891 INFO:teuthology.orchestra.run.trial165.stdout:Permissive 2026-02-24T08:02:53.892 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial105.front.sepia.ceph.com': 'permissive', 'ubuntu@trial165.front.sepia.ceph.com': 'permissive'} 2026-02-24T08:02:53.892 DEBUG:teuthology.orchestra.run.trial105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T08:02:53.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:02:53.923 DEBUG:teuthology.orchestra.run.trial165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T08:02:53.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:02:53.957 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T08:02:53.958 DEBUG:teuthology.orchestra.run.trial105:> sudo /usr/sbin/setenforce permissive 2026-02-24T08:02:53.987 DEBUG:teuthology.orchestra.run.trial165:> sudo /usr/sbin/setenforce permissive 2026-02-24T08:02:54.022 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T08:02:54.038 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T08:02:54.051 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T08:02:54.052 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial105.front.sepia.ceph.com,trial165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T08:06:01.635 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial105.front.sepia.ceph.com'), Remote(name='ubuntu@trial165.front.sepia.ceph.com')] 2026-02-24T08:06:01.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-24T08:06:01.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T08:06:01.726 DEBUG:teuthology.orchestra.run.trial105:> true 2026-02-24T08:06:01.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-24T08:06:01.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial165.front.sepia.ceph.com' 2026-02-24T08:06:01.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T08:06:01.879 DEBUG:teuthology.orchestra.run.trial165:> true 2026-02-24T08:06:01.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial165.front.sepia.ceph.com' 2026-02-24T08:06:01.955 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T08:06:01.968 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T08:06:01.968 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T08:06:01.968 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T08:06:01.970 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T08:06:01.970 DEBUG:teuthology.orchestra.run.trial165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T08:06:01.996 INFO:teuthology.orchestra.run.trial105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T08:06:02.007 INFO:teuthology.orchestra.run.trial105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T08:06:02.022 INFO:teuthology.orchestra.run.trial165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T08:06:02.027 INFO:teuthology.orchestra.run.trial105.stderr:sudo: ntpd: command not found 2026-02-24T08:06:02.034 INFO:teuthology.orchestra.run.trial165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T08:06:02.036 INFO:teuthology.orchestra.run.trial105.stdout:506 Cannot talk to daemon 2026-02-24T08:06:02.047 INFO:teuthology.orchestra.run.trial105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T08:06:02.056 INFO:teuthology.orchestra.run.trial165.stderr:sudo: ntpd: command not found 2026-02-24T08:06:02.058 INFO:teuthology.orchestra.run.trial105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T08:06:02.066 INFO:teuthology.orchestra.run.trial165.stdout:506 Cannot talk to daemon 2026-02-24T08:06:02.079 INFO:teuthology.orchestra.run.trial165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T08:06:02.091 INFO:teuthology.orchestra.run.trial165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T08:06:02.110 INFO:teuthology.orchestra.run.trial105.stderr:bash: line 1: ntpq: command not found 2026-02-24T08:06:02.128 INFO:teuthology.orchestra.run.trial105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T08:06:02.128 INFO:teuthology.orchestra.run.trial105.stdout:=============================================================================== 2026-02-24T08:06:02.128 INFO:teuthology.orchestra.run.trial105.stdout:^? h134-215-155-177.mdtnwi.> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T08:06:02.128 INFO:teuthology.orchestra.run.trial105.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T08:06:02.128 INFO:teuthology.orchestra.run.trial105.stdout:^? 216-144-228-179-host.col> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T08:06:02.128 INFO:teuthology.orchestra.run.trial105.stdout:^? 173.249.203.227 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T08:06:02.144 INFO:teuthology.orchestra.run.trial165.stderr:bash: line 1: ntpq: command not found 2026-02-24T08:06:02.149 INFO:teuthology.orchestra.run.trial165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T08:06:02.150 INFO:teuthology.orchestra.run.trial165.stdout:=============================================================================== 2026-02-24T08:06:02.150 INFO:teuthology.orchestra.run.trial165.stdout:^? ntp0.alb1.inoc.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T08:06:02.150 INFO:teuthology.orchestra.run.trial165.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T08:06:02.150 INFO:teuthology.orchestra.run.trial165.stdout:^? 23.186.168.130 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T08:06:02.150 INFO:teuthology.orchestra.run.trial165.stdout:^? rn-03.koehn.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T08:06:02.151 INFO:teuthology.run_tasks:Running task install... 2026-02-24T08:06:02.167 DEBUG:teuthology.task.install:project ceph 2026-02-24T08:06:02.168 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'}} 2026-02-24T08:06:02.168 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'} 2026-02-24T08:06:02.168 INFO:teuthology.task.install:Using flavor: debug 2026-02-24T08:06:02.177 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-24T08:06:02.177 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-24T08:06:02.178 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017', 'tag': None, 'wait_for_package': False} 2026-02-24T08:06:02.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T08:06:02.183 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017', 'tag': None, 'wait_for_package': False} 2026-02-24T08:06:02.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T08:06:02.372 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/ 2026-02-24T08:06:02.372 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5440.gff63f3d9 2026-02-24T08:06:02.383 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/ 2026-02-24T08:06:02.383 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5440.gff63f3d9 2026-02-24T08:06:02.691 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T08:06:02.692 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:06:02.692 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T08:06:02.718 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-24T08:06:02.719 DEBUG:teuthology.orchestra.run.trial105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ff63f3d997e38f69382fd23ac0206f07f7b05017/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T08:06:02.732 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T08:06:02.732 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:06:02.732 DEBUG:teuthology.orchestra.run.trial165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T08:06:02.759 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-24T08:06:02.759 DEBUG:teuthology.orchestra.run.trial165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ff63f3d997e38f69382fd23ac0206f07f7b05017/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T08:06:02.785 DEBUG:teuthology.orchestra.run.trial105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T08:06:02.823 DEBUG:teuthology.orchestra.run.trial165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T08:06:02.859 DEBUG:teuthology.orchestra.run.trial105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T08:06:02.897 DEBUG:teuthology.orchestra.run.trial165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T08:06:02.922 INFO:teuthology.orchestra.run.trial105.stdout:check_obsoletes = 1 2026-02-24T08:06:02.924 DEBUG:teuthology.orchestra.run.trial105:> sudo yum clean all 2026-02-24T08:06:02.960 INFO:teuthology.orchestra.run.trial165.stdout:check_obsoletes = 1 2026-02-24T08:06:02.961 DEBUG:teuthology.orchestra.run.trial165:> sudo yum clean all 2026-02-24T08:06:03.072 INFO:teuthology.orchestra.run.trial105.stdout:41 files removed 2026-02-24T08:06:03.086 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-radosgw 2026-02-24T08:06:03.109 INFO:teuthology.orchestra.run.trial165.stdout:41 files removed 2026-02-24T08:06:03.123 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-radosgw 2026-02-24T08:06:03.962 INFO:teuthology.orchestra.run.trial165.stdout:ceph packages for x86_64 136 kB/s | 94 kB 00:00 2026-02-24T08:06:03.983 INFO:teuthology.orchestra.run.trial105.stdout:ceph packages for x86_64 125 kB/s | 94 kB 00:00 2026-02-24T08:06:04.477 INFO:teuthology.orchestra.run.trial165.stdout:ceph noarch packages 50 kB/s | 25 kB 00:00 2026-02-24T08:06:04.506 INFO:teuthology.orchestra.run.trial105.stdout:ceph noarch packages 50 kB/s | 25 kB 00:00 2026-02-24T08:06:04.952 INFO:teuthology.orchestra.run.trial165.stdout:ceph source packages 4.6 kB/s | 2.1 kB 00:00 2026-02-24T08:06:04.981 INFO:teuthology.orchestra.run.trial105.stdout:ceph source packages 4.6 kB/s | 2.1 kB 00:00 2026-02-24T08:06:06.332 INFO:teuthology.orchestra.run.trial165.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.9 MB 00:01 2026-02-24T08:06:06.673 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.9 MB 00:01 2026-02-24T08:06:09.425 INFO:teuthology.orchestra.run.trial165.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-24T08:06:10.208 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 27 MB 00:03 2026-02-24T08:06:13.017 INFO:teuthology.orchestra.run.trial165.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 8.0 MB 00:01 2026-02-24T08:06:14.106 INFO:teuthology.orchestra.run.trial165.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 20 kB 00:00 2026-02-24T08:06:14.445 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 8.0 MB 00:01 2026-02-24T08:06:14.896 INFO:teuthology.orchestra.run.trial165.stdout:Extra Packages for Enterprise Linux 28 MB/s | 20 MB 00:00 2026-02-24T08:06:15.460 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 20 kB 00:00 2026-02-24T08:06:18.111 INFO:teuthology.orchestra.run.trial165.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T08:06:19.338 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout: Package Arch Version Repository Size 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout: ceph-radosgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 11 M 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout:Upgrading: 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout: librados2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 3.3 M 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout: librbd1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.7 M 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout:Installing dependencies: 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout: ceph-base x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.1 M 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout: ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 21 M 2026-02-24T08:06:19.340 INFO:teuthology.orchestra.run.trial165.stdout: ceph-selinux x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 25 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: libcephfs2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 859 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: libradosstriper1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 263 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: librgw2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.6 M 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: python3-ceph-argparse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 45 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: python3-ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 186 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: python3-cephfs x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 204 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: python3-rados x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 324 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: python3-rbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 306 k 2026-02-24T08:06:19.341 INFO:teuthology.orchestra.run.trial165.stdout: python3-rgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 100 k 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout:Installing weak dependencies: 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: libcephfs-daemon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 39 k 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 26 k 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout:Install 35 Packages 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout:Upgrade 2 Packages 2026-02-24T08:06:19.342 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:19.343 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 61 M 2026-02-24T08:06:19.343 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:06:21.602 INFO:teuthology.orchestra.run.trial165.stdout:(1/37): ceph-radosgw-20.3.0-5440.gff63f3d9.el9. 6.9 MB/s | 11 MB 00:01 2026-02-24T08:06:21.651 INFO:teuthology.orchestra.run.trial165.stdout:(2/37): ceph-selinux-20.3.0-5440.gff63f3d9.el9. 514 kB/s | 25 kB 00:00 2026-02-24T08:06:21.698 INFO:teuthology.orchestra.run.trial165.stdout:(3/37): libcephfs-daemon-20.3.0-5440.gff63f3d9. 831 kB/s | 39 kB 00:00 2026-02-24T08:06:21.744 INFO:teuthology.orchestra.run.trial165.stdout:(4/37): libcephfs-proxy2-20.3.0-5440.gff63f3d9. 566 kB/s | 26 kB 00:00 2026-02-24T08:06:21.849 INFO:teuthology.orchestra.run.trial165.stdout:(5/37): libcephfs2-20.3.0-5440.gff63f3d9.el9.x8 8.0 MB/s | 859 kB 00:00 2026-02-24T08:06:21.900 INFO:teuthology.orchestra.run.trial165.stdout:(6/37): libradosstriper1-20.3.0-5440.gff63f3d9. 5.0 MB/s | 263 kB 00:00 2026-02-24T08:06:22.369 INFO:teuthology.orchestra.run.trial105.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 20 MB 00:06 2026-02-24T08:06:22.556 INFO:teuthology.orchestra.run.trial165.stdout:(7/37): librgw2-20.3.0-5440.gff63f3d9.el9.x86_6 8.6 MB/s | 5.6 MB 00:00 2026-02-24T08:06:22.621 INFO:teuthology.orchestra.run.trial165.stdout:(8/37): python3-ceph-argparse-20.3.0-5440.gff63 705 kB/s | 45 kB 00:00 2026-02-24T08:06:23.231 INFO:teuthology.orchestra.run.trial165.stdout:(9/37): python3-ceph-common-20.3.0-5440.gff63f3 305 kB/s | 186 kB 00:00 2026-02-24T08:06:23.950 INFO:teuthology.orchestra.run.trial165.stdout:(10/37): python3-cephfs-20.3.0-5440.gff63f3d9.e 284 kB/s | 204 kB 00:00 2026-02-24T08:06:24.088 INFO:teuthology.orchestra.run.trial165.stdout:(11/37): python3-rados-20.3.0-5440.gff63f3d9.el 2.3 MB/s | 324 kB 00:00 2026-02-24T08:06:24.225 INFO:teuthology.orchestra.run.trial165.stdout:(12/37): python3-rbd-20.3.0-5440.gff63f3d9.el9. 2.2 MB/s | 306 kB 00:00 2026-02-24T08:06:24.294 INFO:teuthology.orchestra.run.trial165.stdout:(13/37): python3-rgw-20.3.0-5440.gff63f3d9.el9. 1.4 MB/s | 100 kB 00:00 2026-02-24T08:06:24.847 INFO:teuthology.orchestra.run.trial165.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 60 kB/s | 33 kB 00:00 2026-02-24T08:06:25.123 INFO:teuthology.orchestra.run.trial165.stdout:(15/37): ceph-base-20.3.0-5440.gff63f3d9.el9.x8 1.0 MB/s | 5.1 MB 00:05 2026-02-24T08:06:25.573 INFO:teuthology.orchestra.run.trial105.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-24T08:06:25.756 INFO:teuthology.orchestra.run.trial165.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 147 kB/s | 93 kB 00:00 2026-02-24T08:06:25.992 INFO:teuthology.orchestra.run.trial165.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 441 kB/s | 104 kB 00:00 2026-02-24T08:06:26.305 INFO:teuthology.orchestra.run.trial165.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 523 kB/s | 164 kB 00:00 2026-02-24T08:06:26.326 INFO:teuthology.orchestra.run.trial165.stdout:(19/37): nvme-cli-2.16-1.el9.x86_64.rpm 796 kB/s | 1.2 MB 00:01 2026-02-24T08:06:26.566 INFO:teuthology.orchestra.run.trial165.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 189 kB/s | 45 kB 00:00 2026-02-24T08:06:26.619 INFO:teuthology.orchestra.run.trial165.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 512 kB/s | 160 kB 00:00 2026-02-24T08:06:26.795 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:06:26.796 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:06:26.796 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repository Size 2026-02-24T08:06:26.796 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:06:26.796 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:06:26.796 INFO:teuthology.orchestra.run.trial105.stdout: ceph-radosgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 11 M 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout:Upgrading: 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout: librados2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 3.3 M 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout: librbd1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.7 M 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout:Installing dependencies: 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout: ceph-base x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.1 M 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout: ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 21 M 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout: ceph-selinux x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 25 k 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T08:06:26.797 INFO:teuthology.orchestra.run.trial105.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 859 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: libradosstriper1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 263 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: librgw2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.6 M 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T08:06:26.798 INFO:teuthology.orchestra.run.trial105.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: python3-ceph-argparse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 45 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: python3-ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 186 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: python3-cephfs x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 204 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: python3-rados x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 324 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: python3-rbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 306 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: python3-rgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 100 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T08:06:26.799 INFO:teuthology.orchestra.run.trial105.stdout:Installing weak dependencies: 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-daemon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 39 k 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 26 k 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout:Install 35 Packages 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout:Upgrade 2 Packages 2026-02-24T08:06:26.800 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:26.801 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 61 M 2026-02-24T08:06:26.801 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:06:27.089 INFO:teuthology.orchestra.run.trial165.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 621 kB/s | 292 kB 00:00 2026-02-24T08:06:27.424 INFO:teuthology.orchestra.run.trial165.stdout:(23/37): librdkafka-1.6.1-102.el9.x86_64.rpm 772 kB/s | 662 kB 00:00 2026-02-24T08:06:27.481 INFO:teuthology.orchestra.run.trial165.stdout:(24/37): qatlib-25.08.0-2.el9.x86_64.rpm 612 kB/s | 240 kB 00:00 2026-02-24T08:06:27.581 INFO:teuthology.orchestra.run.trial165.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 235 kB/s | 37 kB 00:00 2026-02-24T08:06:27.640 INFO:teuthology.orchestra.run.trial165.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 417 kB/s | 66 kB 00:00 2026-02-24T08:06:29.801 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] gperftools-libs-2.9.1-3.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-3.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:06:29.818 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] libarrow-9.0.0-15.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-15.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:06:30.100 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] libarrow-9.0.0-15.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-15.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:06:32.995 INFO:teuthology.orchestra.run.trial105.stdout:(1/37): ceph-base-20.3.0-5440.gff63f3d9.el9.x86 910 kB/s | 5.1 MB 00:05 2026-02-24T08:06:33.068 INFO:teuthology.orchestra.run.trial105.stdout:(2/37): ceph-selinux-20.3.0-5440.gff63f3d9.el9. 343 kB/s | 25 kB 00:00 2026-02-24T08:06:33.134 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] gperftools-libs-2.9.1-3.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-3.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:06:33.140 INFO:teuthology.orchestra.run.trial105.stdout:(3/37): libcephfs-daemon-20.3.0-5440.gff63f3d9. 543 kB/s | 39 kB 00:00 2026-02-24T08:06:33.213 INFO:teuthology.orchestra.run.trial105.stdout:(4/37): libcephfs-proxy2-20.3.0-5440.gff63f3d9. 360 kB/s | 26 kB 00:00 2026-02-24T08:06:33.867 INFO:teuthology.orchestra.run.trial105.stdout:(5/37): libcephfs2-20.3.0-5440.gff63f3d9.el9.x8 1.3 MB/s | 859 kB 00:00 2026-02-24T08:06:34.048 INFO:teuthology.orchestra.run.trial105.stdout:(6/37): libradosstriper1-20.3.0-5440.gff63f3d9. 1.4 MB/s | 263 kB 00:00 2026-02-24T08:06:34.110 INFO:teuthology.orchestra.run.trial165.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 698 kB/s | 4.4 MB 00:06 2026-02-24T08:06:34.449 INFO:teuthology.orchestra.run.trial165.stdout:(28/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 45 kB/s | 308 kB 00:06 2026-02-24T08:06:34.580 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] libarrow-doc-9.0.0-15.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-15.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:06:34.880 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] liboath-2.6.12-1.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/liboath-2.6.12-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:06:35.162 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] libarrow-doc-9.0.0-15.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-15.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:06:35.302 INFO:teuthology.orchestra.run.trial165.stdout:(29/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 21 kB/s | 25 kB 00:01 2026-02-24T08:06:35.443 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] libunwind-1.6.2-1.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libunwind-1.6.2-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:06:35.631 INFO:teuthology.orchestra.run.trial165.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 205 kB/s | 67 kB 00:00 2026-02-24T08:06:36.135 INFO:teuthology.orchestra.run.trial105.stdout:(7/37): ceph-radosgw-20.3.0-5440.gff63f3d9.el9. 1.3 MB/s | 11 MB 00:08 2026-02-24T08:06:36.204 INFO:teuthology.orchestra.run.trial105.stdout:(8/37): python3-ceph-argparse-20.3.0-5440.gff63 662 kB/s | 45 kB 00:00 2026-02-24T08:06:36.339 INFO:teuthology.orchestra.run.trial105.stdout:(9/37): python3-ceph-common-20.3.0-5440.gff63f3 1.3 MB/s | 186 kB 00:00 2026-02-24T08:06:36.479 INFO:teuthology.orchestra.run.trial105.stdout:(10/37): python3-cephfs-20.3.0-5440.gff63f3d9.e 1.4 MB/s | 204 kB 00:00 2026-02-24T08:06:36.679 INFO:teuthology.orchestra.run.trial165.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 799 kB/s | 838 kB 00:01 2026-02-24T08:06:36.680 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] liboath-2.6.12-1.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/liboath-2.6.12-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:06:36.715 INFO:teuthology.orchestra.run.trial105.stdout:(11/37): python3-rados-20.3.0-5440.gff63f3d9.el 1.3 MB/s | 324 kB 00:00 2026-02-24T08:06:36.865 INFO:teuthology.orchestra.run.trial165.stdout:(32/37): liboath-2.6.12-1.el9.x86_64.rpm 20 kB/s | 49 kB 00:02 2026-02-24T08:06:36.921 INFO:teuthology.orchestra.run.trial105.stdout:(12/37): python3-rbd-20.3.0-5440.gff63f3d9.el9. 1.5 MB/s | 306 kB 00:00 2026-02-24T08:06:36.993 INFO:teuthology.orchestra.run.trial105.stdout:(13/37): python3-rgw-20.3.0-5440.gff63f3d9.el9. 1.4 MB/s | 100 kB 00:00 2026-02-24T08:06:37.093 INFO:teuthology.orchestra.run.trial165.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 463 kB/s | 191 kB 00:00 2026-02-24T08:06:37.265 INFO:teuthology.orchestra.run.trial105.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 122 kB/s | 33 kB 00:00 2026-02-24T08:06:37.402 INFO:teuthology.orchestra.run.trial105.stdout:(15/37): librgw2-20.3.0-5440.gff63f3d9.el9.x86_ 1.7 MB/s | 5.6 MB 00:03 2026-02-24T08:06:37.754 INFO:teuthology.orchestra.run.trial105.stdout:(16/37): nvme-cli-2.16-1.el9.x86_64.rpm 2.4 MB/s | 1.2 MB 00:00 2026-02-24T08:06:37.794 INFO:teuthology.orchestra.run.trial105.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 238 kB/s | 93 kB 00:00 2026-02-24T08:06:37.951 INFO:teuthology.orchestra.run.trial165.stdout:(34/37): ceph-common-20.3.0-5440.gff63f3d9.el9. 1.2 MB/s | 21 MB 00:17 2026-02-24T08:06:38.423 INFO:teuthology.orchestra.run.trial105.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 156 kB/s | 104 kB 00:00 2026-02-24T08:06:38.512 INFO:teuthology.orchestra.run.trial105.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 228 kB/s | 164 kB 00:00 2026-02-24T08:06:39.110 INFO:teuthology.orchestra.run.trial105.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2026-02-24T08:06:39.145 INFO:teuthology.orchestra.run.trial105.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 222 kB/s | 160 kB 00:00 2026-02-24T08:06:39.486 INFO:teuthology.orchestra.run.trial165.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 618 kB/s | 1.6 MB 00:02 2026-02-24T08:06:39.676 INFO:teuthology.orchestra.run.trial165.stdout:(36/37): librados2-20.3.0-5440.gff63f3d9.el9.x8 1.3 MB/s | 3.3 MB 00:02 2026-02-24T08:06:39.931 INFO:teuthology.orchestra.run.trial105.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 372 kB/s | 292 kB 00:00 2026-02-24T08:06:39.983 INFO:teuthology.orchestra.run.trial105.stdout:(23/37): librdkafka-1.6.1-102.el9.x86_64.rpm 759 kB/s | 662 kB 00:00 2026-02-24T08:06:40.471 INFO:teuthology.orchestra.run.trial165.stdout:(37/37): librbd1-20.3.0-5440.gff63f3d9.el9.x86_ 1.1 MB/s | 2.7 MB 00:02 2026-02-24T08:06:40.474 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:06:40.474 INFO:teuthology.orchestra.run.trial165.stdout:Total 2.9 MB/s | 61 MB 00:21 2026-02-24T08:06:40.559 INFO:teuthology.orchestra.run.trial105.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 64 kB/s | 37 kB 00:00 2026-02-24T08:06:40.569 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:06:40.589 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:06:40.589 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:06:40.697 INFO:teuthology.orchestra.run.trial105.stdout:(25/37): qatlib-25.08.0-2.el9.x86_64.rpm 313 kB/s | 240 kB 00:00 2026-02-24T08:06:40.836 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:06:40.836 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:06:40.899 INFO:teuthology.orchestra.run.trial105.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.5 MB/s | 308 kB 00:00 2026-02-24T08:06:41.126 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:06:41.184 INFO:teuthology.orchestra.run.trial105.stdout:(27/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 106 kB/s | 66 kB 00:00 2026-02-24T08:06:41.267 INFO:teuthology.orchestra.run.trial165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-24T08:06:41.271 INFO:teuthology.orchestra.run.trial165.stdout: Upgrading : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T08:06:41.318 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T08:06:41.319 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T08:06:41.330 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T08:06:41.332 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 4/39 2026-02-24T08:06:41.332 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T08:06:41.360 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T08:06:41.363 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 6/39 2026-02-24T08:06:41.371 INFO:teuthology.orchestra.run.trial165.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-24T08:06:41.375 INFO:teuthology.orchestra.run.trial165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-24T08:06:41.378 INFO:teuthology.orchestra.run.trial165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-24T08:06:41.383 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-24T08:06:41.395 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 11/39 2026-02-24T08:06:41.408 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T08:06:41.409 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T08:06:41.432 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T08:06:41.435 INFO:teuthology.orchestra.run.trial165.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-24T08:06:41.454 INFO:teuthology.orchestra.run.trial105.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 92 kB/s | 25 kB 00:00 2026-02-24T08:06:41.470 INFO:teuthology.orchestra.run.trial165.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-24T08:06:41.475 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-24T08:06:41.481 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-24T08:06:41.483 INFO:teuthology.orchestra.run.trial165.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-24T08:06:41.487 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-24T08:06:41.537 INFO:teuthology.orchestra.run.trial105.stdout:(29/37): libarrow-9.0.0-15.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2026-02-24T08:06:41.538 INFO:teuthology.orchestra.run.trial105.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 587 kB/s | 49 kB 00:00 2026-02-24T08:06:41.555 INFO:teuthology.orchestra.run.trial105.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 3.6 MB/s | 67 kB 00:00 2026-02-24T08:06:41.601 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T08:06:41.602 INFO:teuthology.orchestra.run.trial165.stdout: Upgrading : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T08:06:41.628 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T08:06:41.630 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 22/39 2026-02-24T08:06:41.637 INFO:teuthology.orchestra.run.trial165.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-24T08:06:41.671 INFO:teuthology.orchestra.run.trial105.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 6.1 MB/s | 838 kB 00:00 2026-02-24T08:06:41.697 INFO:teuthology.orchestra.run.trial105.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2026-02-24T08:06:41.883 INFO:teuthology.orchestra.run.trial165.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-24T08:06:41.884 INFO:teuthology.orchestra.run.trial165.stdout: Installing : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T08:06:41.901 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T08:06:41.906 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 26/39 2026-02-24T08:06:41.910 INFO:teuthology.orchestra.run.trial165.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-24T08:06:41.913 INFO:teuthology.orchestra.run.trial165.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-24T08:06:41.913 INFO:teuthology.orchestra.run.trial165.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T08:06:41.927 INFO:teuthology.orchestra.run.trial105.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 6.2 MB/s | 1.6 MB 00:00 2026-02-24T08:06:41.931 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T08:06:42.046 INFO:teuthology.orchestra.run.trial165.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-24T08:06:42.049 INFO:teuthology.orchestra.run.trial165.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T08:06:42.331 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T08:06:42.331 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T08:06:42.331 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:42.376 INFO:teuthology.orchestra.run.trial165.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-24T08:06:42.378 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 33/39 2026-02-24T08:06:43.318 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T08:06:43.321 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T08:06:43.496 INFO:teuthology.orchestra.run.trial105.stdout:(35/37): librados2-20.3.0-5440.gff63f3d9.el9.x8 1.8 MB/s | 3.3 MB 00:01 2026-02-24T08:06:43.583 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T08:06:43.586 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T08:06:43.626 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T08:06:43.626 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T08:06:43.626 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T08:06:43.626 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:43.629 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T08:06:43.686 INFO:teuthology.orchestra.run.trial105.stdout:(36/37): librbd1-20.3.0-5440.gff63f3d9.el9.x86_ 1.5 MB/s | 2.7 MB 00:01 2026-02-24T08:06:45.121 INFO:teuthology.orchestra.run.trial105.stdout:(37/37): ceph-common-20.3.0-5440.gff63f3d9.el9. 1.2 MB/s | 21 MB 00:17 2026-02-24T08:06:45.123 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:06:45.124 INFO:teuthology.orchestra.run.trial105.stdout:Total 3.4 MB/s | 61 MB 00:18 2026-02-24T08:06:45.219 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:06:45.237 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:06:45.237 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:06:45.480 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:06:45.480 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:06:45.772 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:06:45.912 INFO:teuthology.orchestra.run.trial105.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-24T08:06:45.915 INFO:teuthology.orchestra.run.trial105.stdout: Upgrading : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T08:06:45.964 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T08:06:45.965 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T08:06:45.978 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T08:06:45.980 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 4/39 2026-02-24T08:06:45.980 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T08:06:46.008 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T08:06:46.010 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 6/39 2026-02-24T08:06:46.018 INFO:teuthology.orchestra.run.trial105.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-24T08:06:46.021 INFO:teuthology.orchestra.run.trial105.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-24T08:06:46.024 INFO:teuthology.orchestra.run.trial105.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-24T08:06:46.028 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-24T08:06:46.039 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 11/39 2026-02-24T08:06:46.052 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T08:06:46.052 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T08:06:46.073 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T08:06:46.076 INFO:teuthology.orchestra.run.trial105.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-24T08:06:46.106 INFO:teuthology.orchestra.run.trial105.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-24T08:06:46.109 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-24T08:06:46.115 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-24T08:06:46.118 INFO:teuthology.orchestra.run.trial105.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-24T08:06:46.122 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-24T08:06:46.237 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T08:06:46.238 INFO:teuthology.orchestra.run.trial105.stdout: Upgrading : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T08:06:46.266 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T08:06:46.268 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 22/39 2026-02-24T08:06:46.275 INFO:teuthology.orchestra.run.trial105.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-24T08:06:46.526 INFO:teuthology.orchestra.run.trial105.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-24T08:06:46.526 INFO:teuthology.orchestra.run.trial105.stdout: Installing : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T08:06:46.545 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T08:06:46.549 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 26/39 2026-02-24T08:06:46.554 INFO:teuthology.orchestra.run.trial105.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-24T08:06:46.557 INFO:teuthology.orchestra.run.trial105.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-24T08:06:46.557 INFO:teuthology.orchestra.run.trial105.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T08:06:46.575 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T08:06:46.690 INFO:teuthology.orchestra.run.trial105.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-24T08:06:46.692 INFO:teuthology.orchestra.run.trial105.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T08:06:46.972 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T08:06:46.972 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T08:06:46.973 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:47.019 INFO:teuthology.orchestra.run.trial105.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-24T08:06:47.021 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 33/39 2026-02-24T08:06:47.960 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T08:06:47.963 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T08:06:48.112 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T08:06:48.112 INFO:teuthology.orchestra.run.trial165.stdout:skipping the directory /sys 2026-02-24T08:06:48.112 INFO:teuthology.orchestra.run.trial165.stdout:skipping the directory /proc 2026-02-24T08:06:48.112 INFO:teuthology.orchestra.run.trial165.stdout:skipping the directory /mnt 2026-02-24T08:06:48.112 INFO:teuthology.orchestra.run.trial165.stdout:skipping the directory /var/tmp 2026-02-24T08:06:48.112 INFO:teuthology.orchestra.run.trial165.stdout:skipping the directory /home 2026-02-24T08:06:48.112 INFO:teuthology.orchestra.run.trial165.stdout:skipping the directory /root 2026-02-24T08:06:48.112 INFO:teuthology.orchestra.run.trial165.stdout:skipping the directory /tmp 2026-02-24T08:06:48.113 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:48.229 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T08:06:48.232 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T08:06:48.274 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T08:06:48.274 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T08:06:48.274 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T08:06:48.274 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:48.278 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T08:06:48.607 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T08:06:48.630 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T08:06:48.630 INFO:teuthology.orchestra.run.trial165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:06:48.630 INFO:teuthology.orchestra.run.trial165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T08:06:48.630 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T08:06:48.630 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T08:06:48.630 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:48.632 INFO:teuthology.orchestra.run.trial165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T08:06:48.644 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T08:06:48.644 INFO:teuthology.orchestra.run.trial165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T08:06:48.700 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T08:06:48.700 INFO:teuthology.orchestra.run.trial165.stdout:Creating group 'qat' with GID 992. 2026-02-24T08:06:48.700 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:48.990 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/39 2026-02-24T08:06:48.990 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T08:06:48.990 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T08:06:48.990 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/39 2026-02-24T08:06:48.990 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T08:06:48.990 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 7/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 8/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 9/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 10/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 11/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 13/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 14/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 15/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-24T08:06:48.991 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-24T08:06:48.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-24T08:06:48.993 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-24T08:06:48.993 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-24T08:06:48.993 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-24T08:06:48.993 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-24T08:06:48.993 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-24T08:06:48.993 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T08:06:48.993 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-24T08:06:48.993 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 38/39 2026-02-24T08:06:49.058 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T08:06:49.059 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:49.059 INFO:teuthology.orchestra.run.trial165.stdout:Upgraded: 2026-02-24T08:06:49.059 INFO:teuthology.orchestra.run.trial165.stdout: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.059 INFO:teuthology.orchestra.run.trial165.stdout: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.059 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:06:49.059 INFO:teuthology.orchestra.run.trial165.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T08:06:49.059 INFO:teuthology.orchestra.run.trial165.stdout: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.059 INFO:teuthology.orchestra.run.trial165.stdout: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T08:06:49.060 INFO:teuthology.orchestra.run.trial165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.061 INFO:teuthology.orchestra.run.trial165.stdout: python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout: python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout: python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout: python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:49.062 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:06:49.100 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-test 2026-02-24T08:06:49.424 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:00:31 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:06:49.509 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:06:49.509 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout: Package Arch Version Repository Size 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout: ceph-test x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 126 M 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout:Installing dependencies: 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout: libcephsqlite x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 153 k 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-24T08:06:49.510 INFO:teuthology.orchestra.run.trial165.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout:Install 12 Packages 2026-02-24T08:06:49.511 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:06:49.512 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 131 M 2026-02-24T08:06:49.512 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 977 M 2026-02-24T08:06:49.512 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:06:49.822 INFO:teuthology.orchestra.run.trial165.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 22 MB/s | 2.1 MB 00:00 2026-02-24T08:06:49.849 INFO:teuthology.orchestra.run.trial165.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 856 kB/s | 23 kB 00:00 2026-02-24T08:06:49.873 INFO:teuthology.orchestra.run.trial165.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 3.9 MB/s | 94 kB 00:00 2026-02-24T08:06:50.330 INFO:teuthology.orchestra.run.trial165.stdout:(4/12): libcephsqlite-20.3.0-5440.gff63f3d9.el9 254 kB/s | 153 kB 00:00 2026-02-24T08:06:50.962 INFO:teuthology.orchestra.run.trial165.stdout:(5/12): libasan8-15.2.1-7.el9.x86_64.rpm 482 kB/s | 525 kB 00:01 2026-02-24T08:06:50.980 INFO:teuthology.orchestra.run.trial165.stdout:(6/12): libubsan-11.5.0-14.el9.x86_64.rpm 271 kB/s | 176 kB 00:00 2026-02-24T08:06:51.299 INFO:teuthology.orchestra.run.trial165.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 691 kB/s | 233 kB 00:00 2026-02-24T08:06:51.715 INFO:teuthology.orchestra.run.trial165.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 729 kB/s | 303 kB 00:00 2026-02-24T08:06:51.818 INFO:teuthology.orchestra.run.trial165.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 623 kB/s | 64 kB 00:00 2026-02-24T08:06:51.922 INFO:teuthology.orchestra.run.trial165.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.1 MB/s | 122 kB 00:00 2026-02-24T08:06:52.188 INFO:teuthology.orchestra.run.trial165.stdout:(11/12): protobuf-3.14.0-17.el9.x86_64.rpm 851 kB/s | 1.0 MB 00:01 2026-02-24T08:06:52.746 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T08:06:52.746 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /sys 2026-02-24T08:06:52.746 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /proc 2026-02-24T08:06:52.746 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /mnt 2026-02-24T08:06:52.746 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /var/tmp 2026-02-24T08:06:52.746 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /home 2026-02-24T08:06:52.747 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /root 2026-02-24T08:06:52.747 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /tmp 2026-02-24T08:06:52.747 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:53.238 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T08:06:53.262 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T08:06:53.262 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:06:53.262 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T08:06:53.262 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T08:06:53.262 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T08:06:53.262 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:53.263 INFO:teuthology.orchestra.run.trial105.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T08:06:53.275 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T08:06:53.275 INFO:teuthology.orchestra.run.trial105.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T08:06:53.330 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T08:06:53.330 INFO:teuthology.orchestra.run.trial105.stdout:Creating group 'qat' with GID 992. 2026-02-24T08:06:53.330 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:53.618 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 7/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 8/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 9/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 10/39 2026-02-24T08:06:53.619 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 11/39 2026-02-24T08:06:53.620 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T08:06:53.620 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 13/39 2026-02-24T08:06:53.620 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 14/39 2026-02-24T08:06:53.620 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 15/39 2026-02-24T08:06:53.620 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-24T08:06:53.620 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-24T08:06:53.620 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-24T08:06:53.620 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-24T08:06:53.620 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-24T08:06:53.621 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-24T08:06:53.622 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-24T08:06:53.622 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-24T08:06:53.622 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T08:06:53.622 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-24T08:06:53.622 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 38/39 2026-02-24T08:06:53.685 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T08:06:53.685 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout:Upgraded: 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T08:06:53.686 INFO:teuthology.orchestra.run.trial105.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T08:06:53.687 INFO:teuthology.orchestra.run.trial105.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T08:06:53.687 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.687 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.687 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.687 INFO:teuthology.orchestra.run.trial105.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T08:06:53.687 INFO:teuthology.orchestra.run.trial105.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T08:06:53.687 INFO:teuthology.orchestra.run.trial105.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T08:06:53.687 INFO:teuthology.orchestra.run.trial105.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T08:06:53.688 INFO:teuthology.orchestra.run.trial105.stdout: python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T08:06:53.689 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:53.690 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:06:53.726 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-test 2026-02-24T08:06:54.047 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:00:29 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:06:54.130 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:06:54.131 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:06:54.132 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repository Size 2026-02-24T08:06:54.132 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:06:54.132 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:06:54.132 INFO:teuthology.orchestra.run.trial105.stdout: ceph-test x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 126 M 2026-02-24T08:06:54.132 INFO:teuthology.orchestra.run.trial105.stdout:Installing dependencies: 2026-02-24T08:06:54.132 INFO:teuthology.orchestra.run.trial105.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T08:06:54.132 INFO:teuthology.orchestra.run.trial105.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-24T08:06:54.132 INFO:teuthology.orchestra.run.trial105.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T08:06:54.132 INFO:teuthology.orchestra.run.trial105.stdout: libcephsqlite x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 153 k 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout:Install 12 Packages 2026-02-24T08:06:54.133 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:06:54.134 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 131 M 2026-02-24T08:06:54.134 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 977 M 2026-02-24T08:06:54.134 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:06:54.743 INFO:teuthology.orchestra.run.trial105.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2026-02-24T08:06:54.764 INFO:teuthology.orchestra.run.trial105.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 23 kB 00:00 2026-02-24T08:06:54.787 INFO:teuthology.orchestra.run.trial105.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 4.1 MB/s | 94 kB 00:00 2026-02-24T08:06:54.995 INFO:teuthology.orchestra.run.trial105.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 2.5 MB/s | 525 kB 00:00 2026-02-24T08:06:55.020 INFO:teuthology.orchestra.run.trial105.stdout:(5/12): libcephsqlite-20.3.0-5440.gff63f3d9.el9 338 kB/s | 153 kB 00:00 2026-02-24T08:06:55.040 INFO:teuthology.orchestra.run.trial105.stdout:(6/12): libubsan-11.5.0-14.el9.x86_64.rpm 3.8 MB/s | 176 kB 00:00 2026-02-24T08:06:55.110 INFO:teuthology.orchestra.run.trial105.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2026-02-24T08:06:55.176 INFO:teuthology.orchestra.run.trial105.stdout:(8/12): libxslt-1.1.34-12.el9.x86_64.rpm 1.5 MB/s | 233 kB 00:00 2026-02-24T08:06:55.182 INFO:teuthology.orchestra.run.trial105.stdout:(9/12): socat-1.7.4.1-8.el9.x86_64.rpm 4.2 MB/s | 303 kB 00:00 2026-02-24T08:06:55.210 INFO:teuthology.orchestra.run.trial105.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 64 kB 00:00 2026-02-24T08:06:55.221 INFO:teuthology.orchestra.run.trial105.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.0 MB/s | 122 kB 00:00 2026-02-24T08:07:29.344 INFO:teuthology.orchestra.run.trial105.stdout:(12/12): ceph-test-20.3.0-5440.gff63f3d9.el9.x8 3.6 MB/s | 126 MB 00:34 2026-02-24T08:07:29.346 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:07:29.346 INFO:teuthology.orchestra.run.trial105.stdout:Total 3.7 MB/s | 131 MB 00:35 2026-02-24T08:07:29.423 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:07:29.434 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:07:29.434 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:07:29.862 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:07:29.862 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:07:30.316 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:07:30.325 INFO:teuthology.orchestra.run.trial105.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-24T08:07:30.333 INFO:teuthology.orchestra.run.trial105.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-24T08:07:30.338 INFO:teuthology.orchestra.run.trial105.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-24T08:07:30.342 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-24T08:07:30.344 INFO:teuthology.orchestra.run.trial105.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-24T08:07:30.349 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-24T08:07:30.350 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T08:07:30.365 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T08:07:30.369 INFO:teuthology.orchestra.run.trial105.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-24T08:07:30.378 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-24T08:07:30.386 INFO:teuthology.orchestra.run.trial105.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-24T08:07:30.387 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T08:07:31.786 INFO:teuthology.orchestra.run.trial165.stdout:(12/12): ceph-test-20.3.0-5440.gff63f3d9.el9.x8 3.0 MB/s | 126 MB 00:42 2026-02-24T08:07:31.789 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:07:31.789 INFO:teuthology.orchestra.run.trial165.stdout:Total 3.1 MB/s | 131 MB 00:42 2026-02-24T08:07:31.864 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:07:31.874 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:07:31.875 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:07:32.301 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:07:32.301 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:07:32.752 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:07:32.761 INFO:teuthology.orchestra.run.trial165.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-24T08:07:32.769 INFO:teuthology.orchestra.run.trial165.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-24T08:07:32.775 INFO:teuthology.orchestra.run.trial165.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-24T08:07:32.780 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-24T08:07:32.783 INFO:teuthology.orchestra.run.trial165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-24T08:07:32.787 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-24T08:07:32.788 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T08:07:32.804 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T08:07:32.806 INFO:teuthology.orchestra.run.trial165.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-24T08:07:32.818 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-24T08:07:32.826 INFO:teuthology.orchestra.run.trial165.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-24T08:07:32.827 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T08:07:37.252 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T08:07:37.271 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T08:07:38.078 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T08:07:38.078 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/12 2026-02-24T08:07:38.078 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/12 2026-02-24T08:07:38.078 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-24T08:07:38.078 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-24T08:07:38.078 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-24T08:07:38.079 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-24T08:07:38.079 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-24T08:07:38.079 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-24T08:07:38.079 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-24T08:07:38.079 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-24T08:07:38.079 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-24T08:07:38.140 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-24T08:07:38.140 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:07:38.140 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:07:38.140 INFO:teuthology.orchestra.run.trial105.stdout: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:07:38.140 INFO:teuthology.orchestra.run.trial105.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T08:07:38.140 INFO:teuthology.orchestra.run.trial105.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-24T08:07:38.140 INFO:teuthology.orchestra.run.trial105.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T08:07:38.140 INFO:teuthology.orchestra.run.trial105.stdout: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:07:38.141 INFO:teuthology.orchestra.run.trial105.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-24T08:07:38.141 INFO:teuthology.orchestra.run.trial105.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T08:07:38.141 INFO:teuthology.orchestra.run.trial105.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T08:07:38.141 INFO:teuthology.orchestra.run.trial105.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T08:07:38.141 INFO:teuthology.orchestra.run.trial105.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T08:07:38.141 INFO:teuthology.orchestra.run.trial105.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T08:07:38.141 INFO:teuthology.orchestra.run.trial105.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T08:07:38.141 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:07:38.141 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:07:38.182 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph 2026-02-24T08:07:38.501 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:01:13 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:07:38.588 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout:======================================================================================= 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repository Size 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout:======================================================================================= 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout: ceph x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 6.5 k 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout:Installing dependencies: 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 57 k 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mds x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.0 M 2026-02-24T08:07:38.591 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 937 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 298 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 4.9 M 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 163 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-classic x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 15 M 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-crimson x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 87 M 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 17 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 1.0 M 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T08:07:38.592 INFO:teuthology.orchestra.run.trial105.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T08:07:38.593 INFO:teuthology.orchestra.run.trial105.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T08:07:38.594 INFO:teuthology.orchestra.run.trial105.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T08:07:38.595 INFO:teuthology.orchestra.run.trial105.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout:Installing weak dependencies: 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 184 k 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 51 M 2026-02-24T08:07:38.596 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 7.4 M 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 22 k 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-rook noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 50 k 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout: ceph-volume noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 301 k 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout:======================================================================================= 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout:Install 96 Packages 2026-02-24T08:07:38.597 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:07:38.598 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 225 M 2026-02-24T08:07:38.598 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 1.5 G 2026-02-24T08:07:38.598 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:07:39.370 INFO:teuthology.orchestra.run.trial105.stdout:(1/96): ceph-20.3.0-5440.gff63f3d9.el9.x86_64.r 23 kB/s | 6.5 kB 00:00 2026-02-24T08:07:39.713 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T08:07:39.732 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T08:07:40.431 INFO:teuthology.orchestra.run.trial105.stdout:(2/96): ceph-mgr-20.3.0-5440.gff63f3d9.el9.x86_ 696 kB/s | 937 kB 00:01 2026-02-24T08:07:40.541 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T08:07:40.541 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/12 2026-02-24T08:07:40.541 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/12 2026-02-24T08:07:40.541 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-24T08:07:40.541 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-24T08:07:40.541 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-24T08:07:40.541 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-24T08:07:40.542 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-24T08:07:40.542 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-24T08:07:40.542 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-24T08:07:40.542 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-24T08:07:40.542 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-24T08:07:40.602 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-24T08:07:40.602 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T08:07:40.603 INFO:teuthology.orchestra.run.trial165.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T08:07:40.604 INFO:teuthology.orchestra.run.trial165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T08:07:40.604 INFO:teuthology.orchestra.run.trial165.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T08:07:40.604 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:07:40.604 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:07:40.640 INFO:teuthology.orchestra.run.trial105.stdout:(3/96): ceph-osd-20.3.0-5440.gff63f3d9.el9.x86_ 781 kB/s | 163 kB 00:00 2026-02-24T08:07:40.647 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph 2026-02-24T08:07:40.961 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:01:22 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:07:41.047 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:07:41.050 INFO:teuthology.orchestra.run.trial165.stdout:======================================================================================= 2026-02-24T08:07:41.050 INFO:teuthology.orchestra.run.trial165.stdout: Package Arch Version Repository Size 2026-02-24T08:07:41.050 INFO:teuthology.orchestra.run.trial165.stdout:======================================================================================= 2026-02-24T08:07:41.050 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:07:41.050 INFO:teuthology.orchestra.run.trial165.stdout: ceph x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 6.5 k 2026-02-24T08:07:41.050 INFO:teuthology.orchestra.run.trial165.stdout:Installing dependencies: 2026-02-24T08:07:41.050 INFO:teuthology.orchestra.run.trial165.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T08:07:41.050 INFO:teuthology.orchestra.run.trial165.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 57 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mds x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.0 M 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 937 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 298 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 4.9 M 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: ceph-osd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 163 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: ceph-osd-classic x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 15 M 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: ceph-osd-crimson x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 87 M 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 17 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 1.0 M 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T08:07:41.051 INFO:teuthology.orchestra.run.trial165.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T08:07:41.052 INFO:teuthology.orchestra.run.trial165.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T08:07:41.053 INFO:teuthology.orchestra.run.trial165.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T08:07:41.054 INFO:teuthology.orchestra.run.trial165.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout:Installing weak dependencies: 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 184 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 51 M 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 7.4 M 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 22 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-rook noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 50 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: ceph-volume noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 301 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T08:07:41.055 INFO:teuthology.orchestra.run.trial165.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T08:07:41.056 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:07:41.056 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:07:41.056 INFO:teuthology.orchestra.run.trial165.stdout:======================================================================================= 2026-02-24T08:07:41.056 INFO:teuthology.orchestra.run.trial165.stdout:Install 96 Packages 2026-02-24T08:07:41.056 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:07:41.056 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 225 M 2026-02-24T08:07:41.056 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 1.5 G 2026-02-24T08:07:41.056 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:07:41.552 INFO:teuthology.orchestra.run.trial105.stdout:(4/96): ceph-mds-20.3.0-5440.gff63f3d9.el9.x86_ 840 kB/s | 2.0 MB 00:02 2026-02-24T08:07:41.826 INFO:teuthology.orchestra.run.trial165.stdout:(1/96): ceph-20.3.0-5440.gff63f3d9.el9.x86_64.r 23 kB/s | 6.5 kB 00:00 2026-02-24T08:07:42.409 INFO:teuthology.orchestra.run.trial165.stdout:(2/96): ceph-mds-20.3.0-5440.gff63f3d9.el9.x86_ 2.3 MB/s | 2.0 MB 00:00 2026-02-24T08:07:42.436 INFO:teuthology.orchestra.run.trial165.stdout:(3/96): ceph-mgr-20.3.0-5440.gff63f3d9.el9.x86_ 1.0 MB/s | 937 kB 00:00 2026-02-24T08:07:42.472 INFO:teuthology.orchestra.run.trial165.stdout:(4/96): ceph-osd-20.3.0-5440.gff63f3d9.el9.x86_ 2.5 MB/s | 163 kB 00:00 2026-02-24T08:07:43.597 INFO:teuthology.orchestra.run.trial165.stdout:(5/96): ceph-mon-20.3.0-5440.gff63f3d9.el9.x86_ 2.7 MB/s | 4.9 MB 00:01 2026-02-24T08:07:43.663 INFO:teuthology.orchestra.run.trial165.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5440.gff 877 kB/s | 57 kB 00:00 2026-02-24T08:07:43.729 INFO:teuthology.orchestra.run.trial165.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5440.gff63f3d9. 2.7 MB/s | 184 kB 00:00 2026-02-24T08:07:46.220 INFO:teuthology.orchestra.run.trial105.stdout:(5/96): ceph-mon-20.3.0-5440.gff63f3d9.el9.x86_ 727 kB/s | 4.9 MB 00:06 2026-02-24T08:07:46.351 INFO:teuthology.orchestra.run.trial105.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5440.gff 436 kB/s | 57 kB 00:00 2026-02-24T08:07:46.638 INFO:teuthology.orchestra.run.trial105.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5440.gff63f3d9. 641 kB/s | 184 kB 00:00 2026-02-24T08:07:47.108 INFO:teuthology.orchestra.run.trial165.stdout:(8/96): ceph-osd-classic-20.3.0-5440.gff63f3d9. 3.2 MB/s | 15 MB 00:04 2026-02-24T08:07:50.614 INFO:teuthology.orchestra.run.trial165.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-54 2.1 MB/s | 7.4 MB 00:03 2026-02-24T08:07:50.680 INFO:teuthology.orchestra.run.trial165.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5440.gff63f3 337 kB/s | 22 kB 00:00 2026-02-24T08:07:50.883 INFO:teuthology.orchestra.run.trial165.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5440.gff6 1.4 MB/s | 298 kB 00:00 2026-02-24T08:07:50.951 INFO:teuthology.orchestra.run.trial165.stdout:(12/96): ceph-mgr-rook-20.3.0-5440.gff63f3d9.el 751 kB/s | 50 kB 00:00 2026-02-24T08:07:51.019 INFO:teuthology.orchestra.run.trial165.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5440.gff 253 kB/s | 17 kB 00:00 2026-02-24T08:07:51.225 INFO:teuthology.orchestra.run.trial165.stdout:(14/96): ceph-volume-20.3.0-5440.gff63f3d9.el9. 1.4 MB/s | 301 kB 00:00 2026-02-24T08:07:51.968 INFO:teuthology.orchestra.run.trial165.stdout:(15/96): cephadm-20.3.0-5440.gff63f3d9.el9.noar 1.4 MB/s | 1.0 MB 00:00 2026-02-24T08:07:52.025 INFO:teuthology.orchestra.run.trial165.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 6.0 MB/s | 351 kB 00:00 2026-02-24T08:07:52.050 INFO:teuthology.orchestra.run.trial165.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.7 MB/s | 40 kB 00:00 2026-02-24T08:07:52.082 INFO:teuthology.orchestra.run.trial165.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 2.2 MB/s | 72 kB 00:00 2026-02-24T08:07:52.111 INFO:teuthology.orchestra.run.trial165.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 27 MB/s | 794 kB 00:00 2026-02-24T08:07:52.133 INFO:teuthology.orchestra.run.trial165.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 8.2 MB/s | 184 kB 00:00 2026-02-24T08:07:52.163 INFO:teuthology.orchestra.run.trial165.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.2 MB/s | 253 kB 00:00 2026-02-24T08:07:52.194 INFO:teuthology.orchestra.run.trial165.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 40 MB/s | 1.2 MB 00:00 2026-02-24T08:07:52.218 INFO:teuthology.orchestra.run.trial165.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-24T08:07:52.239 INFO:teuthology.orchestra.run.trial165.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 6.3 MB/s | 135 kB 00:00 2026-02-24T08:07:52.272 INFO:teuthology.orchestra.run.trial165.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 4.4 MB/s | 150 kB 00:00 2026-02-24T08:07:52.303 INFO:teuthology.orchestra.run.trial165.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 4.0 MB/s | 126 kB 00:00 2026-02-24T08:07:52.345 INFO:teuthology.orchestra.run.trial165.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 5.1 MB/s | 218 kB 00:00 2026-02-24T08:07:52.370 INFO:teuthology.orchestra.run.trial165.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 7.4 MB/s | 182 kB 00:00 2026-02-24T08:07:52.393 INFO:teuthology.orchestra.run.trial165.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-24T08:07:52.951 INFO:teuthology.orchestra.run.trial165.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 53 kB/s | 30 kB 00:00 2026-02-24T08:07:53.988 INFO:teuthology.orchestra.run.trial165.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.9 MB/s | 3.0 MB 00:01 2026-02-24T08:07:54.467 INFO:teuthology.orchestra.run.trial165.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 31 kB/s | 15 kB 00:00 2026-02-24T08:07:55.231 INFO:teuthology.orchestra.run.trial165.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 322 kB/s | 246 kB 00:00 2026-02-24T08:07:55.681 INFO:teuthology.orchestra.run.trial105.stdout:(8/96): ceph-osd-classic-20.3.0-5440.gff63f3d9. 1.0 MB/s | 15 MB 00:15 2026-02-24T08:07:55.967 INFO:teuthology.orchestra.run.trial165.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 256 kB/s | 188 kB 00:00 2026-02-24T08:07:56.547 INFO:teuthology.orchestra.run.trial165.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 73 kB/s | 42 kB 00:00 2026-02-24T08:07:57.654 INFO:teuthology.orchestra.run.trial165.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 4.8 MB/s | 5.3 MB 00:01 2026-02-24T08:07:58.786 INFO:teuthology.orchestra.run.trial165.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2026-02-24T08:07:59.546 INFO:teuthology.orchestra.run.trial165.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 322 kB/s | 244 kB 00:00 2026-02-24T08:08:00.317 INFO:teuthology.orchestra.run.trial165.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 323 kB/s | 249 kB 00:00 2026-02-24T08:08:00.904 INFO:teuthology.orchestra.run.trial165.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 81 kB/s | 48 kB 00:00 2026-02-24T08:08:01.628 INFO:teuthology.orchestra.run.trial165.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 245 kB/s | 177 kB 00:00 2026-02-24T08:08:02.576 INFO:teuthology.orchestra.run.trial165.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 1.3 MB/s | 1.2 MB 00:00 2026-02-24T08:08:03.139 INFO:teuthology.orchestra.run.trial165.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 62 kB/s | 35 kB 00:00 2026-02-24T08:08:03.849 INFO:teuthology.orchestra.run.trial165.stdout:(44/96): ceph-mgr-dashboard-20.3.0-5440.gff63f3 2.5 MB/s | 51 MB 00:20 2026-02-24T08:08:04.081 INFO:teuthology.orchestra.run.trial105.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-54 901 kB/s | 7.4 MB 00:08 2026-02-24T08:08:04.144 INFO:teuthology.orchestra.run.trial105.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5440.gff63f3 354 kB/s | 22 kB 00:00 2026-02-24T08:08:04.294 INFO:teuthology.orchestra.run.trial165.stdout:(45/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.3 MB/s | 6.1 MB 00:01 2026-02-24T08:08:04.467 INFO:teuthology.orchestra.run.trial105.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5440.gff6 921 kB/s | 298 kB 00:00 2026-02-24T08:08:04.534 INFO:teuthology.orchestra.run.trial105.stdout:(12/96): ceph-mgr-rook-20.3.0-5440.gff63f3d9.el 756 kB/s | 50 kB 00:00 2026-02-24T08:08:04.600 INFO:teuthology.orchestra.run.trial105.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5440.gff 263 kB/s | 17 kB 00:00 2026-02-24T08:08:04.679 INFO:teuthology.orchestra.run.trial165.stdout:(46/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 533 kB/s | 442 kB 00:00 2026-02-24T08:08:04.928 INFO:teuthology.orchestra.run.trial165.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 122 kB/s | 77 kB 00:00 2026-02-24T08:08:04.939 INFO:teuthology.orchestra.run.trial105.stdout:(14/96): ceph-volume-20.3.0-5440.gff63f3d9.el9. 890 kB/s | 301 kB 00:00 2026-02-24T08:08:05.449 INFO:teuthology.orchestra.run.trial165.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 347 kB/s | 267 kB 00:00 2026-02-24T08:08:05.646 INFO:teuthology.orchestra.run.trial165.stdout:(49/96): python3-pyasn1-0.4.8-7.el9.noarch.rpm 219 kB/s | 157 kB 00:00 2026-02-24T08:08:05.820 INFO:teuthology.orchestra.run.trial105.stdout:(15/96): cephadm-20.3.0-5440.gff63f3d9.el9.noar 1.2 MB/s | 1.0 MB 00:00 2026-02-24T08:08:05.873 INFO:teuthology.orchestra.run.trial105.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 6.6 MB/s | 351 kB 00:00 2026-02-24T08:08:05.882 INFO:teuthology.orchestra.run.trial105.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.3 MB/s | 40 kB 00:00 2026-02-24T08:08:05.892 INFO:teuthology.orchestra.run.trial105.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 7.6 MB/s | 72 kB 00:00 2026-02-24T08:08:05.912 INFO:teuthology.orchestra.run.trial105.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 38 MB/s | 794 kB 00:00 2026-02-24T08:08:05.924 INFO:teuthology.orchestra.run.trial105.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 15 MB/s | 184 kB 00:00 2026-02-24T08:08:05.936 INFO:teuthology.orchestra.run.trial105.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 21 MB/s | 253 kB 00:00 2026-02-24T08:08:05.970 INFO:teuthology.orchestra.run.trial105.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-24T08:08:05.981 INFO:teuthology.orchestra.run.trial105.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 9.8 MB/s | 106 kB 00:00 2026-02-24T08:08:05.992 INFO:teuthology.orchestra.run.trial105.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 12 MB/s | 135 kB 00:00 2026-02-24T08:08:06.003 INFO:teuthology.orchestra.run.trial105.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 13 MB/s | 150 kB 00:00 2026-02-24T08:08:06.015 INFO:teuthology.orchestra.run.trial105.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-24T08:08:06.026 INFO:teuthology.orchestra.run.trial105.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 18 MB/s | 218 kB 00:00 2026-02-24T08:08:06.038 INFO:teuthology.orchestra.run.trial105.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 15 MB/s | 182 kB 00:00 2026-02-24T08:08:06.049 INFO:teuthology.orchestra.run.trial105.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 24 MB/s | 266 kB 00:00 2026-02-24T08:08:06.223 INFO:teuthology.orchestra.run.trial165.stdout:(50/96): python3-pyasn1-modules-0.4.8-7.el9.noa 358 kB/s | 277 kB 00:00 2026-02-24T08:08:06.248 INFO:teuthology.orchestra.run.trial165.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 89 kB/s | 54 kB 00:00 2026-02-24T08:08:06.639 INFO:teuthology.orchestra.run.trial105.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 50 kB/s | 30 kB 00:00 2026-02-24T08:08:06.824 INFO:teuthology.orchestra.run.trial165.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2026-02-24T08:08:07.558 INFO:teuthology.orchestra.run.trial165.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 257 kB/s | 189 kB 00:00 2026-02-24T08:08:07.645 INFO:teuthology.orchestra.run.trial165.stdout:(54/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 14 MB/s | 19 MB 00:01 2026-02-24T08:08:07.678 INFO:teuthology.orchestra.run.trial105.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.9 MB/s | 3.0 MB 00:01 2026-02-24T08:08:08.098 INFO:teuthology.orchestra.run.trial165.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 49 kB/s | 22 kB 00:00 2026-02-24T08:08:08.156 INFO:teuthology.orchestra.run.trial105.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 31 kB/s | 15 kB 00:00 2026-02-24T08:08:08.223 INFO:teuthology.orchestra.run.trial165.stdout:(56/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 136 kB/s | 90 kB 00:00 2026-02-24T08:08:08.921 INFO:teuthology.orchestra.run.trial105.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 322 kB/s | 246 kB 00:00 2026-02-24T08:08:09.139 INFO:teuthology.orchestra.run.trial165.stdout:(57/96): protobuf-compiler-3.14.0-17.el9.x86_64 828 kB/s | 862 kB 00:01 2026-02-24T08:08:09.653 INFO:teuthology.orchestra.run.trial105.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2026-02-24T08:08:10.233 INFO:teuthology.orchestra.run.trial105.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 73 kB/s | 42 kB 00:00 2026-02-24T08:08:10.457 INFO:teuthology.orchestra.run.trial165.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 15 kB/s | 19 kB 00:01 2026-02-24T08:08:11.345 INFO:teuthology.orchestra.run.trial105.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 4.8 MB/s | 5.3 MB 00:01 2026-02-24T08:08:12.196 INFO:teuthology.orchestra.run.trial165.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 87 kB/s | 151 kB 00:01 2026-02-24T08:08:12.476 INFO:teuthology.orchestra.run.trial105.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2026-02-24T08:08:13.062 INFO:teuthology.orchestra.run.trial165.stdout:(60/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 114 kB/s | 551 kB 00:04 2026-02-24T08:08:13.239 INFO:teuthology.orchestra.run.trial105.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 320 kB/s | 244 kB 00:00 2026-02-24T08:08:13.529 INFO:teuthology.orchestra.run.trial165.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 63 kB/s | 29 kB 00:00 2026-02-24T08:08:14.009 INFO:teuthology.orchestra.run.trial105.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 323 kB/s | 249 kB 00:00 2026-02-24T08:08:14.594 INFO:teuthology.orchestra.run.trial105.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 81 kB/s | 48 kB 00:00 2026-02-24T08:08:14.776 INFO:teuthology.orchestra.run.trial165.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 48 kB/s | 60 kB 00:01 2026-02-24T08:08:15.322 INFO:teuthology.orchestra.run.trial105.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 243 kB/s | 177 kB 00:00 2026-02-24T08:08:15.395 INFO:teuthology.orchestra.run.trial165.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 70 kB/s | 43 kB 00:00 2026-02-24T08:08:16.024 INFO:teuthology.orchestra.run.trial165.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 51 kB/s | 32 kB 00:00 2026-02-24T08:08:16.271 INFO:teuthology.orchestra.run.trial105.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 1.3 MB/s | 1.2 MB 00:00 2026-02-24T08:08:16.838 INFO:teuthology.orchestra.run.trial105.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 61 kB/s | 35 kB 00:00 2026-02-24T08:08:17.063 INFO:teuthology.orchestra.run.trial165.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 14 kB/s | 14 kB 00:01 2026-02-24T08:08:17.966 INFO:teuthology.orchestra.run.trial105.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.4 MB/s | 6.1 MB 00:01 2026-02-24T08:08:18.364 INFO:teuthology.orchestra.run.trial165.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 133 kB/s | 173 kB 00:01 2026-02-24T08:08:18.798 INFO:teuthology.orchestra.run.trial105.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 532 kB/s | 442 kB 00:00 2026-02-24T08:08:19.310 INFO:teuthology.orchestra.run.trial165.stdout:(67/96): python3-asyncssh-2.13.2-5.el9.noarch.r 77 kB/s | 548 kB 00:07 2026-02-24T08:08:19.430 INFO:teuthology.orchestra.run.trial105.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 122 kB/s | 77 kB 00:00 2026-02-24T08:08:20.203 INFO:teuthology.orchestra.run.trial105.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 346 kB/s | 267 kB 00:00 2026-02-24T08:08:20.441 INFO:teuthology.orchestra.run.trial165.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 173 kB/s | 358 kB 00:02 2026-02-24T08:08:20.922 INFO:teuthology.orchestra.run.trial105.stdout:(48/96): python3-pyasn1-0.4.8-7.el9.noarch.rpm 219 kB/s | 157 kB 00:00 2026-02-24T08:08:21.701 INFO:teuthology.orchestra.run.trial105.stdout:(49/96): python3-pyasn1-modules-0.4.8-7.el9.noa 356 kB/s | 277 kB 00:00 2026-02-24T08:08:21.792 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] python3-grpcio-1.46.7-10.el9.x86_64.rpm: Status code: 500 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-grpcio-1.46.7-10.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:08:22.039 INFO:teuthology.orchestra.run.trial165.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 93 kB/s | 254 kB 00:02 2026-02-24T08:08:22.299 INFO:teuthology.orchestra.run.trial105.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 90 kB/s | 54 kB 00:00 2026-02-24T08:08:22.777 INFO:teuthology.orchestra.run.trial105.stdout:(51/96): ceph-mgr-dashboard-20.3.0-5440.gff63f3 1.4 MB/s | 51 MB 00:36 2026-02-24T08:08:23.094 INFO:teuthology.orchestra.run.trial165.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 137 kB/s | 144 kB 00:01 2026-02-24T08:08:23.351 INFO:teuthology.orchestra.run.trial105.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2026-02-24T08:08:23.717 INFO:teuthology.orchestra.run.trial105.stdout:(53/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 14 MB/s | 19 MB 00:01 2026-02-24T08:08:24.084 INFO:teuthology.orchestra.run.trial105.stdout:(54/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 257 kB/s | 189 kB 00:00 2026-02-24T08:08:24.137 INFO:teuthology.orchestra.run.trial105.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 424 kB/s | 22 kB 00:00 2026-02-24T08:08:24.172 INFO:teuthology.orchestra.run.trial105.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 24 MB/s | 862 kB 00:00 2026-02-24T08:08:24.372 INFO:teuthology.orchestra.run.trial105.stdout:(57/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 138 kB/s | 90 kB 00:00 2026-02-24T08:08:25.263 INFO:teuthology.orchestra.run.trial105.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:08:25.751 INFO:teuthology.orchestra.run.trial165.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 52 kB/s | 139 kB 00:02 2026-02-24T08:08:26.464 INFO:teuthology.orchestra.run.trial105.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T08:08:26.800 INFO:teuthology.orchestra.run.trial105.stdout:[MIRROR] grpc-data-1.46.7-10.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/grpc-data-1.46.7-10.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:26.943 INFO:teuthology.orchestra.run.trial105.stdout:[MIRROR] grpc-data-1.46.7-10.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/grpc-data-1.46.7-10.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:26.976 INFO:teuthology.orchestra.run.trial105.stdout:(58/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 197 kB/s | 551 kB 00:02 2026-02-24T08:08:27.081 INFO:teuthology.orchestra.run.trial105.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 7.2 kB/s | 19 kB 00:02 2026-02-24T08:08:27.128 INFO:teuthology.orchestra.run.trial105.stdout:[MIRROR] luarocks-3.9.2-5.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/luarocks-3.9.2-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:27.271 INFO:teuthology.orchestra.run.trial105.stdout:[MIRROR] luarocks-3.9.2-5.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/luarocks-3.9.2-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:27.589 INFO:teuthology.orchestra.run.trial105.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 246 kB/s | 151 kB 00:00 2026-02-24T08:08:27.675 INFO:teuthology.orchestra.run.trial105.stdout:[MIRROR] python3-asyncssh-2.13.2-5.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:27.732 INFO:teuthology.orchestra.run.trial105.stdout:[MIRROR] python3-autocommand-2.2.2-8.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-autocommand-2.2.2-8.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:27.869 INFO:teuthology.orchestra.run.trial105.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 105 kB/s | 29 kB 00:00 2026-02-24T08:08:28.051 INFO:teuthology.orchestra.run.trial105.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 331 kB/s | 60 kB 00:00 2026-02-24T08:08:28.121 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] python3-isodate-0.6.1-3.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-isodate-0.6.1-3.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:28.237 INFO:teuthology.orchestra.run.trial105.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 233 kB/s | 43 kB 00:00 2026-02-24T08:08:28.375 INFO:teuthology.orchestra.run.trial105.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 234 kB/s | 32 kB 00:00 2026-02-24T08:08:28.449 INFO:teuthology.orchestra.run.trial105.stdout:[MIRROR] python3-asyncssh-2.13.2-5.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:28.469 INFO:teuthology.orchestra.run.trial105.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 150 kB/s | 14 kB 00:00 2026-02-24T08:08:28.745 INFO:teuthology.orchestra.run.trial105.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 628 kB/s | 173 kB 00:00 2026-02-24T08:08:29.137 INFO:teuthology.orchestra.run.trial105.stdout:(67/96): python3-asyncssh-2.13.2-5.el9.noarch.r 267 kB/s | 548 kB 00:02 2026-02-24T08:08:29.284 INFO:teuthology.orchestra.run.trial105.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 665 kB/s | 358 kB 00:00 2026-02-24T08:08:29.447 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] python3-isodate-0.6.1-3.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-isodate-0.6.1-3.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:29.454 INFO:teuthology.orchestra.run.trial105.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 802 kB/s | 254 kB 00:00 2026-02-24T08:08:29.546 INFO:teuthology.orchestra.run.trial165.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 15 kB/s | 56 kB 00:03 2026-02-24T08:08:29.699 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] python3-jaraco-8.2.1-3.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-jaraco-8.2.1-3.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:29.769 INFO:teuthology.orchestra.run.trial105.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 458 kB/s | 144 kB 00:00 2026-02-24T08:08:29.843 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] python3-jaraco-8.2.1-3.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-jaraco-8.2.1-3.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:29.887 INFO:teuthology.orchestra.run.trial165.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 31 kB/s | 11 kB 00:00 2026-02-24T08:08:30.041 INFO:teuthology.orchestra.run.trial105.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 512 kB/s | 139 kB 00:00 2026-02-24T08:08:30.044 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] python3-jaraco-classes-3.2.1-5.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-jaraco-classes-3.2.1-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:30.186 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] python3-jaraco-classes-3.2.1-5.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-jaraco-classes-3.2.1-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:30.226 INFO:teuthology.orchestra.run.trial105.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 304 kB/s | 56 kB 00:00 2026-02-24T08:08:30.251 INFO:teuthology.orchestra.run.trial165.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 49 kB/s | 18 kB 00:00 2026-02-24T08:08:30.320 INFO:teuthology.orchestra.run.trial105.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 113 kB/s | 11 kB 00:00 2026-02-24T08:08:30.428 INFO:teuthology.orchestra.run.trial105.stdout:(74/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 1.8 MB/s | 2.0 MB 00:01 2026-02-24T08:08:30.458 INFO:teuthology.orchestra.run.trial105.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 128 kB/s | 18 kB 00:00 2026-02-24T08:08:30.567 INFO:teuthology.orchestra.run.trial105.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 167 kB/s | 23 kB 00:00 2026-02-24T08:08:30.596 INFO:teuthology.orchestra.run.trial105.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 143 kB/s | 20 kB 00:00 2026-02-24T08:08:30.705 INFO:teuthology.orchestra.run.trial105.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 141 kB/s | 19 kB 00:00 2026-02-24T08:08:30.732 INFO:teuthology.orchestra.run.trial105.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 194 kB/s | 26 kB 00:00 2026-02-24T08:08:30.919 INFO:teuthology.orchestra.run.trial105.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 423 kB/s | 79 kB 00:00 2026-02-24T08:08:31.105 INFO:teuthology.orchestra.run.trial105.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 463 kB/s | 86 kB 00:00 2026-02-24T08:08:31.269 INFO:teuthology.orchestra.run.trial165.stdout:[MIRROR] python3-jaraco-collections-3.0.0-8.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-jaraco-collections-3.0.0-8.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T08:08:31.286 INFO:teuthology.orchestra.run.trial105.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 318 kB/s | 58 kB 00:00 2026-02-24T08:08:31.340 INFO:teuthology.orchestra.run.trial165.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 21 kB/s | 23 kB 00:01 2026-02-24T08:08:31.404 INFO:teuthology.orchestra.run.trial165.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 304 kB/s | 20 kB 00:00 2026-02-24T08:08:31.424 INFO:teuthology.orchestra.run.trial105.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 119 kB/s | 16 kB 00:00 2026-02-24T08:08:31.469 INFO:teuthology.orchestra.run.trial165.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 304 kB/s | 19 kB 00:00 2026-02-24T08:08:31.532 INFO:teuthology.orchestra.run.trial165.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 413 kB/s | 26 kB 00:00 2026-02-24T08:08:31.608 INFO:teuthology.orchestra.run.trial105.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 489 kB/s | 90 kB 00:00 2026-02-24T08:08:31.702 INFO:teuthology.orchestra.run.trial165.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 6.0 MB/s | 1.0 MB 00:00 2026-02-24T08:08:31.743 INFO:teuthology.orchestra.run.trial105.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 227 kB/s | 31 kB 00:00 2026-02-24T08:08:31.760 INFO:teuthology.orchestra.run.trial105.stdout:(86/96): python3-kubernetes-26.1.0-3.el9.noarch 990 kB/s | 1.0 MB 00:01 2026-02-24T08:08:31.788 INFO:teuthology.orchestra.run.trial165.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 922 kB/s | 79 kB 00:00 2026-02-24T08:08:31.873 INFO:teuthology.orchestra.run.trial165.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2026-02-24T08:08:31.941 INFO:teuthology.orchestra.run.trial105.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 328 kB/s | 59 kB 00:00 2026-02-24T08:08:31.959 INFO:teuthology.orchestra.run.trial165.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 672 kB/s | 58 kB 00:00 2026-02-24T08:08:32.023 INFO:teuthology.orchestra.run.trial165.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 255 kB/s | 16 kB 00:00 2026-02-24T08:08:32.064 INFO:teuthology.orchestra.run.trial105.stdout:(88/96): python3-routes-2.5.1-5.el9.noarch.rpm 588 kB/s | 188 kB 00:00 2026-02-24T08:08:32.110 INFO:teuthology.orchestra.run.trial165.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2026-02-24T08:08:32.175 INFO:teuthology.orchestra.run.trial165.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 475 kB/s | 31 kB 00:00 2026-02-24T08:08:32.201 INFO:teuthology.orchestra.run.trial105.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 260 kB/s | 36 kB 00:00 2026-02-24T08:08:32.209 INFO:teuthology.orchestra.run.trial105.stdout:(90/96): python3-saml-1.16.0-1.el9.noarch.rpm 465 kB/s | 125 kB 00:00 2026-02-24T08:08:32.281 INFO:teuthology.orchestra.run.trial165.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2026-02-24T08:08:32.367 INFO:teuthology.orchestra.run.trial165.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 693 kB/s | 59 kB 00:00 2026-02-24T08:08:32.387 INFO:teuthology.orchestra.run.trial105.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 467 kB/s | 86 kB 00:00 2026-02-24T08:08:32.437 INFO:teuthology.orchestra.run.trial105.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 393 kB/s | 90 kB 00:00 2026-02-24T08:08:32.474 INFO:teuthology.orchestra.run.trial165.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 1.1 MB/s | 125 kB 00:00 2026-02-24T08:08:32.539 INFO:teuthology.orchestra.run.trial165.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 551 kB/s | 36 kB 00:00 2026-02-24T08:08:32.568 INFO:teuthology.orchestra.run.trial105.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 267 kB/s | 48 kB 00:00 2026-02-24T08:08:32.577 INFO:teuthology.orchestra.run.trial105.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 158 kB/s | 22 kB 00:00 2026-02-24T08:08:32.624 INFO:teuthology.orchestra.run.trial165.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 1.0 MB/s | 86 kB 00:00 2026-02-24T08:08:32.710 INFO:teuthology.orchestra.run.trial165.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2026-02-24T08:08:32.711 INFO:teuthology.orchestra.run.trial105.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 140 kB/s | 20 kB 00:00 2026-02-24T08:08:32.794 INFO:teuthology.orchestra.run.trial165.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 572 kB/s | 48 kB 00:00 2026-02-24T08:08:32.858 INFO:teuthology.orchestra.run.trial165.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 347 kB/s | 22 kB 00:00 2026-02-24T08:08:32.923 INFO:teuthology.orchestra.run.trial165.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 308 kB/s | 20 kB 00:00 2026-02-24T08:08:33.835 INFO:teuthology.orchestra.run.trial165.stdout:(95/96): ceph-osd-crimson-20.3.0-5440.gff63f3d9 1.7 MB/s | 87 MB 00:51 2026-02-24T08:08:46.705 INFO:teuthology.orchestra.run.trial105.stdout:(96/96): ceph-osd-crimson-20.3.0-5440.gff63f3d9 1.3 MB/s | 87 MB 01:05 2026-02-24T08:08:46.707 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:08:46.707 INFO:teuthology.orchestra.run.trial105.stdout:Total 3.3 MB/s | 225 MB 01:08 2026-02-24T08:08:47.070 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:08:47.110 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:08:47.110 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:08:47.906 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:08:47.906 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:08:48.729 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:08:48.731 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-24T08:08:48.735 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-24T08:08:48.755 INFO:teuthology.orchestra.run.trial105.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-24T08:08:48.789 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/96 2026-02-24T08:08:48.795 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-24T08:08:48.797 INFO:teuthology.orchestra.run.trial105.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-24T08:08:48.801 INFO:teuthology.orchestra.run.trial105.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-24T08:08:48.824 INFO:teuthology.orchestra.run.trial105.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-24T08:08:48.837 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-24T08:08:48.840 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-24T08:08:48.846 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-24T08:08:48.847 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-24T08:08:48.858 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-24T08:08:48.864 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-24T08:08:48.888 INFO:teuthology.orchestra.run.trial105.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-24T08:08:48.891 INFO:teuthology.orchestra.run.trial105.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-24T08:08:48.940 INFO:teuthology.orchestra.run.trial105.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-24T08:08:48.953 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 18/96 2026-02-24T08:08:48.955 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-24T08:08:48.960 INFO:teuthology.orchestra.run.trial105.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-24T08:08:48.965 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-24T08:08:48.969 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-24T08:08:48.972 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-24T08:08:48.987 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-24T08:08:48.991 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-24T08:08:48.996 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-24T08:08:49.007 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-24T08:08:49.016 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-24T08:08:49.022 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-24T08:08:49.041 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-24T08:08:49.052 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-24T08:08:49.068 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-24T08:08:49.072 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-24T08:08:49.080 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-24T08:08:49.119 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-24T08:08:49.440 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-24T08:08:49.449 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-24T08:08:49.453 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-24T08:08:49.459 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-24T08:08:49.460 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-24T08:08:49.488 INFO:teuthology.orchestra.run.trial105.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-24T08:08:49.531 INFO:teuthology.orchestra.run.trial105.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-24T08:08:49.539 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-24T08:08:49.544 INFO:teuthology.orchestra.run.trial105.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-24T08:08:49.548 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-24T08:08:49.554 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-24T08:08:49.557 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-24T08:08:49.564 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-24T08:08:49.567 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-24T08:08:49.595 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-24T08:08:49.604 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-24T08:08:49.610 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-24T08:08:49.617 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-24T08:08:49.651 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-24T08:08:49.872 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-24T08:08:49.895 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-24T08:08:49.899 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-24T08:08:49.957 INFO:teuthology.orchestra.run.trial105.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-24T08:08:49.959 INFO:teuthology.orchestra.run.trial105.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-24T08:08:49.980 INFO:teuthology.orchestra.run.trial105.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-24T08:08:50.300 INFO:teuthology.orchestra.run.trial105.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-24T08:08:50.372 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-24T08:08:51.033 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-24T08:08:51.050 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-24T08:08:51.060 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-24T08:08:51.066 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-24T08:08:51.079 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-24T08:08:51.095 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-24T08:08:51.170 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-24T08:08:51.178 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-24T08:08:51.201 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-24T08:08:51.230 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-24T08:08:51.280 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-24T08:08:51.286 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-24T08:08:51.289 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-24T08:08:51.291 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-24T08:08:51.308 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T08:08:51.309 INFO:teuthology.orchestra.run.trial105.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T08:08:51.309 INFO:teuthology.orchestra.run.trial105.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T08:08:51.309 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:08:51.316 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T08:08:51.341 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T08:08:51.341 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T08:08:51.341 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:08:51.376 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-24T08:08:51.961 INFO:teuthology.orchestra.run.trial105.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-24T08:08:57.285 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 80/96 2026-02-24T08:08:57.347 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 81/96 2026-02-24T08:08:57.349 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T08:08:57.363 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T08:08:57.363 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:08:57.363 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T08:08:57.363 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:08:57.375 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T08:08:57.399 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T08:08:57.399 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:08:57.399 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T08:08:57.399 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T08:08:57.400 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T08:08:57.400 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:08:57.454 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T08:08:57.455 INFO:teuthology.orchestra.run.trial105.stdout: Installing : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T08:08:57.464 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 85/96 2026-02-24T08:08:57.488 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 86/96 2026-02-24T08:08:57.489 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T08:08:58.178 INFO:teuthology.orchestra.run.trial165.stdout:(96/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 55 kB/s | 2.0 MB 00:37 2026-02-24T08:08:58.181 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:08:58.181 INFO:teuthology.orchestra.run.trial165.stdout:Total 2.9 MB/s | 225 MB 01:17 2026-02-24T08:08:58.550 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:08:58.590 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:08:58.590 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:08:59.392 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:08:59.393 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:09:00.221 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:09:00.223 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-24T08:09:00.227 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-24T08:09:00.249 INFO:teuthology.orchestra.run.trial165.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-24T08:09:00.283 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/96 2026-02-24T08:09:00.289 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-24T08:09:00.291 INFO:teuthology.orchestra.run.trial165.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-24T08:09:00.296 INFO:teuthology.orchestra.run.trial165.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-24T08:09:00.319 INFO:teuthology.orchestra.run.trial165.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-24T08:09:00.332 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-24T08:09:00.335 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-24T08:09:00.341 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-24T08:09:00.343 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-24T08:09:00.354 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-24T08:09:00.360 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-24T08:09:00.371 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T08:09:00.378 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T08:09:00.385 INFO:teuthology.orchestra.run.trial165.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-24T08:09:00.388 INFO:teuthology.orchestra.run.trial165.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-24T08:09:00.438 INFO:teuthology.orchestra.run.trial165.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-24T08:09:00.451 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 18/96 2026-02-24T08:09:00.454 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-24T08:09:00.458 INFO:teuthology.orchestra.run.trial165.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-24T08:09:00.464 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-24T08:09:00.468 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-24T08:09:00.471 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-24T08:09:00.486 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-24T08:09:00.491 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-24T08:09:00.496 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-24T08:09:00.507 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-24T08:09:00.516 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-24T08:09:00.522 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-24T08:09:00.542 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-24T08:09:00.553 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-24T08:09:00.569 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-24T08:09:00.574 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-24T08:09:00.582 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-24T08:09:00.622 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-24T08:09:00.828 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T08:09:00.829 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T08:09:00.842 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T08:09:00.842 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T08:09:00.903 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T08:09:00.943 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 91/96 2026-02-24T08:09:00.944 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T08:09:00.950 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-24T08:09:00.960 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-24T08:09:00.964 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-24T08:09:00.964 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T08:09:00.964 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:00.964 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T08:09:00.964 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T08:09:00.964 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T08:09:00.965 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:00.969 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-24T08:09:00.971 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-24T08:09:00.977 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T08:09:00.999 INFO:teuthology.orchestra.run.trial165.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-24T08:09:01.044 INFO:teuthology.orchestra.run.trial165.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-24T08:09:01.053 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-24T08:09:01.058 INFO:teuthology.orchestra.run.trial165.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-24T08:09:01.062 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-24T08:09:01.068 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-24T08:09:01.071 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-24T08:09:01.078 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-24T08:09:01.082 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-24T08:09:01.110 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-24T08:09:01.120 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-24T08:09:01.126 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-24T08:09:01.133 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-24T08:09:01.167 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-24T08:09:01.193 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T08:09:01.194 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T08:09:01.215 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T08:09:01.215 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:01.215 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T08:09:01.215 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T08:09:01.215 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T08:09:01.215 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:01.297 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T08:09:01.316 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T08:09:01.316 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:01.317 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T08:09:01.317 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T08:09:01.317 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T08:09:01.317 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:01.318 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T08:09:01.324 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T08:09:01.350 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T08:09:01.394 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-24T08:09:01.418 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-24T08:09:01.423 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-24T08:09:01.481 INFO:teuthology.orchestra.run.trial165.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-24T08:09:01.483 INFO:teuthology.orchestra.run.trial165.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-24T08:09:01.504 INFO:teuthology.orchestra.run.trial165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-24T08:09:01.833 INFO:teuthology.orchestra.run.trial165.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-24T08:09:01.907 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-24T08:09:02.584 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-24T08:09:02.602 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-24T08:09:02.612 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-24T08:09:02.618 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-24T08:09:02.632 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-24T08:09:02.648 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-24T08:09:02.697 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T08:09:02.697 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/96 2026-02-24T08:09:02.697 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/96 2026-02-24T08:09:02.697 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/96 2026-02-24T08:09:02.698 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/96 2026-02-24T08:09:02.698 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 5/96 2026-02-24T08:09:02.698 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/96 2026-02-24T08:09:02.698 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 7/96 2026-02-24T08:09:02.698 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 8/96 2026-02-24T08:09:02.698 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 9/96 2026-02-24T08:09:02.698 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 10/96 2026-02-24T08:09:02.698 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 11/96 2026-02-24T08:09:02.698 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 12/96 2026-02-24T08:09:02.699 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 13/96 2026-02-24T08:09:02.699 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 14/96 2026-02-24T08:09:02.699 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 15/96 2026-02-24T08:09:02.699 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 16/96 2026-02-24T08:09:02.699 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 17/96 2026-02-24T08:09:02.699 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-24T08:09:02.699 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-24T08:09:02.699 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-24T08:09:02.700 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-24T08:09:02.701 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 50/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 51/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-24T08:09:02.702 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-24T08:09:02.703 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-24T08:09:02.704 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-24T08:09:02.705 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-24T08:09:02.725 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-24T08:09:02.733 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-24T08:09:02.757 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T08:09:02.769 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T08:09:02.770 INFO:teuthology.orchestra.run.trial105.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: zip-3.0-35.el9.x86_64 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:02.771 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:02.787 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-24T08:09:02.839 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-24T08:09:02.841 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-base 2026-02-24T08:09:02.844 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-24T08:09:02.848 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-24T08:09:02.849 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-24T08:09:02.866 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T08:09:02.866 INFO:teuthology.orchestra.run.trial165.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T08:09:02.866 INFO:teuthology.orchestra.run.trial165.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T08:09:02.866 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:02.874 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T08:09:02.900 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T08:09:02.900 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T08:09:02.900 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:02.935 INFO:teuthology.orchestra.run.trial165.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-24T08:09:03.155 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:38 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:03.220 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:03.238 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:03.239 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:03.239 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:03.260 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install cephadm 2026-02-24T08:09:03.536 INFO:teuthology.orchestra.run.trial165.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-24T08:09:03.572 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:38 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:03.639 INFO:teuthology.orchestra.run.trial105.stdout:Package cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:03.658 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:03.659 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:03.659 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:03.679 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T08:09:03.992 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:38 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:04.078 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:04.078 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:04.079 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repo Size 2026-02-24T08:09:04.079 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:04.079 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:09:04.079 INFO:teuthology.orchestra.run.trial105.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 149 k 2026-02-24T08:09:04.079 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:04.079 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:09:04.079 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:04.079 INFO:teuthology.orchestra.run.trial105.stdout:Install 1 Package 2026-02-24T08:09:04.079 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:04.080 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 149 k 2026-02-24T08:09:04.080 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 455 k 2026-02-24T08:09:04.080 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:09:04.554 INFO:teuthology.orchestra.run.trial105.stdout:ceph-immutable-object-cache-20.3.0-5440.gff63f3 315 kB/s | 149 kB 00:00 2026-02-24T08:09:04.554 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:04.554 INFO:teuthology.orchestra.run.trial105.stdout:Total 314 kB/s | 149 kB 00:00 2026-02-24T08:09:04.554 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:09:04.558 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:09:04.558 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:09:04.590 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:09:04.590 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:09:04.654 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:09:04.655 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T08:09:04.677 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T08:09:04.678 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:04.678 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T08:09:04.678 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:05.013 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T08:09:05.014 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:05.014 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:09:05.014 INFO:teuthology.orchestra.run.trial105.stdout: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:05.014 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:05.014 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:05.041 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-mgr 2026-02-24T08:09:05.356 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:40 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:05.420 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:05.439 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:05.440 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:05.440 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:05.462 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T08:09:05.776 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:40 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:05.841 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:05.860 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:05.861 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:05.861 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:05.881 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T08:09:06.199 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:41 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:06.265 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:06.284 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:06.284 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:06.284 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:06.306 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-mgr-rook 2026-02-24T08:09:06.620 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:41 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:06.685 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:06.703 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:06.704 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:06.704 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:06.724 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T08:09:07.052 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:42 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:07.117 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:07.136 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:07.136 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:07.136 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:07.159 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-osd 2026-02-24T08:09:07.476 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:42 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:07.542 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:07.561 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:07.562 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:07.562 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:07.583 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-osd-classic 2026-02-24T08:09:07.904 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:42 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:07.970 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:07.988 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:07.989 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:07.989 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:08.011 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-fuse 2026-02-24T08:09:08.324 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:43 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:08.408 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:08.408 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:08.408 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repo Size 2026-02-24T08:09:08.408 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout: ceph-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 914 k 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout:Install 1 Package 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 914 k 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 2.9 M 2026-02-24T08:09:08.409 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:09:08.988 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 80/96 2026-02-24T08:09:09.053 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 81/96 2026-02-24T08:09:09.055 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T08:09:09.069 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T08:09:09.069 INFO:teuthology.orchestra.run.trial165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:09.069 INFO:teuthology.orchestra.run.trial165.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T08:09:09.069 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:09.080 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T08:09:09.102 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T08:09:09.102 INFO:teuthology.orchestra.run.trial165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:09.102 INFO:teuthology.orchestra.run.trial165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T08:09:09.103 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T08:09:09.103 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T08:09:09.103 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:09.156 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T08:09:09.158 INFO:teuthology.orchestra.run.trial165.stdout: Installing : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T08:09:09.167 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 85/96 2026-02-24T08:09:09.192 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 86/96 2026-02-24T08:09:09.193 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T08:09:09.207 INFO:teuthology.orchestra.run.trial105.stdout:ceph-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 1.1 MB/s | 914 kB 00:00 2026-02-24T08:09:09.207 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:09.208 INFO:teuthology.orchestra.run.trial105.stdout:Total 1.1 MB/s | 914 kB 00:00 2026-02-24T08:09:09.208 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:09:09.213 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:09:09.213 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:09:09.248 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:09:09.248 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:09:09.341 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:09:09.360 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:09.587 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:09.649 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:09.650 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:09.650 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:09:09.650 INFO:teuthology.orchestra.run.trial105.stdout: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:09.650 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:09.650 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:09.678 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-volume 2026-02-24T08:09:10.001 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:44 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:10.066 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:10.085 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:10.086 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:10.086 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:10.107 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install librados-devel 2026-02-24T08:09:10.421 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:45 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:10.505 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:10.506 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repo Size 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout: librados-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 124 k 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout:Install 1 Package 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 124 k 2026-02-24T08:09:10.507 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 434 k 2026-02-24T08:09:10.508 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:09:11.071 INFO:teuthology.orchestra.run.trial105.stdout:librados-devel-20.3.0-5440.gff63f3d9.el9.x86_64 219 kB/s | 124 kB 00:00 2026-02-24T08:09:11.071 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:11.071 INFO:teuthology.orchestra.run.trial105.stdout:Total 219 kB/s | 124 kB 00:00 2026-02-24T08:09:11.071 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:09:11.074 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:09:11.074 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:09:11.106 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:09:11.106 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:09:11.162 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:09:11.179 INFO:teuthology.orchestra.run.trial105.stdout: Installing : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:11.265 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:11.327 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:11.327 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:11.328 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:09:11.328 INFO:teuthology.orchestra.run.trial105.stdout: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:11.328 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:11.328 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:11.356 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install libcephfs2 2026-02-24T08:09:11.670 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:46 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:11.736 INFO:teuthology.orchestra.run.trial105.stdout:Package libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:11.754 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:11.755 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:11.755 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:11.777 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install libcephfs-devel 2026-02-24T08:09:12.097 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:47 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:12.142 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T08:09:12.149 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T08:09:12.182 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:12.182 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repo Size 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 37 k 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout:Install 1 Package 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:12.183 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 37 k 2026-02-24T08:09:12.184 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 171 k 2026-02-24T08:09:12.184 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:09:12.540 INFO:teuthology.orchestra.run.trial105.stdout:libcephfs-devel-20.3.0-5440.gff63f3d9.el9.x86_6 104 kB/s | 37 kB 00:00 2026-02-24T08:09:12.540 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:12.540 INFO:teuthology.orchestra.run.trial105.stdout:Total 104 kB/s | 37 kB 00:00 2026-02-24T08:09:12.541 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:09:12.543 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:09:12.543 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:09:12.545 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:09:12.546 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:09:12.569 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:09:12.586 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:12.608 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T08:09:12.609 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T08:09:12.621 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T08:09:12.621 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T08:09:12.647 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:12.682 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T08:09:12.709 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:12.709 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:12.709 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:09:12.709 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:12.709 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:12.710 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:12.723 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 91/96 2026-02-24T08:09:12.724 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T08:09:12.737 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install librados2 2026-02-24T08:09:12.744 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T08:09:12.744 INFO:teuthology.orchestra.run.trial165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:12.744 INFO:teuthology.orchestra.run.trial165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T08:09:12.744 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T08:09:12.744 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T08:09:12.744 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:12.756 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T08:09:12.976 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T08:09:12.977 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T08:09:12.997 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T08:09:12.997 INFO:teuthology.orchestra.run.trial165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:12.997 INFO:teuthology.orchestra.run.trial165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T08:09:12.997 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T08:09:12.997 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T08:09:12.997 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:13.051 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:48 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:13.082 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T08:09:13.102 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T08:09:13.102 INFO:teuthology.orchestra.run.trial165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:13.102 INFO:teuthology.orchestra.run.trial165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T08:09:13.102 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T08:09:13.103 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T08:09:13.103 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:13.103 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T08:09:13.109 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T08:09:13.116 INFO:teuthology.orchestra.run.trial105.stdout:Package librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:13.132 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T08:09:13.134 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:13.134 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:13.135 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:13.156 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install librbd1 2026-02-24T08:09:13.478 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:48 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:13.544 INFO:teuthology.orchestra.run.trial105.stdout:Package librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:13.561 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:13.562 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:13.562 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:13.584 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install python3-rados 2026-02-24T08:09:13.905 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:48 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:13.972 INFO:teuthology.orchestra.run.trial105.stdout:Package python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:13.989 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:13.990 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:13.990 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:14.011 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install python3-rgw 2026-02-24T08:09:14.330 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:49 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:14.398 INFO:teuthology.orchestra.run.trial105.stdout:Package python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:14.415 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:14.416 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:14.416 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:14.437 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install python3-cephfs 2026-02-24T08:09:14.502 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 5/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 7/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 8/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 9/96 2026-02-24T08:09:14.503 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 10/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 11/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 12/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 13/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 14/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 15/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 16/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 17/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-24T08:09:14.504 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-24T08:09:14.505 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-24T08:09:14.506 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 50/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 51/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-24T08:09:14.507 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-24T08:09:14.508 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-24T08:09:14.509 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-24T08:09:14.510 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-24T08:09:14.510 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-24T08:09:14.510 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-24T08:09:14.510 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-24T08:09:14.510 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-24T08:09:14.510 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-24T08:09:14.510 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-24T08:09:14.572 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.573 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T08:09:14.574 INFO:teuthology.orchestra.run.trial165.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T08:09:14.575 INFO:teuthology.orchestra.run.trial165.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T08:09:14.576 INFO:teuthology.orchestra.run.trial165.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T08:09:14.577 INFO:teuthology.orchestra.run.trial165.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T08:09:14.578 INFO:teuthology.orchestra.run.trial165.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T08:09:14.579 INFO:teuthology.orchestra.run.trial165.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: zip-3.0-35.el9.x86_64 2026-02-24T08:09:14.580 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:14.581 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:14.640 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-base 2026-02-24T08:09:14.756 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:49 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:14.822 INFO:teuthology.orchestra.run.trial105.stdout:Package python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:14.839 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:14.840 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:14.840 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:14.861 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install python3-rbd 2026-02-24T08:09:14.960 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:02:56 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:15.025 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:15.043 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:15.044 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:15.044 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:15.066 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install cephadm 2026-02-24T08:09:15.176 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:50 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:15.243 INFO:teuthology.orchestra.run.trial105.stdout:Package python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:15.260 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:15.261 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:15.261 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:15.282 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install rbd-fuse 2026-02-24T08:09:15.384 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:02:57 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:15.449 INFO:teuthology.orchestra.run.trial165.stdout:Package cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:15.468 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:15.468 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:15.469 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:15.490 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T08:09:15.598 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:50 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:15.682 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout: Package Architecture Version Repository Size 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout: rbd-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 86 k 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout:Install 1 Package 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 86 k 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 236 k 2026-02-24T08:09:15.683 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:09:15.802 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:02:57 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:15.886 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:15.886 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:15.887 INFO:teuthology.orchestra.run.trial165.stdout: Package Arch Version Repo Size 2026-02-24T08:09:15.887 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:15.887 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:09:15.887 INFO:teuthology.orchestra.run.trial165.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 149 k 2026-02-24T08:09:15.887 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:15.887 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:09:15.887 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:15.887 INFO:teuthology.orchestra.run.trial165.stdout:Install 1 Package 2026-02-24T08:09:15.887 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:15.888 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 149 k 2026-02-24T08:09:15.888 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 455 k 2026-02-24T08:09:15.888 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:09:16.086 INFO:teuthology.orchestra.run.trial105.stdout:rbd-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 215 kB/s | 86 kB 00:00 2026-02-24T08:09:16.088 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:16.088 INFO:teuthology.orchestra.run.trial105.stdout:Total 213 kB/s | 86 kB 00:00 2026-02-24T08:09:16.088 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:09:16.093 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:09:16.093 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:09:16.124 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:09:16.124 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:09:16.176 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:09:16.194 INFO:teuthology.orchestra.run.trial105.stdout: Installing : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:16.286 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:16.352 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:16.352 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:16.352 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:09:16.352 INFO:teuthology.orchestra.run.trial105.stdout: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:16.352 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:16.352 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:16.369 INFO:teuthology.orchestra.run.trial165.stdout:ceph-immutable-object-cache-20.3.0-5440.gff63f3 310 kB/s | 149 kB 00:00 2026-02-24T08:09:16.371 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:16.371 INFO:teuthology.orchestra.run.trial165.stdout:Total 308 kB/s | 149 kB 00:00 2026-02-24T08:09:16.372 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:09:16.376 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:09:16.377 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:09:16.381 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install rbd-mirror 2026-02-24T08:09:16.408 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:09:16.408 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:09:16.464 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:09:16.465 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T08:09:16.488 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T08:09:16.488 INFO:teuthology.orchestra.run.trial165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:16.488 INFO:teuthology.orchestra.run.trial165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T08:09:16.488 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:16.699 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:51 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:16.783 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:16.783 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:16.783 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repo Size 2026-02-24T08:09:16.783 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:16.783 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:09:16.783 INFO:teuthology.orchestra.run.trial105.stdout: rbd-mirror x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.6 M 2026-02-24T08:09:16.783 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:16.783 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:09:16.784 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:16.784 INFO:teuthology.orchestra.run.trial105.stdout:Install 1 Package 2026-02-24T08:09:16.784 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:16.784 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 2.6 M 2026-02-24T08:09:16.784 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 11 M 2026-02-24T08:09:16.784 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:09:16.793 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T08:09:16.793 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:16.793 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:09:16.793 INFO:teuthology.orchestra.run.trial165.stdout: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:16.793 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:16.793 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:16.823 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-mgr 2026-02-24T08:09:17.145 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:02:59 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:17.211 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:17.230 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:17.230 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:17.231 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:17.252 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T08:09:17.564 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:02:59 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:17.629 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:17.648 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:17.648 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:17.648 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:17.669 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T08:09:17.970 INFO:teuthology.orchestra.run.trial105.stdout:rbd-mirror-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 2.2 MB/s | 2.6 MB 00:01 2026-02-24T08:09:17.971 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:17.971 INFO:teuthology.orchestra.run.trial105.stdout:Total 2.2 MB/s | 2.6 MB 00:01 2026-02-24T08:09:17.971 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:09:17.976 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:09:17.976 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:09:17.985 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:02:59 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:18.015 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:09:18.015 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:09:18.050 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:18.069 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:18.069 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:18.069 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:18.090 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-mgr-rook 2026-02-24T08:09:18.186 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:09:18.188 INFO:teuthology.orchestra.run.trial105.stdout: Installing : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:18.210 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:18.210 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:18.210 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T08:09:18.210 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T08:09:18.210 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T08:09:18.211 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:18.408 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:00 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:18.473 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:18.492 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:18.493 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:18.493 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:18.509 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:18.509 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:18.509 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:09:18.509 INFO:teuthology.orchestra.run.trial105.stdout: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:18.509 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:18.509 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:18.514 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T08:09:18.537 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install rbd-nbd 2026-02-24T08:09:18.836 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:00 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:18.860 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:53 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:18.903 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:18.922 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:18.923 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:18.923 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:18.944 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-osd 2026-02-24T08:09:18.946 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:18.946 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:18.946 INFO:teuthology.orchestra.run.trial105.stdout: Package Architecture Version Repository Size 2026-02-24T08:09:18.946 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:18.946 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:09:18.946 INFO:teuthology.orchestra.run.trial105.stdout: rbd-nbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 166 k 2026-02-24T08:09:18.946 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:18.946 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:09:18.946 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:18.947 INFO:teuthology.orchestra.run.trial105.stdout:Install 1 Package 2026-02-24T08:09:18.947 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:18.947 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 166 k 2026-02-24T08:09:18.947 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 496 k 2026-02-24T08:09:18.947 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:09:19.260 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:01 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:19.324 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:19.343 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:19.344 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:19.344 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:19.366 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-osd-classic 2026-02-24T08:09:19.378 INFO:teuthology.orchestra.run.trial105.stdout:rbd-nbd-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 385 kB/s | 166 kB 00:00 2026-02-24T08:09:19.378 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:19.379 INFO:teuthology.orchestra.run.trial105.stdout:Total 384 kB/s | 166 kB 00:00 2026-02-24T08:09:19.379 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:09:19.384 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:09:19.384 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:09:19.415 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:09:19.415 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:09:19.472 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:09:19.490 INFO:teuthology.orchestra.run.trial105.stdout: Installing : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:19.583 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:19.648 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:19.649 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:19.649 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:09:19.649 INFO:teuthology.orchestra.run.trial105.stdout: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:19.649 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:19.649 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:19.678 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-osd-crimson 2026-02-24T08:09:19.687 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:01 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:19.754 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:19.773 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:19.774 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:19.774 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:19.796 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-fuse 2026-02-24T08:09:19.997 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:54 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:20.063 INFO:teuthology.orchestra.run.trial105.stdout:Package ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:20.081 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:20.082 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-24T08:09:20.082 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:09:20.104 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-24T08:09:20.114 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:02 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:20.198 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:20.198 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout: Package Arch Version Repo Size 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout: ceph-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 914 k 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout:Install 1 Package 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 914 k 2026-02-24T08:09:20.199 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 2.9 M 2026-02-24T08:09:20.200 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:09:20.427 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:02:55 ago on Tue 24 Feb 2026 08:06:25 AM UTC. 2026-02-24T08:09:20.511 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-24T08:09:20.511 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repo Size 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 429 M 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout:Installing weak dependencies: 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout: ceph-debugsource x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 12 M 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-24T08:09:20.512 INFO:teuthology.orchestra.run.trial105.stdout:Install 2 Packages 2026-02-24T08:09:20.513 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:09:20.513 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 441 M 2026-02-24T08:09:20.513 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 2.7 G 2026-02-24T08:09:20.513 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-24T08:09:21.117 INFO:teuthology.orchestra.run.trial165.stdout:ceph-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 995 kB/s | 914 kB 00:00 2026-02-24T08:09:21.118 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:21.118 INFO:teuthology.orchestra.run.trial165.stdout:Total 995 kB/s | 914 kB 00:00 2026-02-24T08:09:21.118 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:09:21.122 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:09:21.122 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:09:21.156 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:09:21.157 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:09:21.246 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:09:21.264 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:21.509 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:21.572 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:21.573 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:21.573 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:09:21.573 INFO:teuthology.orchestra.run.trial165.stdout: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:21.573 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:21.573 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:21.600 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-volume 2026-02-24T08:09:21.922 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:03 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:21.987 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T08:09:22.006 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:22.007 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:22.007 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:22.027 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install librados-devel 2026-02-24T08:09:22.345 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:04 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:22.431 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:22.432 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:22.433 INFO:teuthology.orchestra.run.trial165.stdout: Package Arch Version Repo Size 2026-02-24T08:09:22.433 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:22.433 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:09:22.433 INFO:teuthology.orchestra.run.trial165.stdout: librados-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 124 k 2026-02-24T08:09:22.433 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:22.433 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:09:22.433 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:22.433 INFO:teuthology.orchestra.run.trial165.stdout:Install 1 Package 2026-02-24T08:09:22.433 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:22.434 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 124 k 2026-02-24T08:09:22.434 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 434 k 2026-02-24T08:09:22.434 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:09:22.968 INFO:teuthology.orchestra.run.trial165.stdout:librados-devel-20.3.0-5440.gff63f3d9.el9.x86_64 231 kB/s | 124 kB 00:00 2026-02-24T08:09:22.969 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:22.969 INFO:teuthology.orchestra.run.trial165.stdout:Total 230 kB/s | 124 kB 00:00 2026-02-24T08:09:22.969 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:09:22.972 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:09:22.972 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:09:23.004 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:09:23.004 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:09:23.060 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:09:23.078 INFO:teuthology.orchestra.run.trial165.stdout: Installing : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:23.168 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:23.232 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:23.232 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:23.232 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:09:23.232 INFO:teuthology.orchestra.run.trial165.stdout: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:23.232 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:23.232 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:23.262 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install libcephfs2 2026-02-24T08:09:23.583 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:05 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:23.648 INFO:teuthology.orchestra.run.trial165.stdout:Package libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:23.667 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:23.668 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:23.668 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:23.690 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install libcephfs-devel 2026-02-24T08:09:24.008 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:06 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:24.093 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:24.093 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:24.093 INFO:teuthology.orchestra.run.trial165.stdout: Package Arch Version Repo Size 2026-02-24T08:09:24.093 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:24.093 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:09:24.093 INFO:teuthology.orchestra.run.trial165.stdout: libcephfs-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 37 k 2026-02-24T08:09:24.094 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:24.094 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:09:24.094 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:24.094 INFO:teuthology.orchestra.run.trial165.stdout:Install 1 Package 2026-02-24T08:09:24.094 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:24.094 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 37 k 2026-02-24T08:09:24.094 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 171 k 2026-02-24T08:09:24.094 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:09:24.706 INFO:teuthology.orchestra.run.trial165.stdout:libcephfs-devel-20.3.0-5440.gff63f3d9.el9.x86_6 61 kB/s | 37 kB 00:00 2026-02-24T08:09:24.706 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:24.706 INFO:teuthology.orchestra.run.trial165.stdout:Total 61 kB/s | 37 kB 00:00 2026-02-24T08:09:24.706 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:09:24.708 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:09:24.708 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:09:24.711 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:09:24.711 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:09:24.734 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:09:24.752 INFO:teuthology.orchestra.run.trial165.stdout: Installing : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:24.813 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:24.877 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:24.877 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:24.878 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:09:24.878 INFO:teuthology.orchestra.run.trial165.stdout: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:24.878 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:24.878 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:24.907 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install librados2 2026-02-24T08:09:25.223 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:07 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:25.290 INFO:teuthology.orchestra.run.trial165.stdout:Package librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:25.307 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:25.308 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:25.308 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:25.329 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install librbd1 2026-02-24T08:09:25.643 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:07 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:25.708 INFO:teuthology.orchestra.run.trial165.stdout:Package librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:25.725 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:25.726 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:25.726 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:25.748 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install python3-rados 2026-02-24T08:09:26.074 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:08 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:26.142 INFO:teuthology.orchestra.run.trial165.stdout:Package python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:26.159 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:26.160 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:26.160 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:26.182 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install python3-rgw 2026-02-24T08:09:26.503 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:08 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:26.570 INFO:teuthology.orchestra.run.trial165.stdout:Package python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:26.587 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:26.588 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:26.588 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:26.610 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install python3-cephfs 2026-02-24T08:09:26.935 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:08 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:27.004 INFO:teuthology.orchestra.run.trial165.stdout:Package python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:27.021 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:27.022 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:27.022 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:27.045 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install python3-rbd 2026-02-24T08:09:27.366 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:09 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:27.433 INFO:teuthology.orchestra.run.trial165.stdout:Package python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:27.451 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:27.451 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:27.451 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:27.473 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install rbd-fuse 2026-02-24T08:09:27.787 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:09 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:27.870 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout: Package Architecture Version Repository Size 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout: rbd-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 86 k 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout:Install 1 Package 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:27.871 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 86 k 2026-02-24T08:09:27.872 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 236 k 2026-02-24T08:09:27.872 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:09:28.293 INFO:teuthology.orchestra.run.trial165.stdout:rbd-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 205 kB/s | 86 kB 00:00 2026-02-24T08:09:28.293 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:28.293 INFO:teuthology.orchestra.run.trial165.stdout:Total 205 kB/s | 86 kB 00:00 2026-02-24T08:09:28.293 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:09:28.297 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:09:28.297 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:09:28.329 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:09:28.329 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:09:28.381 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:09:28.398 INFO:teuthology.orchestra.run.trial165.stdout: Installing : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:28.488 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:28.552 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:28.553 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:28.553 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:09:28.553 INFO:teuthology.orchestra.run.trial165.stdout: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:28.553 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:28.553 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:28.582 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install rbd-mirror 2026-02-24T08:09:28.632 INFO:teuthology.orchestra.run.trial105.stdout:(1/2): ceph-debugsource-20.3.0-5440.gff63f3d9.e 1.5 MB/s | 12 MB 00:08 2026-02-24T08:09:28.904 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:10 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:28.986 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout: Package Arch Version Repo Size 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout: rbd-mirror x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.6 M 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout:Install 1 Package 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 2.6 M 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 11 M 2026-02-24T08:09:28.987 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:09:30.202 INFO:teuthology.orchestra.run.trial165.stdout:rbd-mirror-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 2.1 MB/s | 2.6 MB 00:01 2026-02-24T08:09:30.202 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:30.202 INFO:teuthology.orchestra.run.trial165.stdout:Total 2.1 MB/s | 2.6 MB 00:01 2026-02-24T08:09:30.202 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:09:30.207 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:09:30.207 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:09:30.246 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:09:30.246 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:09:30.412 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:09:30.414 INFO:teuthology.orchestra.run.trial165.stdout: Installing : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:30.438 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:30.438 INFO:teuthology.orchestra.run.trial165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T08:09:30.438 INFO:teuthology.orchestra.run.trial165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T08:09:30.438 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T08:09:30.438 INFO:teuthology.orchestra.run.trial165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T08:09:30.438 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:30.769 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:30.769 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:30.770 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:09:30.770 INFO:teuthology.orchestra.run.trial165.stdout: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:30.770 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:30.770 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:30.799 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install rbd-nbd 2026-02-24T08:09:31.120 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:13 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout: Package Architecture Version Repository Size 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout: rbd-nbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 166 k 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:Install 1 Package 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 166 k 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 496 k 2026-02-24T08:09:31.204 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:09:31.988 INFO:teuthology.orchestra.run.trial165.stdout:rbd-nbd-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 212 kB/s | 166 kB 00:00 2026-02-24T08:09:31.989 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:09:31.989 INFO:teuthology.orchestra.run.trial165.stdout:Total 212 kB/s | 166 kB 00:00 2026-02-24T08:09:31.989 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:09:31.994 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:09:31.994 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:09:32.026 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:09:32.044 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:09:32.082 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:09:32.099 INFO:teuthology.orchestra.run.trial165.stdout: Installing : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:32.188 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:32.251 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T08:09:32.251 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:32.251 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:09:32.252 INFO:teuthology.orchestra.run.trial165.stdout: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:09:32.252 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:32.252 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:32.279 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-osd-crimson 2026-02-24T08:09:32.599 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:14 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:32.664 INFO:teuthology.orchestra.run.trial165.stdout:Package ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T08:09:32.682 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:32.682 INFO:teuthology.orchestra.run.trial165.stdout:Nothing to do. 2026-02-24T08:09:32.683 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:09:32.704 DEBUG:teuthology.orchestra.run.trial165:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-24T08:09:33.022 INFO:teuthology.orchestra.run.trial165.stdout:Last metadata expiration check: 0:03:15 ago on Tue 24 Feb 2026 08:06:18 AM UTC. 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:Dependencies resolved. 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout: Package Arch Version Repo Size 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:Installing: 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 429 M 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:Installing weak dependencies: 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout: ceph-debugsource x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 12 M 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:Transaction Summary 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:================================================================================ 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:Install 2 Packages 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:Total download size: 441 M 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:Installed size: 2.7 G 2026-02-24T08:09:33.108 INFO:teuthology.orchestra.run.trial165.stdout:Downloading Packages: 2026-02-24T08:09:36.668 INFO:teuthology.orchestra.run.trial165.stdout:(1/2): ceph-debugsource-20.3.0-5440.gff63f3d9.e 3.4 MB/s | 12 MB 00:03 2026-02-24T08:14:47.434 INFO:teuthology.orchestra.run.trial165.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5440.g 1.4 MB/s | 429 MB 05:14 2026-02-24T08:14:47.435 INFO:teuthology.orchestra.run.trial165.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:14:47.435 INFO:teuthology.orchestra.run.trial165.stdout:Total 1.4 MB/s | 441 MB 05:14 2026-02-24T08:14:47.435 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction check 2026-02-24T08:14:47.440 INFO:teuthology.orchestra.run.trial165.stdout:Transaction check succeeded. 2026-02-24T08:14:47.440 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction test 2026-02-24T08:14:48.804 INFO:teuthology.orchestra.run.trial165.stdout:Transaction test succeeded. 2026-02-24T08:14:48.804 INFO:teuthology.orchestra.run.trial165.stdout:Running transaction 2026-02-24T08:14:52.372 INFO:teuthology.orchestra.run.trial165.stdout: Preparing : 1/1 2026-02-24T08:15:14.432 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T08:15:14.451 INFO:teuthology.orchestra.run.trial165.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T08:15:14.927 INFO:teuthology.orchestra.run.trial165.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T08:15:14.927 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T08:15:14.992 INFO:teuthology.orchestra.run.trial165.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T08:15:14.992 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:15:14.992 INFO:teuthology.orchestra.run.trial165.stdout:Installed: 2026-02-24T08:15:14.992 INFO:teuthology.orchestra.run.trial165.stdout: ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:15:14.992 INFO:teuthology.orchestra.run.trial165.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:15:14.992 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:15:14.992 INFO:teuthology.orchestra.run.trial165.stdout:Complete! 2026-02-24T08:15:15.064 DEBUG:teuthology.parallel:result is None 2026-02-24T08:18:25.222 INFO:teuthology.orchestra.run.trial105.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5440.g 807 kB/s | 429 MB 09:04 2026-02-24T08:18:25.223 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:18:25.224 INFO:teuthology.orchestra.run.trial105.stdout:Total 830 kB/s | 441 MB 09:04 2026-02-24T08:18:25.224 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-24T08:18:25.229 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-24T08:18:25.229 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-24T08:18:26.602 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-24T08:18:26.603 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-24T08:18:30.192 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-24T08:18:52.756 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T08:18:52.828 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T08:18:53.081 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T08:18:53.081 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T08:18:53.146 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T08:18:53.146 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:18:53.146 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-24T08:18:53.146 INFO:teuthology.orchestra.run.trial105.stdout: ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:18:53.146 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T08:18:53.146 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:18:53.146 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-24T08:18:53.220 DEBUG:teuthology.parallel:result is None 2026-02-24T08:18:53.221 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T08:18:53.388 DEBUG:teuthology.orchestra.run.trial105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T08:18:53.408 INFO:teuthology.orchestra.run.trial105.stdout:20.3.0-5440.gff63f3d9.el9 2026-02-24T08:18:53.409 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5440.gff63f3d9.el9 2026-02-24T08:18:53.409 INFO:teuthology.task.install:The correct ceph version 20.3.0-5440.gff63f3d9 is installed. 2026-02-24T08:18:53.412 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T08:18:53.565 DEBUG:teuthology.orchestra.run.trial165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T08:18:53.598 INFO:teuthology.orchestra.run.trial165.stdout:20.3.0-5440.gff63f3d9.el9 2026-02-24T08:18:53.598 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5440.gff63f3d9.el9 2026-02-24T08:18:53.599 INFO:teuthology.task.install:The correct ceph version 20.3.0-5440.gff63f3d9 is installed. 2026-02-24T08:18:53.602 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T08:18:53.602 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:18:53.603 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T08:18:53.630 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:18:53.630 DEBUG:teuthology.orchestra.run.trial165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T08:18:53.664 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T08:18:53.665 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:18:53.665 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T08:18:53.694 DEBUG:teuthology.orchestra.run.trial105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T08:18:53.759 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:18:53.759 DEBUG:teuthology.orchestra.run.trial165:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T08:18:53.785 DEBUG:teuthology.orchestra.run.trial165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T08:18:53.849 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T08:18:53.849 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:18:53.849 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T08:18:53.875 DEBUG:teuthology.orchestra.run.trial105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T08:18:53.938 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:18:53.938 DEBUG:teuthology.orchestra.run.trial165:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T08:18:53.962 DEBUG:teuthology.orchestra.run.trial165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T08:18:54.026 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T08:18:54.026 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:18:54.026 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T08:18:54.051 DEBUG:teuthology.orchestra.run.trial105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T08:18:54.115 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:18:54.115 DEBUG:teuthology.orchestra.run.trial165:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T08:18:54.140 DEBUG:teuthology.orchestra.run.trial165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T08:18:54.204 INFO:teuthology.run_tasks:Running task pexec... 2026-02-24T08:18:54.222 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-24T08:18:54.222 DEBUG:teuthology.orchestra.run.trial105:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-24T08:18:54.223 DEBUG:teuthology.orchestra.run.trial165:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-24T08:18:54.226 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial105.front.sepia.ceph.com 2026-02-24T08:18:54.226 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-24T08:18:54.246 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial165.front.sepia.ceph.com 2026-02-24T08:18:54.246 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-24T08:18:54.276 DEBUG:teuthology.parallel:result is None 2026-02-24T08:18:54.299 DEBUG:teuthology.parallel:result is None 2026-02-24T08:18:54.299 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-24T08:18:54.431 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1, 'debug osd': 10}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'osd_type': 'crimson', 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'} 2026-02-24T08:18:54.431 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T08:18:54.433 INFO:tasks.cephadm:Cluster fsid is 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:18:54.433 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-24T08:18:54.433 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.105'} 2026-02-24T08:18:54.433 INFO:tasks.cephadm:First mon is mon.a on trial105 2026-02-24T08:18:54.433 INFO:tasks.cephadm:First mgr is x 2026-02-24T08:18:54.433 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-24T08:18:54.433 DEBUG:teuthology.orchestra.run.trial105:> sudo hostname $(hostname -s) 2026-02-24T08:18:54.458 DEBUG:teuthology.orchestra.run.trial165:> sudo hostname $(hostname -s) 2026-02-24T08:18:54.483 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-24T08:18:54.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T08:18:54.625 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/', 'ref': 'wip-shraddhaag-enable-cephadm-tests', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-24 05:52:36.050311', 'status': 'ready', 'flavor': 'debug', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '20.3.0-5440-gff63f3d9', 'package_manager_version': '20.3.0-5440.gff63f3d9', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3219/', 'root_build_cause': '', 'node_name': '10.20.192.97+toko07', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-24T08:18:54.769 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-shraddhaag-enable-cephadm-tests, sha1 ff63f3d997e38f69382fd23ac0206f07f7b05017 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=debug&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T08:18:54.770 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm 2026-02-24T08:18:54.771 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm 2026-02-24T08:18:54.771 DEBUG:teuthology.orchestra.run.trial105:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T08:18:56.083 INFO:teuthology.orchestra.run.trial105.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076667 Feb 24 08:18 /home/ubuntu/cephtest/cephadm 2026-02-24T08:18:56.084 DEBUG:teuthology.orchestra.run.trial165:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T08:18:57.692 INFO:teuthology.orchestra.run.trial165.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076667 Feb 24 08:18 /home/ubuntu/cephtest/cephadm 2026-02-24T08:18:57.693 DEBUG:teuthology.orchestra.run.trial105:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T08:18:57.710 DEBUG:teuthology.orchestra.run.trial165:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T08:18:57.745 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 on all hosts... 2026-02-24T08:18:57.745 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 pull 2026-02-24T08:18:57.753 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 pull 2026-02-24T08:18:57.902 INFO:teuthology.orchestra.run.trial105.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T08:18:57.930 INFO:teuthology.orchestra.run.trial165.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T08:19:08.698 INFO:teuthology.orchestra.run.trial105.stdout:{ 2026-02-24T08:19:08.698 INFO:teuthology.orchestra.run.trial105.stdout: "ceph_version": "ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev)", 2026-02-24T08:19:08.699 INFO:teuthology.orchestra.run.trial105.stdout: "image_id": "3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85", 2026-02-24T08:19:08.699 INFO:teuthology.orchestra.run.trial105.stdout: "repo_digests": [ 2026-02-24T08:19:08.699 INFO:teuthology.orchestra.run.trial105.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148" 2026-02-24T08:19:08.699 INFO:teuthology.orchestra.run.trial105.stdout: ] 2026-02-24T08:19:08.699 INFO:teuthology.orchestra.run.trial105.stdout:} 2026-02-24T08:19:08.721 INFO:teuthology.orchestra.run.trial165.stdout:{ 2026-02-24T08:19:08.722 INFO:teuthology.orchestra.run.trial165.stdout: "ceph_version": "ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev)", 2026-02-24T08:19:08.722 INFO:teuthology.orchestra.run.trial165.stdout: "image_id": "3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85", 2026-02-24T08:19:08.722 INFO:teuthology.orchestra.run.trial165.stdout: "repo_digests": [ 2026-02-24T08:19:08.722 INFO:teuthology.orchestra.run.trial165.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148" 2026-02-24T08:19:08.722 INFO:teuthology.orchestra.run.trial165.stdout: ] 2026-02-24T08:19:08.722 INFO:teuthology.orchestra.run.trial165.stdout:} 2026-02-24T08:19:08.738 DEBUG:teuthology.orchestra.run.trial105:> sudo mkdir -p /etc/ceph 2026-02-24T08:19:08.776 DEBUG:teuthology.orchestra.run.trial165:> sudo mkdir -p /etc/ceph 2026-02-24T08:19:08.803 DEBUG:teuthology.orchestra.run.trial105:> sudo chmod 777 /etc/ceph 2026-02-24T08:19:08.841 DEBUG:teuthology.orchestra.run.trial165:> sudo chmod 777 /etc/ceph 2026-02-24T08:19:08.866 INFO:tasks.cephadm:Writing seed config... 2026-02-24T08:19:08.869 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-24T08:19:08.869 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-24T08:19:08.869 INFO:tasks.cephadm: override: [mgr] debug osd = 10 2026-02-24T08:19:08.869 INFO:tasks.cephadm: override: [client.0] debug ms = 1 2026-02-24T08:19:08.869 INFO:tasks.cephadm: override: [client.0] debug objecter = 20 2026-02-24T08:19:08.869 INFO:tasks.cephadm: override: [client.0] debug rados = 20 2026-02-24T08:19:08.869 INFO:tasks.cephadm: override: [global] crimson_allow_pg_split = False 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [global] enable experimental unrecoverable data corrupting features = crimson 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [global] ms client mode = crc 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [global] ms cluster mode = crc 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [global] ms mon client mode = crc 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [global] ms mon cluster mode = crc 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [global] ms mon service mode = crc 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [global] ms service mode = crc 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [global] osd_pool_default_min_size = 2 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [global] osd_pool_default_size = 3 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-24T08:19:08.870 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [mon] mon min osdmap epochs = 50 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [mon] mon osdmap full prune interval = 2 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [mon] mon osdmap full prune min = 15 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [mon] mon osdmap full prune txsize = 2 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [mon] osd pool default crimson = True 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [mon] paxos service trim min = 10 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [osd] crimson cpu num = 4 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [osd] crimson osd obc lru size = 10 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [osd] debug ms = 20 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [osd] debug seastore = 20 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [osd] debug seastore backref = 20 2026-02-24T08:19:08.871 INFO:tasks.cephadm: override: [osd] debug seastore cache = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore cleaner = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore device = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore epm = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore fixedkv tree = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore journal = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore lba = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore odata = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore omap = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore onode = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore t = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] debug seastore tm = 20 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] osd blocked scrub grace period = 3600 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] osd debug reject backfill probability = 0.3 2026-02-24T08:19:08.872 INFO:tasks.cephadm: override: [osd] osd delete sleep = 1 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] osd max backfills = 3 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] osd max markdown count = 1000 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] osd objectstore = seastore 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] osd scrub max interval = 120 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] osd scrub min interval = 60 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] osd snap trim sleep = 2 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] seastore cachepin size pershard = 64M 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] seastore cachepin type = 2Q 2026-02-24T08:19:08.873 INFO:tasks.cephadm: override: [osd] seastore max concurrent transactions = 8 2026-02-24T08:19:08.874 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:19:08.875 DEBUG:teuthology.orchestra.run.trial105:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-24T08:19:08.897 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7561fe62-1159-11f1-9273-d404e6e7d460 crimson_allow_pg_split = False enable experimental unrecoverable data corrupting features = crimson ms client mode = crc ms cluster mode = crc ms mon client mode = crc ms mon cluster mode = crc ms mon service mode = crc ms service mode = crc osd_pool_default_min_size = 2 osd_pool_default_size = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 120 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true crimson cpu num = 4 crimson osd obc lru size = 10 debug ms = 20 debug osd = 20 debug seastore = 20 debug seastore backref = 20 debug seastore cache = 20 debug seastore cleaner = 20 debug seastore device = 20 debug seastore epm = 20 debug seastore fixedkv tree = 20 debug seastore journal = 20 debug seastore lba = 20 debug seastore odata = 20 debug seastore omap = 20 debug seastore onode = 20 debug seastore t = 20 debug seastore tm = 20 osd blocked scrub grace period = 3600 osd debug reject backfill probability = 0.3 osd delete sleep = 1 osd max backfills = 3 osd max markdown count = 1000 osd objectstore = seastore osd scrub min interval = 60 osd snap trim sleep = 2 seastore cachepin size pershard = 64M seastore cachepin type = 2Q seastore max concurrent transactions = 8 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 debug osd = 10 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon min osdmap epochs = 50 mon osdmap full prune interval = 2 mon osdmap full prune min = 15 mon osdmap full prune txsize = 2 osd pool default crimson = True paxos service trim min = 10 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client.0] debug ms = 1 debug objecter = 20 debug rados = 20 2026-02-24T08:19:08.898 DEBUG:teuthology.orchestra.run.trial105:mon.a> sudo journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a.service 2026-02-24T08:19:08.940 DEBUG:teuthology.orchestra.run.trial105:mgr.x> sudo journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mgr.x.service 2026-02-24T08:19:08.983 INFO:tasks.cephadm:Bootstrapping... 2026-02-24T08:19:08.983 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 -v bootstrap --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.105 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:19:09.120 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:19:09.121 INFO:teuthology.orchestra.run.trial105.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017', '-v', 'bootstrap', '--fsid', '7561fe62-1159-11f1-9273-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.105', '--skip-admin-label'] 2026-02-24T08:19:09.121 INFO:teuthology.orchestra.run.trial105.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-24T08:19:09.121 INFO:teuthology.orchestra.run.trial105.stdout:Verifying podman|docker is present... 2026-02-24T08:19:09.135 INFO:teuthology.orchestra.run.trial105.stdout:/bin/podman: stdout 5.8.0 2026-02-24T08:19:09.135 INFO:teuthology.orchestra.run.trial105.stdout:Verifying lvm2 is present... 2026-02-24T08:19:09.135 INFO:teuthology.orchestra.run.trial105.stdout:Verifying time synchronization is in place... 2026-02-24T08:19:09.142 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T08:19:09.142 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T08:19:09.147 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T08:19:09.147 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout inactive 2026-02-24T08:19:09.154 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout enabled 2026-02-24T08:19:09.159 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout active 2026-02-24T08:19:09.160 INFO:teuthology.orchestra.run.trial105.stdout:Unit chronyd.service is enabled and running 2026-02-24T08:19:09.160 INFO:teuthology.orchestra.run.trial105.stdout:Repeating the final host check... 2026-02-24T08:19:09.174 INFO:teuthology.orchestra.run.trial105.stdout:/bin/podman: stdout 5.8.0 2026-02-24T08:19:09.174 INFO:teuthology.orchestra.run.trial105.stdout:podman (/bin/podman) version 5.8.0 is present 2026-02-24T08:19:09.174 INFO:teuthology.orchestra.run.trial105.stdout:systemctl is present 2026-02-24T08:19:09.174 INFO:teuthology.orchestra.run.trial105.stdout:lvcreate is present 2026-02-24T08:19:09.179 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T08:19:09.180 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T08:19:09.185 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T08:19:09.185 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout inactive 2026-02-24T08:19:09.191 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout enabled 2026-02-24T08:19:09.197 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout active 2026-02-24T08:19:09.197 INFO:teuthology.orchestra.run.trial105.stdout:Unit chronyd.service is enabled and running 2026-02-24T08:19:09.197 INFO:teuthology.orchestra.run.trial105.stdout:Host looks OK 2026-02-24T08:19:09.197 INFO:teuthology.orchestra.run.trial105.stdout:Cluster fsid: 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:09.197 INFO:teuthology.orchestra.run.trial105.stdout:Acquiring lock 140562005369184 on /run/cephadm/7561fe62-1159-11f1-9273-d404e6e7d460.lock 2026-02-24T08:19:09.197 INFO:teuthology.orchestra.run.trial105.stdout:Lock 140562005369184 acquired on /run/cephadm/7561fe62-1159-11f1-9273-d404e6e7d460.lock 2026-02-24T08:19:09.197 INFO:teuthology.orchestra.run.trial105.stdout:Verifying IP 10.20.193.105 port 3300 ... 2026-02-24T08:19:09.197 INFO:teuthology.orchestra.run.trial105.stdout:Verifying IP 10.20.193.105 port 6789 ... 2026-02-24T08:19:09.198 INFO:teuthology.orchestra.run.trial105.stdout:Base mon IP(s) is [10.20.193.105:3300, 10.20.193.105:6789], mon addrv is [v2:10.20.193.105:3300,v1:10.20.193.105:6789] 2026-02-24T08:19:09.200 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.105 metric 102 2026-02-24T08:19:09.200 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.105 metric 102 2026-02-24T08:19:09.200 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-24T08:19:09.202 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-24T08:19:09.202 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-24T08:19:09.203 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout inet6 fe80::9cae:2603:6821:5d4d/64 scope link noprefixroute 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:62be/64 scope link 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:Mon IP `10.20.193.105` is in CIDR network `10.20.192.0/20` 2026-02-24T08:19:09.206 INFO:teuthology.orchestra.run.trial105.stdout:Mon IP `10.20.193.105` is in CIDR network `10.20.192.0/20` 2026-02-24T08:19:09.207 INFO:teuthology.orchestra.run.trial105.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-24T08:19:09.207 INFO:teuthology.orchestra.run.trial105.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-24T08:19:09.207 INFO:teuthology.orchestra.run.trial105.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T08:19:09.460 INFO:teuthology.orchestra.run.trial105.stdout:/bin/podman: stdout 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 2026-02-24T08:19:09.461 INFO:teuthology.orchestra.run.trial105.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T08:19:09.461 INFO:teuthology.orchestra.run.trial105.stdout:/bin/podman: stderr Getting image source signatures 2026-02-24T08:19:09.461 INFO:teuthology.orchestra.run.trial105.stdout:/bin/podman: stderr Copying blob sha256:34ff0ae581cc4b523b1cc31578790f86bdcdd88215c5534f4c04451410e82346 2026-02-24T08:19:09.461 INFO:teuthology.orchestra.run.trial105.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-02-24T08:19:09.461 INFO:teuthology.orchestra.run.trial105.stdout:/bin/podman: stderr Copying config sha256:3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 2026-02-24T08:19:09.461 INFO:teuthology.orchestra.run.trial105.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-24T08:19:09.585 INFO:teuthology.orchestra.run.trial105.stdout:ceph: stdout ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev) 2026-02-24T08:19:09.585 INFO:teuthology.orchestra.run.trial105.stdout:Ceph version: ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev) 2026-02-24T08:19:09.585 INFO:teuthology.orchestra.run.trial105.stdout:Extracting ceph user uid/gid from container image... 2026-02-24T08:19:09.708 INFO:teuthology.orchestra.run.trial105.stdout:stat: stdout 167 167 2026-02-24T08:19:09.708 INFO:teuthology.orchestra.run.trial105.stdout:Creating initial keys... 2026-02-24T08:19:09.847 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph-authtool: stdout AQD9Xp1pQ4DLMRAA2G0QwHStOFKPgM7WYjD/tA== 2026-02-24T08:19:09.920 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph-authtool: stdout AQD9Xp1p03MeNhAAJddUXHwTLQ4CeMq8v2NZCQ== 2026-02-24T08:19:10.054 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph-authtool: stdout AQD+Xp1pMxelARAAeGPOuRvmck2YpjQ/qzfo2g== 2026-02-24T08:19:10.055 INFO:teuthology.orchestra.run.trial105.stdout:Creating initial monmap... 2026-02-24T08:19:10.210 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T08:19:10.210 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-24T08:19:10.210 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:10.210 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T08:19:10.210 INFO:teuthology.orchestra.run.trial105.stdout:monmaptool for a [v2:10.20.193.105:3300,v1:10.20.193.105:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T08:19:10.210 INFO:teuthology.orchestra.run.trial105.stdout:setting min_mon_release = tentacle 2026-02-24T08:19:10.210 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/monmaptool: set fsid to 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:10.210 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T08:19:10.211 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:10.211 INFO:teuthology.orchestra.run.trial105.stdout:Creating mon... 2026-02-24T08:19:10.354 INFO:teuthology.orchestra.run.trial105.stdout:create mon.a on 2026-02-24T08:19:10.533 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-24T08:19:10.631 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-24T08:19:10.742 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7561fe62-1159-11f1-9273-d404e6e7d460.target → /etc/systemd/system/ceph-7561fe62-1159-11f1-9273-d404e6e7d460.target. 2026-02-24T08:19:10.742 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7561fe62-1159-11f1-9273-d404e6e7d460.target → /etc/systemd/system/ceph-7561fe62-1159-11f1-9273-d404e6e7d460.target. 2026-02-24T08:19:10.862 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a 2026-02-24T08:19:10.862 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a.service: Unit ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a.service not loaded. 2026-02-24T08:19:10.986 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7561fe62-1159-11f1-9273-d404e6e7d460.target.wants/ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-7561fe62-1159-11f1-9273-d404e6e7d460@.service. 2026-02-24T08:19:11.132 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T08:19:11.132 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout disabled 2026-02-24T08:19:11.138 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T08:19:11.138 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout inactive 2026-02-24T08:19:11.138 INFO:teuthology.orchestra.run.trial105.stdout:firewalld.service is not enabled 2026-02-24T08:19:11.138 INFO:teuthology.orchestra.run.trial105.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T08:19:11.138 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for mon to start... 2026-02-24T08:19:11.139 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for mon... 2026-02-24T08:19:11.293 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout cluster: 2026-02-24T08:19:11.294 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout id: 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:11.294 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-24T08:19:11.294 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:11.294 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout services: 2026-02-24T08:19:11.294 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.131246s) [leader: a] 2026-02-24T08:19:11.294 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-24T08:19:11.294 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-24T08:19:11.294 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout data: 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout pgs: 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:11.237+0000 7f1b3ba99640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:11.241+0000 7f1b3ba99640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:mon is available 2026-02-24T08:19:11.295 INFO:teuthology.orchestra.run.trial105.stdout:Assimilating anything we can from ceph.conf... 2026-02-24T08:19:11.446 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:11.446 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T08:19:11.446 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout fsid = 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:11.446 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T08:19:11.446 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.105:3300,v1:10.20.193.105:6789] 2026-02-24T08:19:11.446 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T08:19:11.446 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:11.386+0000 7fa19ddf3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:11.390+0000 7fa19ddf3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:11.447 INFO:teuthology.orchestra.run.trial105.stdout:Generating new minimal ceph.conf... 2026-02-24T08:19:11.604 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:11.541+0000 7f4deca2e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:11.604 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:11.545+0000 7f4deca2e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:11.604 INFO:teuthology.orchestra.run.trial105.stdout:Restarting the monitor... 2026-02-24T08:19:11.784 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39007]: 2026-02-24T08:19:11.681+0000 7f9882464640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T08:19:11.985 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for mon to start after restart... 2026-02-24T08:19:11.985 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for mon... 2026-02-24T08:19:12.039 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 podman[39290]: 2026-02-24 08:19:11.782918324 +0000 UTC m=+0.112350079 container died 1db74b9eb563c8396fc516f11d4ff4e2ead13b828c4a40fb41fe2a0ad756ed58 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, OSD_FLAVOR=default, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7) 2026-02-24T08:19:12.039 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 podman[39290]: 2026-02-24 08:19:11.79087547 +0000 UTC m=+0.120307225 container remove 1db74b9eb563c8396fc516f11d4ff4e2ead13b828c4a40fb41fe2a0ad756ed58 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223) 2026-02-24T08:19:12.039 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 bash[39290]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 systemd[1]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 systemd[1]: Stopped Ceph mon.a for 7561fe62-1159-11f1-9273-d404e6e7d460. 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 systemd[1]: Starting Ceph mon.a for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 podman[39417]: 2026-02-24 08:19:11.948458203 +0000 UTC m=+0.015009136 container create 45e9473c32d3d84f2c13c2a6ba9063288b7210c18b7c92e95b2ec808fe6b34d7 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, ceph=True, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-shraddhaag-enable-cephadm-tests) 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 podman[39417]: 2026-02-24 08:19:11.977613713 +0000 UTC m=+0.044164646 container init 45e9473c32d3d84f2c13c2a6ba9063288b7210c18b7c92e95b2ec808fe6b34d7 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, OSD_FLAVOR=default, org.label-schema.license=GPLv2) 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 podman[39417]: 2026-02-24 08:19:11.97999517 +0000 UTC m=+0.046546103 container start 45e9473c32d3d84f2c13c2a6ba9063288b7210c18b7c92e95b2ec808fe6b34d7 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223) 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 bash[39417]: 45e9473c32d3d84f2c13c2a6ba9063288b7210c18b7c92e95b2ec808fe6b34d7 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 podman[39417]: 2026-02-24 08:19:11.942375322 +0000 UTC m=+0.008926255 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 systemd[1]: Started Ceph mon.a for 7561fe62-1159-11f1-9273-d404e6e7d460. 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: set uid:gid to 167:167 (ceph:ceph) 2026-02-24T08:19:12.040 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: pidfile_write: ignore empty --pid-file 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: load: jerasure load: lrc 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: RocksDB version: 7.9.2 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Git sha 0 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Compile date 2026-02-24 05:12:44 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: DB SUMMARY 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: DB Session ID: 61I60M9QYWHC50SOA9LH 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: CURRENT file: CURRENT 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: IDENTITY file: IDENTITY 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99024 ; 2026-02-24T08:19:12.041 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.error_if_exists: 0 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.create_if_missing: 0 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.paranoid_checks: 1 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.env: 0xed5d60 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.fs: PosixFileSystem 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.info_log: 0x36b2ec0 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_file_opening_threads: 16 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.statistics: (nil) 2026-02-24T08:19:12.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.use_fsync: 0 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_log_file_size: 0 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.keep_log_file_num: 1000 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.recycle_log_file_num: 0 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.allow_fallocate: 1 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.allow_mmap_reads: 0 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.allow_mmap_writes: 0 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.use_direct_reads: 0 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.create_missing_column_families: 0 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.db_log_dir: 2026-02-24T08:19:12.043 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.wal_dir: 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.advise_random_on_open: 1 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.db_write_buffer_size: 0 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.write_buffer_manager: 0x36ae140 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.rate_limiter: (nil) 2026-02-24T08:19:12.044 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.wal_recovery_mode: 2 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.enable_thread_tracking: 0 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.enable_pipelined_write: 0 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.unordered_write: 0 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.row_cache: None 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.wal_filter: None 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.allow_ingest_behind: 0 2026-02-24T08:19:12.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.two_write_queues: 0 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.manual_wal_flush: 0 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.wal_compression: 0 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.atomic_flush: 0 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.log_readahead_size: 0 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.best_efforts_recovery: 0 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-24T08:19:12.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.allow_data_in_errors: 0 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.db_host_id: __hostname__ 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_background_jobs: 2 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_background_compactions: -1 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_subcompactions: 1 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_total_wal_size: 0 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-24T08:19:12.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_open_files: -1 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bytes_per_sync: 0 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_readahead_size: 0 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_background_flushes: -1 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Compression algorithms supported: 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: kZSTD supported: 0 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: kXpressCompression supported: 0 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: kBZip2Compression supported: 0 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: kLZ4Compression supported: 1 2026-02-24T08:19:12.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: kZlibCompression supported: 1 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: kLZ4HCCompression supported: 1 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: kSnappyCompression supported: 1 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.merge_operator: 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_filter: None 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_filter_factory: None 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.sst_partitioner_factory: None 2026-02-24T08:19:12.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x36b3600) 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: cache_index_and_filter_blocks: 1 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: pin_top_level_index_and_filter: 1 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: index_type: 0 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: data_block_index_type: 0 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: index_shortening: 1 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: checksum: 4 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: no_block_cache: 0 2026-02-24T08:19:12.050 INFO:journalctl@ceph.mon.a.trial105.stdout: block_cache: 0x3681a50 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: block_cache_name: BinnedLRUCache 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: block_cache_options: 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: capacity : 536870912 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: num_shard_bits : 4 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: strict_capacity_limit : 0 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: high_pri_pool_ratio: 0.000 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: block_cache_compressed: (nil) 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: persistent_cache: (nil) 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: block_size: 4096 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: block_size_deviation: 10 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: block_restart_interval: 16 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: index_block_restart_interval: 1 2026-02-24T08:19:12.051 INFO:journalctl@ceph.mon.a.trial105.stdout: metadata_block_size: 4096 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: partition_filters: 0 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: use_delta_encoding: 1 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: filter_policy: bloomfilter 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: whole_key_filtering: 1 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: verify_compression: 0 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: read_amp_bytes_per_bit: 0 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: format_version: 5 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: enable_index_compression: 1 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: block_align: 0 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: max_auto_readahead_size: 262144 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: prepopulate_block_cache: 0 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: initial_auto_readahead_size: 8192 2026-02-24T08:19:12.052 INFO:journalctl@ceph.mon.a.trial105.stdout: num_file_reads_for_auto_readahead: 2 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.write_buffer_size: 33554432 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_write_buffer_number: 2 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression: NoCompression 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression: Disabled 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.prefix_extractor: nullptr 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.num_levels: 7 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-24T08:19:12.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression_opts.level: 32767 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression_opts.strategy: 0 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-24T08:19:12.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression_opts.enabled: false 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.target_file_size_base: 67108864 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-24T08:19:12.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.arena_block_size: 1048576 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.disable_auto_compactions: 0 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-24T08:19:12.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.inplace_update_support: 0 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-24T08:19:12.057 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.bloom_locality: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.max_successive_merges: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.paranoid_file_checks: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.force_consistency_checks: 1 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.report_bg_io_stats: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.ttl: 2592000 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-24T08:19:12.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.enable_blob_files: false 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.min_blob_size: 0 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.blob_file_size: 268435456 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.blob_file_starting_level: 0 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 57fcc1c5-cf57-426f-87ae-5a044d12dc70 2026-02-24T08:19:12.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771921151997104, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771921151998033, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93645, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 321, "table_properties": {"data_size": 91588, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 15443, "raw_average_key_size": 52, "raw_value_size": 83598, "raw_average_value_size": 286, "num_data_blocks": 9, "num_entries": 292, "num_filter_entries": 292, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771921151, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "57fcc1c5-cf57-426f-87ae-5a044d12dc70", "db_session_id": "61I60M9QYWHC50SOA9LH", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771921151998095, "job": 1, "event": "recovery_finished"} 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x36cee00 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: DB pointer 0x44c0000 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout: ** DB Stats ** 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T08:19:12.060 INFO:journalctl@ceph.mon.a.trial105.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: ** Compaction Stats [default] ** 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: L0 2/0 93.32 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: Sum 2/0 93.32 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T08:19:12.061 INFO:journalctl@ceph.mon.a.trial105.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: ** Compaction Stats [default] ** 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 141.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-24T08:19:12.062 INFO:journalctl@ceph.mon.a.trial105.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout: Cumulative compaction: 0.00 GB write, 29.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout: Interval compaction: 0.00 GB write, 29.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout: Block cache BinnedLRUCache@0x3681a50#2 capacity: 512.00 MB usage: 1.45 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.7e-05 secs_since: 0 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout: 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:11 trial105 ceph-mon[39442]: starting mon.a rank 0 at public addrs [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] at bind addrs [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mon.a@-1(???) e1 preinit fsid 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:12.063 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mon.a@-1(???).mds e1 new map 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mon.a@-1(???).mds e1 print_map 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout: e1 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout: btime 2026-02-24T08:19:11:143201+0000 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout: legacy client fscid: -1 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout: 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout: No filesystems configured 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T08:19:12.064 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T08:19:12.065 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-24T08:19:12.065 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39438]: 2026-02-24T08:19:12.000+0000 7f327abdcc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:12.139 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout cluster: 2026-02-24T08:19:12.139 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout id: 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout services: 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.117785s) [leader: a] 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout data: 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-24T08:19:12.140 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-24T08:19:12.141 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout pgs: 2026-02-24T08:19:12.141 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:12.141 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:12.084+0000 7f114c89f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:12.141 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:12.088+0000 7f114c89f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:12.141 INFO:teuthology.orchestra.run.trial105.stdout:mon is available 2026-02-24T08:19:12.141 INFO:teuthology.orchestra.run.trial105.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-24T08:19:12.284 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:12.227+0000 7f2700c7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:12.284 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:12.232+0000 7f2700c7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:12.284 INFO:teuthology.orchestra.run.trial105.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-24T08:19:12.285 INFO:teuthology.orchestra.run.trial105.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:19:12.285 INFO:teuthology.orchestra.run.trial105.stdout:Creating mgr... 2026-02-24T08:19:12.285 INFO:teuthology.orchestra.run.trial105.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-24T08:19:12.285 INFO:teuthology.orchestra.run.trial105.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: monmap epoch 1 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: fsid 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: last_changed 2026-02-24T08:19:10.158686+0000 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: created 2026-02-24T08:19:10.158686+0000 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: min_mon_release 20 (tentacle) 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: election_strategy: 1 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: 0: [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] mon.a 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: fsmap 2026-02-24T08:19:12.294 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: osdmap e1: 0 total, 0 up, 0 in 2026-02-24T08:19:12.295 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:12 trial105 ceph-mon[39442]: mgrmap e1: no daemons active 2026-02-24T08:19:12.413 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mgr.x 2026-02-24T08:19:12.413 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mgr.x.service: Unit ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mgr.x.service not loaded. 2026-02-24T08:19:12.523 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7561fe62-1159-11f1-9273-d404e6e7d460.target.wants/ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-7561fe62-1159-11f1-9273-d404e6e7d460@.service. 2026-02-24T08:19:12.619 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 systemd[1]: Starting Ceph mgr.x for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:19:12.663 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T08:19:12.663 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout disabled 2026-02-24T08:19:12.670 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T08:19:12.670 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout inactive 2026-02-24T08:19:12.670 INFO:teuthology.orchestra.run.trial105.stdout:firewalld.service is not enabled 2026-02-24T08:19:12.670 INFO:teuthology.orchestra.run.trial105.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T08:19:12.677 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T08:19:12.677 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout disabled 2026-02-24T08:19:12.683 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T08:19:12.684 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout inactive 2026-02-24T08:19:12.684 INFO:teuthology.orchestra.run.trial105.stdout:firewalld.service is not enabled 2026-02-24T08:19:12.684 INFO:teuthology.orchestra.run.trial105.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-24T08:19:12.684 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for mgr to start... 2026-02-24T08:19:12.684 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for mgr... 2026-02-24T08:19:12.849 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:12.849 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout { 2026-02-24T08:19:12.849 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "fsid": "7561fe62-1159-11f1-9273-d404e6e7d460", 2026-02-24T08:19:12.849 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T08:19:12.849 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 0 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ], 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ], 2026-02-24T08:19:12.850 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T08:19:12.851 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:12.852 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T08:19:11:143201+0000", 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ], 2026-02-24T08:19:12.853 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T08:19:11.143677+0000", 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout } 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:12.787+0000 7f2b0254b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:12.790+0000 7f2b0254b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:12.854 INFO:teuthology.orchestra.run.trial105.stdout:mgr not available, waiting (1/15)... 2026-02-24T08:19:12.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 podman[39754]: 2026-02-24 08:19:12.618648856 +0000 UTC m=+0.016134162 container create 4b705cc3fc1c43d9e1edec543e057e2b34b1de571da53e30118c9f54f7270c55 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T08:19:12.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 podman[39754]: 2026-02-24 08:19:12.646583753 +0000 UTC m=+0.044069049 container init 4b705cc3fc1c43d9e1edec543e057e2b34b1de571da53e30118c9f54f7270c55 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x, org.label-schema.schema-version=1.0, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.7) 2026-02-24T08:19:12.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 podman[39754]: 2026-02-24 08:19:12.648867969 +0000 UTC m=+0.046353275 container start 4b705cc3fc1c43d9e1edec543e057e2b34b1de571da53e30118c9f54f7270c55 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True) 2026-02-24T08:19:12.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 bash[39754]: 4b705cc3fc1c43d9e1edec543e057e2b34b1de571da53e30118c9f54f7270c55 2026-02-24T08:19:12.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 podman[39754]: 2026-02-24 08:19:12.611778255 +0000 UTC m=+0.009263561 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T08:19:12.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 systemd[1]: Started Ceph mgr.x for 7561fe62-1159-11f1-9273-d404e6e7d460. 2026-02-24T08:19:12.940 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:19:12.661+0000 7f9e1c7d4fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:12.940 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:19:12.663+0000 7f9e1c7d4fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:12.940 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:12 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:19:12.663+0000 7f9e1c7d4fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:13.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2289536733' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-24T08:19:13.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3455335108' entity='client.admin' 2026-02-24T08:19:13.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3005816682' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T08:19:13.938 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:13 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T08:19:13.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:13 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T08:19:13.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:13 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: from numpy import show_config as show_numpy_config 2026-02-24T08:19:14.998 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:14.998 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout { 2026-02-24T08:19:14.998 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "fsid": "7561fe62-1159-11f1-9273-d404e6e7d460", 2026-02-24T08:19:14.998 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T08:19:14.998 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 0 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ], 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ], 2026-02-24T08:19:14.999 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T08:19:15.000 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T08:19:15.001 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T08:19:11:143201+0000", 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T08:19:15.002 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ], 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T08:19:11.143677+0000", 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T08:19:15.003 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:15.004 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T08:19:15.004 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout } 2026-02-24T08:19:15.004 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:14.938+0000 7fb66b3c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:15.004 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:14.940+0000 7fb66b3c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:15.004 INFO:teuthology.orchestra.run.trial105.stdout:mgr not available, waiting (2/15)... 2026-02-24T08:19:15.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:15 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4263991658' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T08:19:16.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: Activating manager daemon x 2026-02-24T08:19:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: mgrmap e2: x(active, starting, since 0.00275743s) 2026-02-24T08:19:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T08:19:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T08:19:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T08:19:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T08:19:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T08:19:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: Manager daemon x is now available 2026-02-24T08:19:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T08:19:16.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' 2026-02-24T08:19:16.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T08:19:16.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' 2026-02-24T08:19:16.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:16 trial105 ceph-mon[39442]: from='mgr.14102 10.20.193.105:0/1435223347' entity='mgr.x' 2026-02-24T08:19:17.271 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:17.272 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout { 2026-02-24T08:19:17.272 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "fsid": "7561fe62-1159-11f1-9273-d404e6e7d460", 2026-02-24T08:19:17.272 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T08:19:17.272 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T08:19:17.272 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T08:19:17.272 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T08:19:17.272 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:17.272 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T08:19:17.272 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 0 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ], 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ], 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T08:19:17.273 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:17.274 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:17.275 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T08:19:11:143201+0000", 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ], 2026-02-24T08:19:17.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T08:19:11.143677+0000", 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout }, 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout } 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:17.086+0000 7fabc7a36640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:17.089+0000 7fabc7a36640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:17.277 INFO:teuthology.orchestra.run.trial105.stdout:mgr is available 2026-02-24T08:19:17.492 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:17.492 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout fsid = 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.105:3300,v1:10.20.193.105:6789] 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T08:19:17.493 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 2026-02-24T08:19:17.494 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T08:19:17.494 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T08:19:17.494 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T08:19:17.494 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:17.357+0000 7f7ccd9b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:17.494 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:17.360+0000 7f7ccd9b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:17.494 INFO:teuthology.orchestra.run.trial105.stdout:Enabling cephadm module... 2026-02-24T08:19:17.580 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:17 trial105 ceph-mon[39442]: mgrmap e3: x(active, since 1.00612s) 2026-02-24T08:19:17.580 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2322586801' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T08:19:18.462 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:17.576+0000 7f76e4ff3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:18.462 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:17.580+0000 7f76e4ff3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:18.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:18 trial105 ceph-mon[39442]: mgrmap e4: x(active, since 2s) 2026-02-24T08:19:18.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3534437183' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-24T08:19:18.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/223996069' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-24T08:19:18.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:18 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ignoring --setuser ceph since I am not root 2026-02-24T08:19:18.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:18 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ignoring --setgroup ceph since I am not root 2026-02-24T08:19:18.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:18 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:19:18.474+0000 7fc68ab6ffc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:18.690 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:18 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:19:18.478+0000 7fc68ab6ffc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:18.690 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:18 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:19:18.478+0000 7fc68ab6ffc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:18.715 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout { 2026-02-24T08:19:18.715 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-24T08:19:18.716 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T08:19:18.716 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T08:19:18.716 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T08:19:18.716 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout } 2026-02-24T08:19:18.716 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:18.547+0000 7fc0123da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:18.716 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:18.550+0000 7fc0123da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:18.716 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for the mgr to restart... 2026-02-24T08:19:18.716 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for mgr epoch 5... 2026-02-24T08:19:19.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/223996069' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-24T08:19:19.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:19 trial105 ceph-mon[39442]: mgrmap e5: x(active, since 3s) 2026-02-24T08:19:19.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2219416570' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T08:19:19.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T08:19:19.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T08:19:19.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: from numpy import show_config as show_numpy_config 2026-02-24T08:19:21.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: Active manager daemon x restarted 2026-02-24T08:19:21.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: Activating manager daemon x 2026-02-24T08:19:21.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: osdmap e2: 0 total, 0 up, 0 in 2026-02-24T08:19:21.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: mgrmap e6: x(active, starting, since 0.00248788s) 2026-02-24T08:19:21.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T08:19:21.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T08:19:21.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T08:19:21.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T08:19:21.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T08:19:21.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:21 trial105 ceph-mon[39442]: Manager daemon x is now available 2026-02-24T08:19:22.276 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout { 2026-02-24T08:19:22.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-24T08:19:22.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T08:19:22.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout } 2026-02-24T08:19:22.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:18.816+0000 7f08c1f81640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:22.277 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:18.820+0000 7f08c1f81640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:22.277 INFO:teuthology.orchestra.run.trial105.stdout:mgr epoch 5 is available 2026-02-24T08:19:22.277 INFO:teuthology.orchestra.run.trial105.stdout:Verifying orchestrator module is enabled... 2026-02-24T08:19:23.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: Found migration_current of "None". Setting to last migration. 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T08:19:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T08:19:23.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: mgrmap e7: x(active, since 1.0037s) 2026-02-24T08:19:23.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T08:19:23.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:23.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:23.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2766431095' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-24T08:19:23.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:22 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:23.400 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:22.376+0000 7fc730a43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:23.400 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:22.380+0000 7fc730a43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:23.401 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-24T08:19:23.401 INFO:teuthology.orchestra.run.trial105.stdout:Setting orchestrator backend to cephadm... 2026-02-24T08:19:23.634 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:23.488+0000 7fc38cb3b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:23.634 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:23.492+0000 7fc38cb3b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:23.857 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-24T08:19:23.858 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:23.725+0000 7f6bcae1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:23.858 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:23.729+0000 7f6bcae1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:23.858 INFO:teuthology.orchestra.run.trial105.stdout:Generating ssh key... 2026-02-24T08:19:24.103 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:23.948+0000 7f5d912c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:24.103 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:23.951+0000 7f5d912c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:24.332 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: Generating public/private ed25519 key pair. 2026-02-24T08:19:24.332 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: Your identification has been saved in /tmp/tmp60juel7n/key 2026-02-24T08:19:24.332 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: Your public key has been saved in /tmp/tmp60juel7n/key.pub 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: The key fingerprint is: 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: SHA256:3YlvwY7ErkKAx6zVZM1jeVNhL3vEZxK/RM+CTIICj1g ceph-7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: The key's randomart image is: 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: +--[ED25519 256]--+ 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: | E. o o..=... | 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: | o o+ B o= +.+.| 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: | .+.+.o o .+ *.*| 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: | . * . o + =.=.| 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: | + . S = * .. | 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: | . . o + o | 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: | . o + | 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: | . . . | 2026-02-24T08:19:24.333 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: | .. | 2026-02-24T08:19:24.334 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:24 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: +----[SHA256]-----+ 2026-02-24T08:19:24.343 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILt+whiw4rk/ltsziJYhLIMSMdMT90aIZEgXa3cOE+9j ceph-7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:24.343 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:24.191+0000 7f9aef6f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:24.343 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:24.194+0000 7f9aef6f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:24.343 INFO:teuthology.orchestra.run.trial105.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-24T08:19:24.343 INFO:teuthology.orchestra.run.trial105.stdout:Adding key to root@localhost authorized_keys... 2026-02-24T08:19:24.344 INFO:teuthology.orchestra.run.trial105.stdout:Adding host trial105... 2026-02-24T08:19:24.585 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:22] ENGINE Bus STARTING 2026-02-24T08:19:24.585 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:22] ENGINE Serving on http://10.20.193.105:8765 2026-02-24T08:19:24.585 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:22] ENGINE Serving on https://10.20.193.105:7150 2026-02-24T08:19:24.585 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:22] ENGINE Bus STARTED 2026-02-24T08:19:24.586 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:22] ENGINE Client ('10.20.193.105', 32866) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T08:19:24.586 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2766431095' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-24T08:19:24.586 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: mgrmap e8: x(active, since 2s) 2026-02-24T08:19:24.586 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:24.586 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:24.586 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:24.586 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:24 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:25.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:25 trial105 ceph-mon[39442]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:25.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:25 trial105 ceph-mon[39442]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:25.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:25 trial105 ceph-mon[39442]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:25.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:25 trial105 ceph-mon[39442]: Generating ssh key... 2026-02-24T08:19:25.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:25 trial105 ceph-mon[39442]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:26.161 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout Added host 'trial105' with addr '10.20.193.105' 2026-02-24T08:19:26.161 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:24.433+0000 7fd3492be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:26.161 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:24.438+0000 7fd3492be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:26.161 INFO:teuthology.orchestra.run.trial105.stdout:Deploying unmanaged mon service... 2026-02-24T08:19:26.413 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-24T08:19:26.413 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:26.268+0000 7effb9b24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:26.413 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:26.272+0000 7effb9b24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:26.413 INFO:teuthology.orchestra.run.trial105.stdout:Deploying unmanaged mgr service... 2026-02-24T08:19:26.630 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:26 trial105 ceph-mon[39442]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial105", "addr": "10.20.193.105", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:26.630 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:26 trial105 ceph-mon[39442]: Deploying cephadm binary to trial105 2026-02-24T08:19:26.630 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:26 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:26.630 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:26 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:26.642 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-24T08:19:26.642 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:26.496+0000 7f39c0c87640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:26.642 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:26.500+0000 7f39c0c87640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:26.877 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:26.733+0000 7fb057ab6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:26.878 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:26.738+0000 7fb057ab6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:27.115 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:26.973+0000 7f8737041640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:27.115 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:26.978+0000 7f8737041640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:27.116 INFO:teuthology.orchestra.run.trial105.stdout:Enabling the dashboard module... 2026-02-24T08:19:27.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: Added host trial105 2026-02-24T08:19:27.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: Saving service mon spec with placement count:5 2026-02-24T08:19:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3469255331' entity='client.admin' 2026-02-24T08:19:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/999409842' entity='client.admin' 2026-02-24T08:19:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2379113175' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-24T08:19:28.158 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:27.212+0000 7ffa251b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:28.158 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:27.216+0000 7ffa251b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:28.410 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:28 trial105 ceph-mon[39442]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:28.410 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:28 trial105 ceph-mon[39442]: Saving service mgr spec with placement count:2 2026-02-24T08:19:28.410 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:28 trial105 ceph-mon[39442]: from='mgr.14120 10.20.193.105:0/713531872' entity='mgr.x' 2026-02-24T08:19:28.410 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2379113175' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-24T08:19:28.411 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:28 trial105 ceph-mon[39442]: mgrmap e9: x(active, since 6s) 2026-02-24T08:19:28.411 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:28 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ignoring --setuser ceph since I am not root 2026-02-24T08:19:28.411 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:28 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ignoring --setgroup ceph since I am not root 2026-02-24T08:19:28.411 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:28 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:19:28.176+0000 7f3000fb8fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:28.411 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:28 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:19:28.179+0000 7f3000fb8fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:28.411 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:28 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:19:28.179+0000 7f3000fb8fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:28.452 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout { 2026-02-24T08:19:28.452 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-24T08:19:28.452 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T08:19:28.453 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T08:19:28.453 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T08:19:28.453 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout } 2026-02-24T08:19:28.453 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:28.261+0000 7f0bb97b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:28.453 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:28.263+0000 7f0bb97b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:28.453 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for the mgr to restart... 2026-02-24T08:19:28.453 INFO:teuthology.orchestra.run.trial105.stdout:Waiting for mgr epoch 9... 2026-02-24T08:19:29.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4163873718' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T08:19:29.439 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T08:19:29.439 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T08:19:29.439 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:19:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: from numpy import show_config as show_numpy_config 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: Active manager daemon x restarted 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: Activating manager daemon x 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: osdmap e3: 0 total, 0 up, 0 in 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: mgrmap e10: x(active, starting, since 0.00328605s) 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T08:19:31.429 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:30 trial105 ceph-mon[39442]: Manager daemon x is now available 2026-02-24T08:19:31.966 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout { 2026-02-24T08:19:31.966 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-24T08:19:31.966 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T08:19:31.966 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout } 2026-02-24T08:19:31.966 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:28.549+0000 7f1810126640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:31.966 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:28.553+0000 7f1810126640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:31.966 INFO:teuthology.orchestra.run.trial105.stdout:mgr epoch 9 is available 2026-02-24T08:19:31.967 INFO:teuthology.orchestra.run.trial105.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-24T08:19:32.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:31 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:32.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:31 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T08:19:32.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:31 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T08:19:32.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:31 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:32.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:31 trial105 ceph-mon[39442]: mgrmap e11: x(active, since 1.00492s) 2026-02-24T08:19:32.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:31 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:32.546 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFIDCCAwigAwIBAgIUQ7immsESyNhofsasfQx0cYOfj7owDQYJKoZIhvcNAQEL\nBQAwPDE6MDgGA1UEAwwxY2VwaGFkbS1yb290LTc1NjFmZTYyLTExNTktMTFmMS05\nMjczLWQ0MDRlNmU3ZDQ2MDAeFw0yNjAyMjQwODE5MzJaFw0yOTAyMjMwODE5MzJa\nMBgxFjAUBgNVBAMMDTEwLjIwLjE5My4xMDUwggIiMA0GCSqGSIb3DQEBAQUAA4IC\nDwAwggIKAoICAQC1K82qW7dUsGcMF1fUk28xURPPQBYkuvArhPYxxqG9CGQ5vX/j\nmnEZg3LFdnG5vA07zwnBavpKBRVcn5raKpK7pNWGMl1itH2e4dcqjbqgAYu3WbbK\nmHYQfVK+mVRbnFumC5TvBpyPMX8NHM0oPAcbPRAPiIdv07fiydncmiDJfupIQ7AQ\nLwz+5FI/eBaPwaX+L4wVnd99eF8bUbHaAZ62iSK76rT5+txr4NtRF+YneLV9N3tC\nJxdZMwWXJjcBTO81DQeXkPhurnQpZoiK3vMbwfxL4F5pNu7fqrRTJM7ig34uowQe\n/1Bk2uPm5W8weLkkQFmDCQ8tXhGE9Os5HqId5JbLL4VUrX5ftuPbQy7iqbJtIZu+\n47mmZAA2aHzK86tNsZzqxb+6AyvaCkHFMBN1qSw+R+kOcSTMBc8pIxgcuSl9WMYf\naMjvM2gw6YOVXsc+Ugk1Vl59F4mN3moqTjweOkJk30U5xgY02poJhQo885U89RNi\nuT8JoYpsFHFA/tNO51ArLqQRaaRdiGoIEZ29IQLJ2HUJU9DtziahrGrw4hXmXorJ\nScNkhzIeC2oICifY1pGysnPPJJK0dZ7bn6QL2hz/yJanQ7tTPtaJSjICvvwL1Ou1\n2S3OwUl2JulUH4bWcYQBAtuek2Dr0Elny4vR9pXxANUwHDN98ko7OKS0wwIDAQAB\noz4wPDAsBgNVHREEJTAjggh0cmlhbDEwNYIRZGFzaGJvYXJkX3NlcnZlcnOHBAoU\nwWkwDAYDVR0TAQH/BAIwADANBgkqhkiG9w0BAQsFAAOCAgEAwEWL+dGt6HKcVVeS\ntZVzmX8ERtp6TxZ0CST32AP/4Y9N83P46nc/MCDVpOP94w4VO9sunFSnPAjPPfZC\nO68i9YvaGVKhR11ka4OsLF0dpLlcMI9OEpf6SIERC1mnSh2DGtiUSZIBNAS3P/HK\n2bClNfJRYIhQhvEXI2i1Yw+k2EUxnH9W7VwiOaQNNvKNLdGMgNSkR3yOv33V/TSU\neYCrUTJRP7hWGNgJTX1HD+XwfHtmJkE/x1xAOkRm8M3N+xh4g/7pglAhwNu6Bsh3\nZzuCGGmmFdZPerLm0atwrhZcBoYTmaiQbunu7qgJSKw5Ic7HwDEQN4wFzoX60fN8\n9kcAi+/mTTZyBCR0PRlzesYg/1iFXPspZ2mjWdpOlH/nmDR/EfIUu5zwa9gy5VoH\n4K/H2EEh8i+uJwkTcmtvD09yibt8E8aHMB02uM2Ne/hAd4CAJU0WgWEsS801gN9s\nyVkBsojjKehDSbK7DldRpWmRZPv5U44UGBAXYbpfpvdFkB/iOlc55A70ODkIj6jW\nEwkPxYFHeGRdF4oE/uJL8ECoqiru8g9S5EbXhvkUgVMCF5i06fEPIL52mRqXFSTS\nQPk+ja6Yg1PQz2FCW1pofN9n6ZRq3GSsTo17VdX2t3L4BPRZOu3wKWHti7Upsits\nYpmL2m0pE21b1GncvfPCkj1Evvc=\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAtSvNqlu3VLBnDBdX1JNvMVETz0AWJLrwK4T2McahvQhkOb1/\n45pxGYNyxXZxubwNO88JwWr6SgUVXJ+a2iqSu6TVhjJdYrR9nuHXKo26oAGLt1m2\nyph2EH1SvplUW5xbpguU7wacjzF/DRzNKDwHGz0QD4iHb9O34snZ3JogyX7qSEOw\nEC8M/uRSP3gWj8Gl/i+MFZ3ffXhfG1Gx2gGetokiu+q0+frca+DbURfmJ3i1fTd7\nQicXWTMFlyY3AUzvNQ0Hl5D4bq50KWaIit7zG8H8S+BeaTbu36q0UyTO4oN+LqME\nHv9QZNrj5uVvMHi5JEBZgwkPLV4RhPTrOR6iHeSWyy+FVK1+X7bj20Mu4qmybSGb\nvuO5pmQANmh8yvOrTbGc6sW/ugMr2gpBxTATdaksPkfpDnEkzAXPKSMYHLkpfVjG\nH2jI7zNoMOmDlV7HPlIJNVZefReJjd5qKk48HjpCZN9FOcYGNNqaCYUKPPOVPPUT\nYrk/CaGKbBRxQP7TTudQKy6kEWmkXYhqCBGdvSECydh1CVPQ7c4moaxq8OIV5l6K\nyUnDZIcyHgtqCAon2NaRsrJzzySStHWe25+kC9oc/8iWp0O7Uz7WiUoyAr78C9Tr\ntdktzsFJdibpVB+G1nGEAQLbnpNg69BJZ8uL0faV8QDVMBwzffJKOziktMMCAwEA\nAQKCAgBUxfxkfKoaXLi7NakJdTuQbgnA7pHt+fMryfmRbQp9c5HCWuOe0sOdVp67\nuyKX8GCY3dYIxU/8lshaIOzKrSUf3I91TdfYufAWCkMuTEdJW6/OyZH41sJYEOxI\n92I7w7w2xDCacBOOBXEX56Qv8Xa5zibXveDx+LWQzza8PPqejl5+Ff4qdHm2Q4wg\n2sZj2g8cE4+PBeJvyYVnOSDpi9yCOUUhfT/VwQanC/5TwcUWLyttPirU14nbWT6C\nbYVLfH5p6oDk8RbuY39DaBD4Oj6zfF/b+U70GJpJ2oyqYwzTfQfsNqdVAc7SgoIl\nprISkkq/pcS8xd5uMhgsiJYQkj70xt9yZttr96lCsfcEg+7rHWz9GbGxnCubwQuY\nTVxf652246kGnVu3jnRGcDQEi9JQ9r1pwxf9q0MiBJxm62w3QcgeAB5Y2qHcbai5\nZJIiXAUUUtTfVimhPgqyiiG7u5UgdHwAI/JFFCqYKrHm0UvyuhZoN/bvvjTJt8eC\n1V2AW/8n6Wzel4hTjng9a2NJRDHAZyumW6Gsn6QUWGxD79KCtOAkgJ09JaFedXlX\nmiLBGB5EMUuJ4mPArgs6dUPtiK0l4H8Icn7dGfrorUdktpdHJ5w0ndmvZemGpvq2\nCF6TflZOqal+AygDuPtHZhrGCn9KcrY2pQYSxUaClk0KJv0YYQKCAQEA8wGJVDah\nr5QDUXW/4eIGFiA/J8eFFqc/gF2MtgTdQgnRR0pGGGRiQ14YWhoktv3dSiFIL4Dp\nd87vW/3W+1++nky4Vc7hwpHkgB7xRkCHsKuKiSOYJEUkLmOsKJdxdYR32dSaPJTZ\nQp64f7yc76VGxZDj7nFjFLXIQoOrNYgeXVIRGxDCoBSuH5zaNLSgoRER9M6QRAn5\nDg4DiiQ7gXgy010NUBawhE2eaitpYPKZajnuUIXZrU89h7pYFmo0lS63mU1Ak0ng\nTaHww0LWfD6yKynE6fWPhbaSEaj/lnzVQr6xgawqfovTGj644Na8k1fMy4bdYUMw\nCsBRQZLsiZ6KuwKCAQEAvtvSF0w0YH7E0c5sGO2AfrvIG5kxycGCpjMSeS3FUq8B\na8ato8VBMQVUhotlXtS9xzkJwk66Cs828NsPAVfgKrqT9OvprUV935q7qWBp+XIA\nSWElfkqjj7U6k4Ky/fE78Vz5M312WRlpk+5svZNGtE9tW8ofHzKFK0IrXggGc8MG\nQxVZ3GwzQ8lnnV2T2vpjzmN+ym33bz6/4xE0mLiE3LGXHhmOZ3lQDH+xWQU4mxfF\nOnc1wBdWLTMdvbOvkUXf2f1nEulwc8UdSvlpIAczq1FqUBp8jDDs6IP0YFWObqPO\nL0UduE2IlKPoOc9/WTeAc5j5c0lXRuIWXGd/IqIxmQKCAQEA4E2hwk7vLY8VBQMI\nS+sCrTe0s/YxvbhBIC65rGWPCd7gAsrnKqq2HPLkzX5mN1bbBQr1g4uddQ5Y2HPV\nFZDJ9XphiCr/LkbWQQDOuobj+MpOhMmLLKd5fyxXg9xOSSguLK5Wc+b9J8Y0DQw/\nW+EWE1TrX3Pf/gTRRbwds7riNEeFLJNq4rJUCzAQJig4QJPuHCby+Sqvbi63S7Ko\nDpixaXHx0OQwqN6wg9VwXqFvxKKWfFMgmx2ScQ8rMf10beOCawnoukuttFrvTn0K\nWALTGI5kiYQ1pznfWFfDG9g8TXCRjl0pmEdeY1JT+o2b4PFhQthIzfdjh/j+x+Vj\nWqAx8wKCAQB4a63E8VniwFlin0FpAQEf9U8uypu1VpkeT/8J4i0sHCtjWvnX6O9X\nBKvuMCmHiecruftEU/PiOhfKJAz1pgJUM2CDGg5YOw5OdQyOs7xpnNo9ckP7yRAl\n7gzFYaOZwgk2IplBOZngYb5Rjg+iFTh5L9wqG/9C6ddIEfnW3G1lwNlEnkYSY1p9\nHKh5i79sXKt4XyJyiquhzw+3LvXmnhWGQa69WRaWht5Q5Ih7SGYMxRS17N1HE/JV\nlnjfZm4R1OqGWfIc5pkDEo2G7pK7mI+rOjU/0VZgBcaUdh1MYu75M/U1sgAsdw8D\n6d7uCtOo8PHk/dH2QYIFwUSmjM6UhY2RAoIBAHran3LGBVk9m38EvhftT2ejZ3ej\nw28QYPhGO1havsW9Gd58PwCzQR8O87pVeORVVvx2gZVx9GKY1XI5HP/hOyjReAF7\njZ+POGkVM8J6JPBDmScbnsX0XDV2Ti2HukGPiro4pM59lnCZNCVBo7sAZd8cjR4d\nm0OxOeRBfFLU8AX4vWKnxtnt28338tiuVuj95TRgm2Rj5c4g+JlPRRgNWWwRFl0W\n53KeMRS3TYWUXy1H2ksh+v81Q2J/nt7O82Yvs2YUBvnyWFHE0gX6j3u3UQEWsLw1\nowCQA6M4hc3vKCAY8yevlTjw7i271QdVyGZhZrUjxnisRlNs57DgJ0Dyah8=\n-----END RSA PRIVATE KEY-----\n"} 2026-02-24T08:19:32.546 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:32.068+0000 7f1575fc0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:32.546 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:32.073+0000 7f1575fc0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:32.776 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-24T08:19:32.777 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:32.632+0000 7f96740b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:32.777 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:32.635+0000 7f96740b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:33.011 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-24T08:19:33.011 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:32.869+0000 7fc6dbb7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:33.011 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:32.872+0000 7fc6dbb7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:33.011 INFO:teuthology.orchestra.run.trial105.stdout:Creating initial admin user... 2026-02-24T08:19:33.033 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:32 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:31] ENGINE Bus STARTING 2026-02-24T08:19:33.033 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:32 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:31] ENGINE Serving on http://10.20.193.105:8765 2026-02-24T08:19:33.033 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:32 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:31] ENGINE Serving on https://10.20.193.105:7150 2026-02-24T08:19:33.033 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:32 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:31] ENGINE Bus STARTED 2026-02-24T08:19:33.033 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:32 trial105 ceph-mon[39442]: [24/Feb/2026:08:19:31] ENGINE Client ('10.20.193.105', 55864) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T08:19:33.033 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:32 trial105 ceph-mon[39442]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T08:19:33.033 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:32 trial105 ceph-mon[39442]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T08:19:33.033 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:32 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:33.439 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$daGHWnzeWbO1boIBEoLivuc9SRWfC5Uz3FIr0dFZeuc6CqSwUn7g6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771921173, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-24T08:19:33.439 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:33.098+0000 7f56d4f00640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:33.439 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:33.102+0000 7f56d4f00640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:33.439 INFO:teuthology.orchestra.run.trial105.stdout:Fetching dashboard port number... 2026-02-24T08:19:33.664 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stdout 8443 2026-02-24T08:19:33.664 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:33.531+0000 7f4d698f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:33.665 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:33.535+0000 7f4d698f2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:33.673 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T08:19:33.673 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout disabled 2026-02-24T08:19:33.679 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T08:19:33.679 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout inactive 2026-02-24T08:19:33.679 INFO:teuthology.orchestra.run.trial105.stdout:firewalld.service is not enabled 2026-02-24T08:19:33.679 INFO:teuthology.orchestra.run.trial105.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-24T08:19:33.679 INFO:teuthology.orchestra.run.trial105.stdout:Ceph Dashboard is now available at: 2026-02-24T08:19:33.680 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.680 INFO:teuthology.orchestra.run.trial105.stdout: URL: https://trial105:8443/ 2026-02-24T08:19:33.680 INFO:teuthology.orchestra.run.trial105.stdout: User: admin 2026-02-24T08:19:33.680 INFO:teuthology.orchestra.run.trial105.stdout: Password: 4x3nvkchd1 2026-02-24T08:19:33.680 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.680 INFO:teuthology.orchestra.run.trial105.stdout:Saving cluster configuration to /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config directory 2026-02-24T08:19:33.957 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:33.764+0000 7f5f87f79640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:33.957 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr 2026-02-24T08:19:33.768+0000 7f5f87f79640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:33.957 INFO:teuthology.orchestra.run.trial105.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-24T08:19:33.957 INFO:teuthology.orchestra.run.trial105.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-24T08:19:33.957 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.957 INFO:teuthology.orchestra.run.trial105.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:19:33.957 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.957 INFO:teuthology.orchestra.run.trial105.stdout:Or, if you are only running a single cluster on this host: 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout: ceph telemetry on 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout:For more information see: 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-24T08:19:33.958 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:33.959 INFO:teuthology.orchestra.run.trial105.stdout:Bootstrap complete. 2026-02-24T08:19:33.964 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout static 2026-02-24T08:19:33.969 INFO:teuthology.orchestra.run.trial105.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-24T08:19:33.969 INFO:teuthology.orchestra.run.trial105.stdout:systemctl: stdout inactive 2026-02-24T08:19:33.970 INFO:teuthology.orchestra.run.trial105.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-24T08:19:34.113 INFO:tasks.cephadm:Fetching config... 2026-02-24T08:19:34.113 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:19:34.113 DEBUG:teuthology.orchestra.run.trial105:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-24T08:19:34.131 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-24T08:19:34.131 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:19:34.131 DEBUG:teuthology.orchestra.run.trial105:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-24T08:19:34.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:33 trial105 ceph-mon[39442]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:34.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:33 trial105 ceph-mon[39442]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:34.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:33 trial105 ceph-mon[39442]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:34.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:33 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:34.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:33 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/208091133' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-24T08:19:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:33 trial105 ceph-mon[39442]: mgrmap e12: x(active, since 2s) 2026-02-24T08:19:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/771911386' entity='client.admin' 2026-02-24T08:19:34.190 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-24T08:19:34.190 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:19:34.191 DEBUG:teuthology.orchestra.run.trial105:> sudo dd if=/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-24T08:19:34.258 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-24T08:19:34.258 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:19:34.258 DEBUG:teuthology.orchestra.run.trial105:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-24T08:19:34.315 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-24T08:19:34.315 DEBUG:teuthology.orchestra.run.trial105:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILt+whiw4rk/ltsziJYhLIMSMdMT90aIZEgXa3cOE+9j ceph-7561fe62-1159-11f1-9273-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T08:19:34.389 INFO:teuthology.orchestra.run.trial105.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILt+whiw4rk/ltsziJYhLIMSMdMT90aIZEgXa3cOE+9j ceph-7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:34.398 DEBUG:teuthology.orchestra.run.trial165:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILt+whiw4rk/ltsziJYhLIMSMdMT90aIZEgXa3cOE+9j ceph-7561fe62-1159-11f1-9273-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T08:19:34.433 INFO:teuthology.orchestra.run.trial165.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILt+whiw4rk/ltsziJYhLIMSMdMT90aIZEgXa3cOE+9j ceph-7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:34.444 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-24T08:19:34.558 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:34.665 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:34.662+0000 7f1c7f83c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:34.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:34.662+0000 7f1c7f83c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:34.835 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-24T08:19:34.836 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-24T08:19:34.952 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:35.062 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:35.059+0000 7fde3caed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:35.063 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:34 trial105 ceph-mon[39442]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:35.063 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3044742036' entity='client.admin' 2026-02-24T08:19:35.063 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:35.060+0000 7fde3caed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:35.216 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial165 2026-02-24T08:19:35.217 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:19:35.217 DEBUG:teuthology.orchestra.run.trial165:> dd of=/etc/ceph/ceph.conf 2026-02-24T08:19:35.235 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:19:35.235 DEBUG:teuthology.orchestra.run.trial165:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T08:19:35.292 INFO:tasks.cephadm:Adding host trial165 to orchestrator... 2026-02-24T08:19:35.292 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch host add trial165 2026-02-24T08:19:35.423 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:35.536 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:35.533+0000 7fcd97c2e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:35.536 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:35.533+0000 7fcd97c2e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:36.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial105", "name": "osd_memory_target"} : dispatch 2026-02-24T08:19:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:19:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:36.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:36.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:36 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:37.332 INFO:teuthology.orchestra.run.trial105.stdout:Added host 'trial165' with addr '10.20.193.165' 2026-02-24T08:19:37.333 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:37 trial105 ceph-mon[39442]: Certificate for "cephadm-signed_agent_cert (trial105)" is still valid for 1824 days. 2026-02-24T08:19:37.333 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:37 trial105 ceph-mon[39442]: Updating trial105:/etc/ceph/ceph.conf 2026-02-24T08:19:37.333 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:37 trial105 ceph-mon[39442]: Updating trial105:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:19:37.333 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:37 trial105 ceph-mon[39442]: Updating trial105:/etc/ceph/ceph.client.admin.keyring 2026-02-24T08:19:37.333 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:37 trial105 ceph-mon[39442]: Updating trial105:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T08:19:37.333 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:37 trial105 ceph-mon[39442]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial165", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:37.334 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:37 trial105 ceph-mon[39442]: Deploying cephadm binary to trial165 2026-02-24T08:19:37.375 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-24T08:19:37.490 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:37.593 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:37.591+0000 7f57abc4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:37.593 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:37.591+0000 7f57abc4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:37.704 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:37.704 INFO:teuthology.orchestra.run.trial105.stdout:[{"addr": "10.20.193.105", "hostname": "trial105", "labels": [], "status": ""}, {"addr": "10.20.193.165", "hostname": "trial165", "labels": [], "status": ""}] 2026-02-24T08:19:37.740 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-24T08:19:37.741 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd crush tunables default 2026-02-24T08:19:37.856 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:37.956 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:37.954+0000 7f2a7bc8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:37.956 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:37.954+0000 7f2a7bc8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:38.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:38 trial105 ceph-mon[39442]: mgrmap e13: x(active, since 6s) 2026-02-24T08:19:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:38 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:38 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:38 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:38 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:39.031 INFO:teuthology.orchestra.run.trial105.stderr:adjusted tunables profile to default 2026-02-24T08:19:39.073 INFO:tasks.cephadm:Adding mon.a on trial105 2026-02-24T08:19:39.073 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch apply mon '1;trial105:10.20.193.105=a' 2026-02-24T08:19:39.190 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T08:19:39.190 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T08:19:39.304 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:19:39.302+0000 7f8127a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:39.304 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:19:39.302+0000 7f8127a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:39.425 INFO:teuthology.orchestra.run.trial165.stdout:Scheduled mon update... 2026-02-24T08:19:39.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:39 trial105 ceph-mon[39442]: Added host trial165 2026-02-24T08:19:39.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:39 trial105 ceph-mon[39442]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:19:39.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:39 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/368404750' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-24T08:19:39.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:39 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:39.463 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-24T08:19:39.464 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T08:19:39.618 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T08:19:39.618 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T08:19:39.809 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:19:39.807+0000 7fab285f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:39.809 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:19:39.807+0000 7fab285f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:39.959 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:19:39.959 INFO:teuthology.orchestra.run.trial165.stdout:{"epoch":1,"fsid":"7561fe62-1159-11f1-9273-d404e6e7d460","modified":"2026-02-24T08:19:10.158686Z","created":"2026-02-24T08:19:10.158686Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:3300","nonce":0},{"type":"v1","addr":"10.20.193.105:6789","nonce":0}]},"addr":"10.20.193.105:6789/0","public_addr":"10.20.193.105:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T08:19:10:158699+0000","crush_location":[]}],"quorum":[0]} 2026-02-24T08:19:39.959 INFO:teuthology.orchestra.run.trial165.stderr:dumped monmap epoch 1 2026-02-24T08:19:39.997 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-24T08:19:39.998 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-24T08:19:40.114 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:40.220 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:40.218+0000 7f3e98da1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:40.220 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:40.218+0000 7f3e98da1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:40.283 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/368404750' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-24T08:19:40.283 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T08:19:40.283 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:40.283 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:40.283 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:40.284 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:40.284 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:40.284 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial165", "name": "osd_memory_target"} : dispatch 2026-02-24T08:19:40.284 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:40.284 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:19:40.284 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.165:0/3715706220' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T08:19:40.333 INFO:teuthology.orchestra.run.trial105.stdout:# minimal ceph.conf for 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:40.334 INFO:teuthology.orchestra.run.trial105.stdout:[global] 2026-02-24T08:19:40.334 INFO:teuthology.orchestra.run.trial105.stdout: fsid = 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:19:40.334 INFO:teuthology.orchestra.run.trial105.stdout: mon_host = [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] 2026-02-24T08:19:40.373 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-24T08:19:40.373 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:19:40.373 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T08:19:40.413 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:19:40.414 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T08:19:40.484 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:19:40.484 DEBUG:teuthology.orchestra.run.trial165:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T08:19:40.509 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:19:40.510 DEBUG:teuthology.orchestra.run.trial165:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T08:19:40.574 INFO:tasks.cephadm:Adding mgr.x on trial105 2026-02-24T08:19:40.574 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch apply mgr '1;trial105=x' 2026-02-24T08:19:40.726 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:19:40.841 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:19:40.839+0000 7efde5512640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:40.841 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:19:40.839+0000 7efde5512640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:40.959 INFO:teuthology.orchestra.run.trial165.stdout:Scheduled mgr update... 2026-02-24T08:19:40.996 DEBUG:tasks.cephadm:set 0 configs 2026-02-24T08:19:40.996 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph config dump 2026-02-24T08:19:41.124 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:41.295 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial105:10.20.193.105=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:41.295 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: Saving service mon spec with placement trial105:10.20.193.105=a;count:1 2026-02-24T08:19:41.295 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: Updating trial165:/etc/ceph/ceph.conf 2026-02-24T08:19:41.295 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: Updating trial165:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:19:41.295 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: Updating trial165:/etc/ceph/ceph.client.admin.keyring 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: Updating trial165:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: Reconfiguring daemon mon.a on trial105 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/775369623' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:41.296 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:41.297 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T08:19:41.298 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T08:19:41.298 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:41.355 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:41.353+0000 7ff8ede5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:41.355 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:41.353+0000 7ff8ede5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:41.465 INFO:teuthology.orchestra.run.trial105.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T08:19:41.466 INFO:teuthology.orchestra.run.trial105.stdout:global dev auth_debug true 2026-02-24T08:19:41.466 INFO:teuthology.orchestra.run.trial105.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 * 2026-02-24T08:19:41.466 INFO:teuthology.orchestra.run.trial105.stdout:global advanced crimson_allow_pg_split false 2026-02-24T08:19:41.466 INFO:teuthology.orchestra.run.trial105.stdout:global dev debug_asserts_on_shutdown true 2026-02-24T08:19:41.466 INFO:teuthology.orchestra.run.trial105.stdout:global advanced enable_experimental_unrecoverable_data_corrupting_features crimson 2026-02-24T08:19:41.466 INFO:teuthology.orchestra.run.trial105.stdout:global basic log_to_file true 2026-02-24T08:19:41.466 INFO:teuthology.orchestra.run.trial105.stdout:global basic log_to_journald false 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global basic log_to_stderr false 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global advanced mon_allow_pool_delete true 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global advanced mon_cluster_log_to_file true 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global basic ms_client_mode crc * 2026-02-24T08:19:41.467 INFO:teuthology.orchestra.run.trial105.stdout:global basic ms_cluster_mode crc * 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global dev ms_die_on_bug true 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global dev ms_die_on_old_message true 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global basic ms_mon_client_mode crc * 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global basic ms_mon_cluster_mode crc * 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global basic ms_mon_service_mode crc * 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global basic ms_service_mode crc * 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global advanced osd_pool_default_min_size 2 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global advanced osd_pool_default_size 3 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-24T08:19:41.468 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced debug_mon 20/20 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced debug_ms 1/1 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced debug_paxos 20/20 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_data_avail_warn 5 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_min_osdmap_epochs 50 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_osdmap_full_prune_interval 2 2026-02-24T08:19:41.469 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_osdmap_full_prune_min 15 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_osdmap_full_prune_txsize 2 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced osd_pool_default_crimson true 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mon advanced paxos_service_trim_min 10 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced debug_mgr 20/20 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced debug_ms 1/1 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced debug_osd 10/10 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-24T08:19:41.470 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:osd dev bdev_debug_aio true 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced crimson_cpu_num 4 * 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced crimson_osd_obc_lru_size 10 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_ms 20/20 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_osd 20/20 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore 20/20 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_backref 20/20 2026-02-24T08:19:41.471 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_cache 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_cleaner 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_device 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_epm 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_fixedkv_tree 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_journal 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_lba 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_odata 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_omap 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_onode 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_t 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced debug_seastore_tm 20/20 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_blocked_scrub_grace_period 3600 2026-02-24T08:19:41.472 INFO:teuthology.orchestra.run.trial105.stdout:osd dev osd_debug_misdirected_ops true 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd dev osd_debug_op_order true 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd dev osd_debug_reject_backfill_probability 0.300000 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd dev osd_debug_shutdown true 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_delete_sleep 1.000000 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_max_backfills 3 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_max_markdown_count 1000 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-24T08:19:41.473 INFO:teuthology.orchestra.run.trial105.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_memory_target_autotune true 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_objectstore seastore * 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_op_queue debug_random * 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_recover_clone_overlap true 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_scrub_max_interval 120.000000 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_scrub_min_interval 60.000000 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced osd_snap_trim_sleep 2.000000 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced seastore_cachepin_size_pershard 67108864 2026-02-24T08:19:41.474 INFO:teuthology.orchestra.run.trial105.stdout:osd dev seastore_cachepin_type 2Q * 2026-02-24T08:19:41.475 INFO:teuthology.orchestra.run.trial105.stdout:osd advanced seastore_max_concurrent_transactions 8 2026-02-24T08:19:41.475 INFO:teuthology.orchestra.run.trial105.stdout:client.0 advanced debug_ms 1/1 2026-02-24T08:19:41.475 INFO:teuthology.orchestra.run.trial105.stdout:client.0 advanced debug_objecter 20/20 2026-02-24T08:19:41.475 INFO:teuthology.orchestra.run.trial105.stdout:client.0 advanced debug_rados 20/20 2026-02-24T08:19:41.475 INFO:teuthology.orchestra.run.trial105.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-24T08:19:41.475 INFO:teuthology.orchestra.run.trial105.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-24T08:19:41.475 INFO:teuthology.orchestra.run.trial105.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-24T08:19:41.505 INFO:tasks.cephadm:Enabling crimson flags... 2026-02-24T08:19:41.505 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-24T08:19:41.620 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:41.718 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:41.716+0000 7f9419125640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:41.718 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:41.716+0000 7f9419125640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:41.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39438]: 2026-02-24T08:19:41.829+0000 7f3273a49640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-24T08:19:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39438]: Please be aware that this feature is experimental, untested, 2026-02-24T08:19:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39438]: unsupported, and may result in data corruption, data loss, 2026-02-24T08:19:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39438]: and/or irreparable damage to your cluster. Do not use 2026-02-24T08:19:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39438]: feature with important data. 2026-02-24T08:19:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:41 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39438]: 2026-02-24T08:19:42.398 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:42 trial105 ceph-mon[39442]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial105=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:42.398 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:42 trial105 ceph-mon[39442]: Saving service mgr spec with placement trial105=x;count:1 2026-02-24T08:19:42.399 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:42 trial105 ceph-mon[39442]: Reconfiguring mgr.x (unknown last config time)... 2026-02-24T08:19:42.399 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:42 trial105 ceph-mon[39442]: Reconfiguring daemon mgr.x on trial105 2026-02-24T08:19:42.399 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:42 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:42.399 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:42 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:42.399 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:42 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3695056965' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-24T08:19:42.399 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:42 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3816335241' entity='client.admin' cmd={"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:19:42.426 INFO:tasks.cephadm:Deploying OSDs... 2026-02-24T08:19:42.426 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:19:42.426 DEBUG:teuthology.orchestra.run.trial105:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T08:19:42.444 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T08:19:42.444 DEBUG:teuthology.orchestra.run.trial105:> stat /dev/vg_nvme/lv_1 2026-02-24T08:19:42.500 INFO:teuthology.orchestra.run.trial105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T08:19:42.501 INFO:teuthology.orchestra.run.trial105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T08:19:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-24T08:19:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T08:19:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T08:19:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Access: 2026-02-24 08:19:35.661787070 +0000 2026-02-24T08:19:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Modify: 2026-02-24 08:06:46.998545643 +0000 2026-02-24T08:19:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Change: 2026-02-24 08:06:46.998545643 +0000 2026-02-24T08:19:42.501 INFO:teuthology.orchestra.run.trial105.stdout: Birth: 2026-02-24 08:06:46.998545643 +0000 2026-02-24T08:19:42.502 DEBUG:teuthology.orchestra.run.trial105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T08:19:42.565 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records in 2026-02-24T08:19:42.566 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records out 2026-02-24T08:19:42.566 INFO:teuthology.orchestra.run.trial105.stderr:512 bytes copied, 0.000153565 s, 3.3 MB/s 2026-02-24T08:19:42.567 DEBUG:teuthology.orchestra.run.trial105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T08:19:42.624 DEBUG:teuthology.orchestra.run.trial105:> stat /dev/vg_nvme/lv_2 2026-02-24T08:19:42.680 INFO:teuthology.orchestra.run.trial105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T08:19:42.681 INFO:teuthology.orchestra.run.trial105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T08:19:42.681 INFO:teuthology.orchestra.run.trial105.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-24T08:19:42.681 INFO:teuthology.orchestra.run.trial105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T08:19:42.681 INFO:teuthology.orchestra.run.trial105.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T08:19:42.681 INFO:teuthology.orchestra.run.trial105.stdout:Access: 2026-02-24 08:19:35.693786255 +0000 2026-02-24T08:19:42.681 INFO:teuthology.orchestra.run.trial105.stdout:Modify: 2026-02-24 08:06:46.997545671 +0000 2026-02-24T08:19:42.681 INFO:teuthology.orchestra.run.trial105.stdout:Change: 2026-02-24 08:06:46.997545671 +0000 2026-02-24T08:19:42.681 INFO:teuthology.orchestra.run.trial105.stdout: Birth: 2026-02-24 08:06:46.997545671 +0000 2026-02-24T08:19:42.681 DEBUG:teuthology.orchestra.run.trial105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T08:19:42.743 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records in 2026-02-24T08:19:42.743 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records out 2026-02-24T08:19:42.743 INFO:teuthology.orchestra.run.trial105.stderr:512 bytes copied, 0.00014572 s, 3.5 MB/s 2026-02-24T08:19:42.745 DEBUG:teuthology.orchestra.run.trial105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T08:19:42.802 DEBUG:teuthology.orchestra.run.trial105:> stat /dev/vg_nvme/lv_3 2026-02-24T08:19:42.858 INFO:teuthology.orchestra.run.trial105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T08:19:42.858 INFO:teuthology.orchestra.run.trial105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T08:19:42.858 INFO:teuthology.orchestra.run.trial105.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-24T08:19:42.858 INFO:teuthology.orchestra.run.trial105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T08:19:42.858 INFO:teuthology.orchestra.run.trial105.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T08:19:42.859 INFO:teuthology.orchestra.run.trial105.stdout:Access: 2026-02-24 08:19:35.725785438 +0000 2026-02-24T08:19:42.859 INFO:teuthology.orchestra.run.trial105.stdout:Modify: 2026-02-24 08:06:46.998545643 +0000 2026-02-24T08:19:42.859 INFO:teuthology.orchestra.run.trial105.stdout:Change: 2026-02-24 08:06:46.998545643 +0000 2026-02-24T08:19:42.859 INFO:teuthology.orchestra.run.trial105.stdout: Birth: 2026-02-24 08:06:46.998545643 +0000 2026-02-24T08:19:42.859 DEBUG:teuthology.orchestra.run.trial105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T08:19:42.921 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records in 2026-02-24T08:19:42.921 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records out 2026-02-24T08:19:42.921 INFO:teuthology.orchestra.run.trial105.stderr:512 bytes copied, 0.000159276 s, 3.2 MB/s 2026-02-24T08:19:42.923 DEBUG:teuthology.orchestra.run.trial105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T08:19:42.980 DEBUG:teuthology.orchestra.run.trial105:> stat /dev/vg_nvme/lv_4 2026-02-24T08:19:43.035 INFO:teuthology.orchestra.run.trial105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T08:19:43.036 INFO:teuthology.orchestra.run.trial105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T08:19:43.036 INFO:teuthology.orchestra.run.trial105.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-24T08:19:43.036 INFO:teuthology.orchestra.run.trial105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T08:19:43.036 INFO:teuthology.orchestra.run.trial105.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T08:19:43.036 INFO:teuthology.orchestra.run.trial105.stdout:Access: 2026-02-24 08:19:35.758784596 +0000 2026-02-24T08:19:43.036 INFO:teuthology.orchestra.run.trial105.stdout:Modify: 2026-02-24 08:06:46.997545671 +0000 2026-02-24T08:19:43.036 INFO:teuthology.orchestra.run.trial105.stdout:Change: 2026-02-24 08:06:46.997545671 +0000 2026-02-24T08:19:43.036 INFO:teuthology.orchestra.run.trial105.stdout: Birth: 2026-02-24 08:06:46.997545671 +0000 2026-02-24T08:19:43.037 DEBUG:teuthology.orchestra.run.trial105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T08:19:43.098 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records in 2026-02-24T08:19:43.098 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records out 2026-02-24T08:19:43.098 INFO:teuthology.orchestra.run.trial105.stderr:512 bytes copied, 0.000144969 s, 3.5 MB/s 2026-02-24T08:19:43.099 DEBUG:teuthology.orchestra.run.trial105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T08:19:43.156 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:19:43.156 DEBUG:teuthology.orchestra.run.trial165:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T08:19:43.175 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T08:19:43.176 DEBUG:teuthology.orchestra.run.trial165:> stat /dev/vg_nvme/lv_1 2026-02-24T08:19:43.231 INFO:teuthology.orchestra.run.trial165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T08:19:43.231 INFO:teuthology.orchestra.run.trial165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T08:19:43.231 INFO:teuthology.orchestra.run.trial165.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-24T08:19:43.232 INFO:teuthology.orchestra.run.trial165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T08:19:43.232 INFO:teuthology.orchestra.run.trial165.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T08:19:43.232 INFO:teuthology.orchestra.run.trial165.stdout:Access: 2026-02-24 08:19:39.349237630 +0000 2026-02-24T08:19:43.232 INFO:teuthology.orchestra.run.trial165.stdout:Modify: 2026-02-24 08:06:42.355756540 +0000 2026-02-24T08:19:43.232 INFO:teuthology.orchestra.run.trial165.stdout:Change: 2026-02-24 08:06:42.355756540 +0000 2026-02-24T08:19:43.232 INFO:teuthology.orchestra.run.trial165.stdout: Birth: 2026-02-24 08:06:42.355756540 +0000 2026-02-24T08:19:43.232 DEBUG:teuthology.orchestra.run.trial165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T08:19:43.295 INFO:teuthology.orchestra.run.trial165.stderr:1+0 records in 2026-02-24T08:19:43.295 INFO:teuthology.orchestra.run.trial165.stderr:1+0 records out 2026-02-24T08:19:43.295 INFO:teuthology.orchestra.run.trial165.stderr:512 bytes copied, 0.00015053 s, 3.4 MB/s 2026-02-24T08:19:43.296 DEBUG:teuthology.orchestra.run.trial165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T08:19:43.353 DEBUG:teuthology.orchestra.run.trial165:> stat /dev/vg_nvme/lv_2 2026-02-24T08:19:43.410 INFO:teuthology.orchestra.run.trial165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T08:19:43.410 INFO:teuthology.orchestra.run.trial165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T08:19:43.410 INFO:teuthology.orchestra.run.trial165.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-24T08:19:43.410 INFO:teuthology.orchestra.run.trial165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T08:19:43.410 INFO:teuthology.orchestra.run.trial165.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T08:19:43.410 INFO:teuthology.orchestra.run.trial165.stdout:Access: 2026-02-24 08:19:39.379237025 +0000 2026-02-24T08:19:43.410 INFO:teuthology.orchestra.run.trial165.stdout:Modify: 2026-02-24 08:06:42.355756540 +0000 2026-02-24T08:19:43.410 INFO:teuthology.orchestra.run.trial165.stdout:Change: 2026-02-24 08:06:42.355756540 +0000 2026-02-24T08:19:43.411 INFO:teuthology.orchestra.run.trial165.stdout: Birth: 2026-02-24 08:06:42.355756540 +0000 2026-02-24T08:19:43.411 DEBUG:teuthology.orchestra.run.trial165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T08:19:43.473 INFO:teuthology.orchestra.run.trial165.stderr:1+0 records in 2026-02-24T08:19:43.473 INFO:teuthology.orchestra.run.trial165.stderr:1+0 records out 2026-02-24T08:19:43.473 INFO:teuthology.orchestra.run.trial165.stderr:512 bytes copied, 0.000143447 s, 3.6 MB/s 2026-02-24T08:19:43.474 DEBUG:teuthology.orchestra.run.trial165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T08:19:43.531 DEBUG:teuthology.orchestra.run.trial165:> stat /dev/vg_nvme/lv_3 2026-02-24T08:19:43.588 INFO:teuthology.orchestra.run.trial165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T08:19:43.588 INFO:teuthology.orchestra.run.trial165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T08:19:43.588 INFO:teuthology.orchestra.run.trial165.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-24T08:19:43.588 INFO:teuthology.orchestra.run.trial165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T08:19:43.588 INFO:teuthology.orchestra.run.trial165.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T08:19:43.588 INFO:teuthology.orchestra.run.trial165.stdout:Access: 2026-02-24 08:19:39.408236441 +0000 2026-02-24T08:19:43.588 INFO:teuthology.orchestra.run.trial165.stdout:Modify: 2026-02-24 08:06:42.355756540 +0000 2026-02-24T08:19:43.588 INFO:teuthology.orchestra.run.trial165.stdout:Change: 2026-02-24 08:06:42.355756540 +0000 2026-02-24T08:19:43.589 INFO:teuthology.orchestra.run.trial165.stdout: Birth: 2026-02-24 08:06:42.355756540 +0000 2026-02-24T08:19:43.589 DEBUG:teuthology.orchestra.run.trial165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T08:19:43.651 INFO:teuthology.orchestra.run.trial165.stderr:1+0 records in 2026-02-24T08:19:43.651 INFO:teuthology.orchestra.run.trial165.stderr:1+0 records out 2026-02-24T08:19:43.652 INFO:teuthology.orchestra.run.trial165.stderr:512 bytes copied, 0.000157733 s, 3.2 MB/s 2026-02-24T08:19:43.653 DEBUG:teuthology.orchestra.run.trial165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T08:19:43.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3816335241' entity='client.admin' cmd='[{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:19:43.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:43 trial105 ceph-mon[39442]: osdmap e5: 0 total, 0 up, 0 in 2026-02-24T08:19:43.710 DEBUG:teuthology.orchestra.run.trial165:> stat /dev/vg_nvme/lv_4 2026-02-24T08:19:43.766 INFO:teuthology.orchestra.run.trial165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T08:19:43.767 INFO:teuthology.orchestra.run.trial165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T08:19:43.767 INFO:teuthology.orchestra.run.trial165.stdout:Device: 6h/6d Inode: 1286 Links: 1 2026-02-24T08:19:43.767 INFO:teuthology.orchestra.run.trial165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T08:19:43.767 INFO:teuthology.orchestra.run.trial165.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T08:19:43.767 INFO:teuthology.orchestra.run.trial165.stdout:Access: 2026-02-24 08:19:39.438235837 +0000 2026-02-24T08:19:43.767 INFO:teuthology.orchestra.run.trial165.stdout:Modify: 2026-02-24 08:06:42.354756559 +0000 2026-02-24T08:19:43.767 INFO:teuthology.orchestra.run.trial165.stdout:Change: 2026-02-24 08:06:42.354756559 +0000 2026-02-24T08:19:43.767 INFO:teuthology.orchestra.run.trial165.stdout: Birth: 2026-02-24 08:06:42.354756559 +0000 2026-02-24T08:19:43.768 DEBUG:teuthology.orchestra.run.trial165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T08:19:43.829 INFO:teuthology.orchestra.run.trial165.stderr:1+0 records in 2026-02-24T08:19:43.830 INFO:teuthology.orchestra.run.trial165.stderr:1+0 records out 2026-02-24T08:19:43.830 INFO:teuthology.orchestra.run.trial165.stderr:512 bytes copied, 0.000135542 s, 3.8 MB/s 2026-02-24T08:19:43.831 DEBUG:teuthology.orchestra.run.trial165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T08:19:43.888 INFO:tasks.cephadm:Deploying osd.0 on trial105 with /dev/vg_nvme/lv_4... 2026-02-24T08:19:43.889 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T08:19:44.006 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:44.478 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:44.496 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch daemon add osd trial105:vg_nvme/lv_4 --skip-validation 2026-02-24T08:19:44.612 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:44.717 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:44.715+0000 7fe7c8f2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:44.717 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:44.715+0000 7fe7c8f2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:45.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='client.14200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:45.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: osd.default does not exist. Creating it now. 2026-02-24T08:19:45.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: Creating OSDs with service ID: default on trial105:['vg_nvme/lv_4'] 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: Marking host: trial105 for OSDSpec preview refresh. 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: Saving service osd.default spec with placement trial105 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2034355417' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5b6d17b0-c5d6-474b-89bc-48f24734b414"} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2034355417' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5b6d17b0-c5d6-474b-89bc-48f24734b414"}]': finished 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: osdmap e6: 1 total, 0 up, 1 in 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T08:19:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/797746138' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T08:19:47.653 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:47 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T08:19:47.653 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:47 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:48.903 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:48 trial105 ceph-mon[39442]: Deploying daemon osd.0 on trial105 2026-02-24T08:19:48.903 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:48 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T08:19:48.903 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:48 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:48.903 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:48 trial105 ceph-mon[39442]: Deploying daemon osd.0 on trial105 2026-02-24T08:19:50.304 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:50 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:50.304 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:50 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:51.661 INFO:teuthology.orchestra.run.trial105.stdout:Created osd(s) 0 on host 'trial105' 2026-02-24T08:19:51.704 DEBUG:teuthology.orchestra.run.trial105:osd.0> sudo journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.0.service 2026-02-24T08:19:51.706 INFO:tasks.cephadm:Deploying osd.1 on trial105 with /dev/vg_nvme/lv_3... 2026-02-24T08:19:51.706 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T08:19:51.865 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:52.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:52 trial105 ceph-mon[39442]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T08:19:52.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:52 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:52.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:52 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:52.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:52 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:52.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:52 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:52.178 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:52 trial105 ceph-mon[39442]: from='osd.0 [v2:10.20.193.105:6802/869632794,v1:10.20.193.105:6803/869632794]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T08:19:52.686 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:19:52.702 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch daemon add osd trial105:vg_nvme/lv_3 --skip-validation 2026-02-24T08:19:52.819 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:19:52.922 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:52.919+0000 7fa8ffde8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:52.922 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:19:52.920+0000 7fa8ffde8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:19:53.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:19:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='osd.0 [v2:10.20.193.105:6802/869632794,v1:10.20.193.105:6803/869632794]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T08:19:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: osdmap e7: 1 total, 0 up, 1 in 2026-02-24T08:19:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T08:19:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='osd.0 [v2:10.20.193.105:6802/869632794,v1:10.20.193.105:6803/869632794]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-24T08:19:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='client.14210 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: osd.default does not exist. Creating it now. 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: Creating OSDs with service ID: default on trial105:['vg_nvme/lv_3'] 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: Marking host: trial105 for OSDSpec preview refresh. 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: Saving service osd.default spec with placement trial105 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T08:19:53.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:53 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:53.849 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:19:53 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0[56181]: 2026-02-24T08:19:53.662+0000 7f6e323ae640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T08:19:53.849 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:19:53 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0[56181]: 2026-02-24T08:19:53.664+0000 7f6e2a26d640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T08:19:54.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: Detected new or changed devices on trial105 2026-02-24T08:19:54.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:54.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:54.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:54.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:54.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T08:19:54.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: Adjusting osd_memory_target on trial105 to 84047M 2026-02-24T08:19:54.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:54.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:54.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='osd.0 [v2:10.20.193.105:6802/869632794,v1:10.20.193.105:6803/869632794]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: osdmap e8: 1 total, 0 up, 1 in 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3597768873' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f33507e8-8616-4090-8585-e8a08345165c"} : dispatch 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3597768873' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f33507e8-8616-4090-8585-e8a08345165c"}]': finished 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: osd.0 [v2:10.20.193.105:6802/869632794,v1:10.20.193.105:6803/869632794] boot 2026-02-24T08:19:54.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: osdmap e9: 2 total, 1 up, 2 in 2026-02-24T08:19:54.941 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T08:19:54.941 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T08:19:54.941 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/976336262' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T08:19:55.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:55 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:19:55.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:55 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:19:55.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:55 trial105 ceph-mon[39442]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T08:19:56.802 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:56 trial105 ceph-mon[39442]: osdmap e10: 2 total, 1 up, 2 in 2026-02-24T08:19:56.802 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:56 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T08:19:56.802 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:56 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T08:19:56.802 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:56 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:56.802 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:56 trial105 ceph-mon[39442]: Deploying daemon osd.1 on trial105 2026-02-24T08:19:56.802 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:56 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T08:19:56.803 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:56 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:19:58.153 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:58 trial105 ceph-mon[39442]: Deploying daemon osd.1 on trial105 2026-02-24T08:19:58.153 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:58 trial105 ceph-mon[39442]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T08:19:58.153 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:58 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:19:58.154 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:19:58 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:00.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:00 trial105 ceph-mon[39442]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T08:20:00.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:00 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:00.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:00 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:00.355 INFO:teuthology.orchestra.run.trial105.stdout:Created osd(s) 1 on host 'trial105' 2026-02-24T08:20:00.399 DEBUG:teuthology.orchestra.run.trial105:osd.1> sudo journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.1.service 2026-02-24T08:20:00.402 INFO:tasks.cephadm:Deploying osd.2 on trial165 with /dev/vg_nvme/lv_4... 2026-02-24T08:20:00.402 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T08:20:00.521 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:20:00.657 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:00 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1[63979]: 2026-02-24T08:20:00.469+0000 7f946690e780 -1 osd.1 0 log_to_monitors true 2026-02-24T08:20:01.026 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:20:01.043 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch daemon add osd trial165:vg_nvme/lv_4 --skip-validation 2026-02-24T08:20:01.210 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:20:01.330 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:01.327+0000 7f9ba95ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:01.331 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:01.328+0000 7f9ba95ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:01.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:01 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:01.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:01 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:01.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:01 trial105 ceph-mon[39442]: from='osd.1 [v2:10.20.193.105:6810/2121156766,v1:10.20.193.105:6811/2121156766]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T08:20:01.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:01 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:01.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:01 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:01.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:01 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:20:01.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:01 trial105 ceph-mon[39442]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T08:20:01.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:01 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:01.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:01 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:02.438 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:02 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1[63979]: 2026-02-24T08:20:02.108+0000 7f9462890640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T08:20:02.439 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:02 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1[63979]: 2026-02-24T08:20:02.110+0000 7f945e757640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T08:20:02.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='osd.1 [v2:10.20.193.105:6810/2121156766,v1:10.20.193.105:6811/2121156766]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T08:20:02.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: osdmap e11: 2 total, 1 up, 2 in 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='osd.1 [v2:10.20.193.105:6810/2121156766,v1:10.20.193.105:6811/2121156766]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial165:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: osd.default does not exist. Creating it now. 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: Creating OSDs with service ID: default on trial165:['vg_nvme/lv_4'] 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: Marking host: trial165 for OSDSpec preview refresh. 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: Saving service osd.default spec with placement trial165 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:20:02.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.165:0/165559431' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b15ff1c-8554-41ad-b1f3-0f878aa73435"} : dispatch 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='osd.1 [v2:10.20.193.105:6810/2121156766,v1:10.20.193.105:6811/2121156766]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.165:0/165559431' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b15ff1c-8554-41ad-b1f3-0f878aa73435"}]': finished 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: osdmap e12: 3 total, 1 up, 3 in 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T08:20:02.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T08:20:02.442 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:02.442 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:02.442 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:20:02.442 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:02.442 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:20:02.442 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T08:20:02.442 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:02 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:03.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:03 trial105 ceph-mon[39442]: Detected new or changed devices on trial105 2026-02-24T08:20:03.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:03 trial105 ceph-mon[39442]: Adjusting osd_memory_target on trial105 to 42023M 2026-02-24T08:20:03.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.165:0/3210366967' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T08:20:03.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:03 trial105 ceph-mon[39442]: pgmap v18: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T08:20:03.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:03 trial105 ceph-mon[39442]: osd.1 [v2:10.20.193.105:6810/2121156766,v1:10.20.193.105:6811/2121156766] boot 2026-02-24T08:20:03.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:03 trial105 ceph-mon[39442]: osdmap e13: 3 total, 2 up, 3 in 2026-02-24T08:20:03.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:03 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T08:20:03.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:03 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T08:20:04.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:04 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:20:04.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:04 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:20:04.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:04 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T08:20:04.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:04 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:04.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:04 trial105 ceph-mon[39442]: Deploying daemon osd.2 on trial165 2026-02-24T08:20:05.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:05 trial105 ceph-mon[39442]: osdmap e14: 3 total, 2 up, 3 in 2026-02-24T08:20:05.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:05 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T08:20:05.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:05 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T08:20:05.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:05 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:05.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:05 trial105 ceph-mon[39442]: Deploying daemon osd.2 on trial165 2026-02-24T08:20:05.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:05 trial105 ceph-mon[39442]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T08:20:07.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:07 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:07.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:07 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:08.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:08 trial105 ceph-mon[39442]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T08:20:08.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:08 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:08.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:08 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:08.584 INFO:teuthology.orchestra.run.trial165.stdout:Created osd(s) 2 on host 'trial165' 2026-02-24T08:20:08.625 DEBUG:teuthology.orchestra.run.trial165:osd.2> sudo journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.2.service 2026-02-24T08:20:08.628 INFO:tasks.cephadm:Deploying osd.3 on trial165 with /dev/vg_nvme/lv_3... 2026-02-24T08:20:08.628 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T08:20:08.788 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:20:08.811 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:08 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2[46860]: 2026-02-24T08:20:08.709+0000 7fbedb743780 -1 osd.2 0 log_to_monitors true 2026-02-24T08:20:09.533 INFO:teuthology.orchestra.run.trial165.stdout: 2026-02-24T08:20:09.549 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch daemon add osd trial165:vg_nvme/lv_3 --skip-validation 2026-02-24T08:20:09.666 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:20:09.675 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:09.675 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:09.675 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='osd.2 [v2:10.20.193.165:6800/3063574535,v1:10.20.193.165:6801/3063574535]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T08:20:09.675 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T08:20:09.675 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:09.675 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:09.675 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:20:09.675 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:09.675 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:09.676 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:09.676 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:09 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:09.772 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:09.770+0000 7f0b2b3ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:09.772 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:09.771+0000 7f0b2b3ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:10.647 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:10 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2[46860]: 2026-02-24T08:20:10.587+0000 7fbed76c5640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T08:20:10.647 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:10 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2[46860]: 2026-02-24T08:20:10.589+0000 7fbecf584640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T08:20:10.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='osd.2 [v2:10.20.193.165:6800/3063574535,v1:10.20.193.165:6801/3063574535]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T08:20:10.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: osdmap e15: 3 total, 2 up, 3 in 2026-02-24T08:20:10.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T08:20:10.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='osd.2 [v2:10.20.193.165:6800/3063574535,v1:10.20.193.165:6801/3063574535]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial165", "root=default"]} : dispatch 2026-02-24T08:20:10.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='client.14230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial165:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: osd.default does not exist. Creating it now. 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: Creating OSDs with service ID: default on trial165:['vg_nvme/lv_3'] 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: Marking host: trial165 for OSDSpec preview refresh. 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: Saving service osd.default spec with placement trial165 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:20:10.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T08:20:10.690 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:10 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:11.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: Detected new or changed devices on trial165 2026-02-24T08:20:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: Adjusting osd_memory_target on trial165 to 89167M 2026-02-24T08:20:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: from='osd.2 [v2:10.20.193.165:6800/3063574535,v1:10.20.193.165:6801/3063574535]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial165", "root=default"]}]': finished 2026-02-24T08:20:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: osdmap e16: 3 total, 2 up, 3 in 2026-02-24T08:20:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T08:20:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T08:20:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T08:20:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.165:0/1611633256' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6c4b0a9e-7dba-4452-acde-b0f132240d27"} : dispatch 2026-02-24T08:20:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.165:0/1611633256' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c4b0a9e-7dba-4452-acde-b0f132240d27"}]': finished 2026-02-24T08:20:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: osd.2 [v2:10.20.193.165:6800/3063574535,v1:10.20.193.165:6801/3063574535] boot 2026-02-24T08:20:11.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: osdmap e17: 4 total, 3 up, 4 in 2026-02-24T08:20:11.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T08:20:11.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T08:20:11.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:20:11.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.165:0/1711078226' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T08:20:12.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:12 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:20:12.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:12 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:20:12.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:12 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T08:20:12.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:12 trial105 ceph-mon[39442]: osdmap e18: 4 total, 3 up, 4 in 2026-02-24T08:20:12.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:12 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T08:20:12.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:12 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:20:13.961 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:13 trial165 sudo[53090]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T08:20:13.961 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:13 trial165 sudo[53090]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T08:20:13.961 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:13 trial165 sudo[53090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T08:20:13.961 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:13 trial165 sudo[53090]: pam_unix(sudo:session): session closed for user root 2026-02-24T08:20:13.961 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:13 trial165 sudo[53094]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T08:20:13.961 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:13 trial165 sudo[53094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T08:20:13.961 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:13 trial165 sudo[53094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T08:20:13.962 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:20:13 trial165 sudo[53094]: pam_unix(sudo:session): session closed for user root 2026-02-24T08:20:14.189 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71888]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T08:20:14.189 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71888]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T08:20:14.189 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T08:20:14.189 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71888]: pam_unix(sudo:session): session closed for user root 2026-02-24T08:20:14.189 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71892]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T08:20:14.189 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71892]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T08:20:14.190 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T08:20:14.190 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71892]: pam_unix(sudo:session): session closed for user root 2026-02-24T08:20:14.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71904]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-24T08:20:14.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71904]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T08:20:14.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T08:20:14.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71904]: pam_unix(sudo:session): session closed for user root 2026-02-24T08:20:14.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71908]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71908]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71908]: pam_unix(sudo:session): session closed for user root 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: pgmap v29: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: osdmap e19: 4 total, 3 up, 4 in 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: Deploying daemon osd.3 on trial165 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T08:20:14.191 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:14.192 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:14.192 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:14.192 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T08:20:14.192 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T08:20:14.192 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T08:20:14.192 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:13 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:14.192 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71896]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T08:20:14.192 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71896]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T08:20:14.192 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T08:20:14.193 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71896]: pam_unix(sudo:session): session closed for user root 2026-02-24T08:20:14.193 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71900]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T08:20:14.193 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71900]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T08:20:14.193 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T08:20:14.193 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:20:13 trial105 sudo[71900]: pam_unix(sudo:session): session closed for user root 2026-02-24T08:20:15.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:14 trial105 ceph-mon[39442]: Deploying daemon osd.3 on trial165 2026-02-24T08:20:15.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:14 trial105 ceph-mon[39442]: osdmap e20: 4 total, 3 up, 4 in 2026-02-24T08:20:15.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:14 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T08:20:15.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:14 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:15.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:14 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:16.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:15 trial105 ceph-mon[39442]: pgmap v32: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T08:20:17.224 INFO:teuthology.orchestra.run.trial165.stdout:Created osd(s) 3 on host 'trial165' 2026-02-24T08:20:17.265 DEBUG:teuthology.orchestra.run.trial165:osd.3> sudo journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.3.service 2026-02-24T08:20:17.266 INFO:tasks.cephadm:Waiting for 4 OSDs to come up... 2026-02-24T08:20:17.267 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T08:20:17.292 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:16 trial105 ceph-mon[39442]: mgrmap e14: x(active, since 45s) 2026-02-24T08:20:17.292 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:16 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:17.292 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:16 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:17.386 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:17.491 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:17.489+0000 7f2f6ce20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:17.491 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:17.489+0000 7f2f6ce20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:17.564 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:20:17 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3[54384]: 2026-02-24T08:20:17.410+0000 7f7f80128780 -1 osd.3 0 log_to_monitors true 2026-02-24T08:20:17.600 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:17.662 INFO:teuthology.orchestra.run.trial105.stdout:{"epoch":20,"num_osds":4,"num_up_osds":3,"osd_up_since":1771921210,"num_in_osds":4,"osd_in_since":1771921210,"num_remapped_pgs":0} 2026-02-24T08:20:18.289 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:17 trial105 ceph-mon[39442]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T08:20:18.289 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:17 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:18.289 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:17 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:18.289 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:17 trial105 ceph-mon[39442]: from='osd.3 [v2:10.20.193.165:6808/2512845559,v1:10.20.193.165:6809/2512845559]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T08:20:18.289 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1337175929' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T08:20:18.289 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:17 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:18.289 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:17 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:18.289 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:17 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:20:18.663 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T08:20:18.782 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:18.890 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:18.888+0000 7fa1ae0bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:18.890 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:18.888+0000 7fa1ae0bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:19.003 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:19.043 INFO:teuthology.orchestra.run.trial105.stdout:{"epoch":21,"num_osds":4,"num_up_osds":3,"osd_up_since":1771921210,"num_in_osds":4,"osd_in_since":1771921210,"num_remapped_pgs":0} 2026-02-24T08:20:19.263 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:20:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3[54384]: 2026-02-24T08:20:19.227+0000 7f7f7c0aa640 -1 osd.3 0 waiting for initial osdmap 2026-02-24T08:20:19.264 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:20:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3[54384]: 2026-02-24T08:20:19.229+0000 7f7f73f69640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T08:20:19.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='osd.3 [v2:10.20.193.165:6808/2512845559,v1:10.20.193.165:6809/2512845559]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T08:20:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: osdmap e21: 4 total, 3 up, 4 in 2026-02-24T08:20:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T08:20:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='osd.3 [v2:10.20.193.165:6808/2512845559,v1:10.20.193.165:6809/2512845559]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial165", "root=default"]} : dispatch 2026-02-24T08:20:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2435097052' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T08:20:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T08:20:19.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T08:20:19.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:19.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:20:19.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:19.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:20:19.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T08:20:19.441 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:19 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:20.044 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T08:20:20.160 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:20.262 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:20.260+0000 7facfaf3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:20.263 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:20.261+0000 7facfaf3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:20.373 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:20.374 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:20 trial105 ceph-mon[39442]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T08:20:20.374 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:20 trial105 ceph-mon[39442]: Detected new or changed devices on trial165 2026-02-24T08:20:20.374 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:20 trial105 ceph-mon[39442]: Adjusting osd_memory_target on trial165 to 44583M 2026-02-24T08:20:20.374 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:20 trial105 ceph-mon[39442]: from='osd.3 [v2:10.20.193.165:6808/2512845559,v1:10.20.193.165:6809/2512845559]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial165", "root=default"]}]': finished 2026-02-24T08:20:20.374 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:20 trial105 ceph-mon[39442]: osdmap e22: 4 total, 3 up, 4 in 2026-02-24T08:20:20.374 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:20 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T08:20:20.374 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:20 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T08:20:20.410 INFO:teuthology.orchestra.run.trial105.stdout:{"epoch":23,"num_osds":4,"num_up_osds":4,"osd_up_since":1771921220,"num_in_osds":4,"osd_in_since":1771921210,"num_remapped_pgs":1} 2026-02-24T08:20:20.411 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T08:20:20.527 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:20.628 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:20.626+0000 7ff68f2e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:20.628 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:20.626+0000 7ff68f2e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:20.737 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:20.737 INFO:teuthology.orchestra.run.trial105.stdout:{"epoch":23,"fsid":"7561fe62-1159-11f1-9273-d404e6e7d460","created":"2026-02-24T08:19:11.143358+0000","modified":"2026-02-24T08:20:20.224900+0000","last_up_change":"2026-02-24T08:20:20.224900+0000","last_in_change":"2026-02-24T08:20:10.945432+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T08:20:11.141863+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5b6d17b0-c5d6-474b-89bc-48f24734b414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6803","nonce":869632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6805","nonce":869632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6809","nonce":869632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6807","nonce":869632794}]},"public_addr":"10.20.193.105:6803/869632794","cluster_addr":"10.20.193.105:6805/869632794","heartbeat_back_addr":"10.20.193.105:6809/869632794","heartbeat_front_addr":"10.20.193.105:6807/869632794","state":["exists","up"]},{"osd":1,"uuid":"f33507e8-8616-4090-8585-e8a08345165c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6811","nonce":2121156766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6813","nonce":2121156766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6817","nonce":2121156766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6815","nonce":2121156766}]},"public_addr":"10.20.193.105:6811/2121156766","cluster_addr":"10.20.193.105:6813/2121156766","heartbeat_back_addr":"10.20.193.105:6817/2121156766","heartbeat_front_addr":"10.20.193.105:6815/2121156766","state":["exists","up"]},{"osd":2,"uuid":"0b15ff1c-8554-41ad-b1f3-0f878aa73435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6800","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6801","nonce":3063574535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6802","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6803","nonce":3063574535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6806","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6807","nonce":3063574535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6804","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6805","nonce":3063574535}]},"public_addr":"10.20.193.165:6801/3063574535","cluster_addr":"10.20.193.165:6803/3063574535","heartbeat_back_addr":"10.20.193.165:6807/3063574535","heartbeat_front_addr":"10.20.193.165:6805/3063574535","state":["exists","up"]},{"osd":3,"uuid":"6c4b0a9e-7dba-4452-acde-b0f132240d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6808","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6809","nonce":2512845559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6810","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6811","nonce":2512845559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6814","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6815","nonce":2512845559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6812","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6813","nonce":2512845559}]},"public_addr":"10.20.193.165:6809/2512845559","cluster_addr":"10.20.193.165:6811/2512845559","heartbeat_back_addr":"10.20.193.165:6815/2512845559","heartbeat_front_addr":"10.20.193.165:6813/2512845559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:19:52.707911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:20:01.512802+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:20:09.705974+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[0,2,1]}],"primary_temp":[],"blocklist":{"10.20.193.105:0/4198816748":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/2356899514":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6801/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/3052436975":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/1156713941":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/2664861380":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/1143914845":"2026-02-25T08:19:21.248828+0000","10.20.193.105:6800/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6801/119731213":"2026-02-25T08:19:21.248828+0000","10.20.193.105:6800/119731213":"2026-02-25T08:19:21.248828+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T08:20:20.776 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-24T08:20:11.141863+0000', 'flags': 262145, 'flags_names': 'hashpspool,crimson', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.75, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-24T08:20:20.777 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-24T08:20:20.892 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:20.993 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:20.991+0000 7fe91da60640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:20.993 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:20.991+0000 7fe91da60640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:21.099 INFO:teuthology.orchestra.run.trial105.stdout:pg_num: 1 2026-02-24T08:20:21.137 INFO:tasks.cephadm:Adding prometheus.a on trial165 2026-02-24T08:20:21.137 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch apply prometheus '1;trial165=a' 2026-02-24T08:20:21.257 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:20:21.360 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:21.358+0000 7f1948742640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:21.360 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:21.359+0000 7f1948742640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:21.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:20:21.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:20:21.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: osd.3 [v2:10.20.193.165:6808/2512845559,v1:10.20.193.165:6809/2512845559] boot 2026-02-24T08:20:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: osdmap e23: 4 total, 4 up, 4 in 2026-02-24T08:20:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T08:20:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2464998629' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T08:20:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4221719137' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T08:20:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: pgmap v38: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:20:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2823035344' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T08:20:21.478 INFO:teuthology.orchestra.run.trial165.stdout:Scheduled prometheus update... 2026-02-24T08:20:21.515 DEBUG:teuthology.orchestra.run.trial165:prometheus.a> sudo journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@prometheus.a.service 2026-02-24T08:20:21.517 INFO:tasks.cephadm:Adding node-exporter.a on trial105 2026-02-24T08:20:21.517 INFO:tasks.cephadm:Adding node-exporter.b on trial165 2026-02-24T08:20:21.517 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph orch apply node-exporter '2;trial105=a;trial165=b' 2026-02-24T08:20:21.672 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:20:21.786 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:21.784+0000 7f6534f75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:21.786 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:21.785+0000 7f6534f75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:21.904 INFO:teuthology.orchestra.run.trial165.stdout:Scheduled node-exporter update... 2026-02-24T08:20:21.946 DEBUG:teuthology.orchestra.run.trial105:node-exporter.a> sudo journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@node-exporter.a.service 2026-02-24T08:20:21.948 DEBUG:teuthology.orchestra.run.trial165:node-exporter.b> sudo journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@node-exporter.b.service 2026-02-24T08:20:21.951 INFO:tasks.cephadm:Setting up client nodes... 2026-02-24T08:20:21.952 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T08:20:22.133 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:22.239 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:22.237+0000 7f78139d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:22.240 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:22.238+0000 7f78139d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:22.388 INFO:teuthology.orchestra.run.trial105.stdout:[client.0] 2026-02-24T08:20:22.388 INFO:teuthology.orchestra.run.trial105.stdout: key = AQBGX51pXrsIFxAA2DhZkqSU8rK6TMtOHqqw0A== 2026-02-24T08:20:22.424 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-24T08:20:22.424 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-24T08:20:22.424 DEBUG:teuthology.orchestra.run.trial105:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T08:20:22.459 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T08:20:22.578 INFO:teuthology.orchestra.run.trial165.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:20:22.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: osdmap e24: 4 total, 4 up, 4 in 2026-02-24T08:20:22.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;trial165=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:20:22.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: Saving service prometheus spec with placement trial165=a;count:1 2026-02-24T08:20:22.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:22.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:20:22.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:22.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:22.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: from='client.14255 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;trial105=a;trial165=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:20:22.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: Saving service node-exporter spec with placement trial105=a;trial165=b;count:2 2026-02-24T08:20:22.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:22 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:22.695 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:22.694+0000 7f6c2b767640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:22.696 INFO:teuthology.orchestra.run.trial165.stderr:2026-02-24T08:20:22.694+0000 7f6c2b767640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:22.849 INFO:teuthology.orchestra.run.trial165.stdout:[client.1] 2026-02-24T08:20:22.849 INFO:teuthology.orchestra.run.trial165.stdout: key = AQBGX51puTWDMhAAl2FF3zZSqXDuSdfcf/RhOg== 2026-02-24T08:20:22.887 DEBUG:teuthology.orchestra.run.trial165:> set -ex 2026-02-24T08:20:22.887 DEBUG:teuthology.orchestra.run.trial165:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-24T08:20:22.887 DEBUG:teuthology.orchestra.run.trial165:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-24T08:20:22.923 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-24T08:20:23.040 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:23.144 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:23.143+0000 7fc02d870640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:23.145 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:23.143+0000 7fc02d870640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:23.254 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:23.292 INFO:teuthology.orchestra.run.trial105.stdout:[{"version":13,"timestamp":"2026-02-24T08:20:19.060464+0000","name":"","changes":[{"name":"osd/host:trial165/osd_memory_target","previous_value":"93498629324","new_value":"46749314662"}]}] 2026-02-24T08:20:23.293 INFO:tasks.ceph_manager:config epoch is 13 2026-02-24T08:20:23.293 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T08:20:23.293 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-24T08:20:23.293 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-24T08:20:23.408 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:23.513 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:23.511+0000 7fefec9b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:23.513 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: osdmap e25: 4 total, 4 up, 4 in 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1903239755' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1903239755' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:23.514 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:23.515 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:23.515 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: Deploying daemon prometheus.a on trial165 2026-02-24T08:20:23.515 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.165:0/3197067197' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T08:20:23.515 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.165:0/3197067197' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T08:20:23.515 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:23 trial105 ceph-mon[39442]: pgmap v41: 1 pgs: 1 unknown; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:20:23.515 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:23.511+0000 7fefec9b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:23.655 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:23.691 INFO:teuthology.orchestra.run.trial105.stdout:{"epoch":14,"flags":0,"active_gid":14154,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6800","nonce":4215880599},{"type":"v1","addr":"10.20.193.105:6801","nonce":4215880599}]},"active_addr":"10.20.193.105:6801/4215880599","active_change":"2026-02-24T08:19:30.935442+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.105:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.105:0","nonce":4203947306}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.105:0","nonce":1553193359}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.105:0","nonce":3562493168}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.105:0","nonce":3463864029}]}]} 2026-02-24T08:20:23.695 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-24T08:20:23.695 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-24T08:20:23.695 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T08:20:23.812 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:23.915 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:23.914+0000 7f0975ad8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:23.916 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:23.914+0000 7f0975ad8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.026 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:24.026 INFO:teuthology.orchestra.run.trial105.stdout:{"epoch":25,"fsid":"7561fe62-1159-11f1-9273-d404e6e7d460","created":"2026-02-24T08:19:11.143358+0000","modified":"2026-02-24T08:20:22.227981+0000","last_up_change":"2026-02-24T08:20:20.224900+0000","last_in_change":"2026-02-24T08:20:10.945432+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T08:20:11.141863+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5b6d17b0-c5d6-474b-89bc-48f24734b414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6803","nonce":869632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6805","nonce":869632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6809","nonce":869632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6807","nonce":869632794}]},"public_addr":"10.20.193.105:6803/869632794","cluster_addr":"10.20.193.105:6805/869632794","heartbeat_back_addr":"10.20.193.105:6809/869632794","heartbeat_front_addr":"10.20.193.105:6807/869632794","state":["exists","up"]},{"osd":1,"uuid":"f33507e8-8616-4090-8585-e8a08345165c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6811","nonce":2121156766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6813","nonce":2121156766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6817","nonce":2121156766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6815","nonce":2121156766}]},"public_addr":"10.20.193.105:6811/2121156766","cluster_addr":"10.20.193.105:6813/2121156766","heartbeat_back_addr":"10.20.193.105:6817/2121156766","heartbeat_front_addr":"10.20.193.105:6815/2121156766","state":["exists","up"]},{"osd":2,"uuid":"0b15ff1c-8554-41ad-b1f3-0f878aa73435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6800","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6801","nonce":3063574535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6802","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6803","nonce":3063574535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6806","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6807","nonce":3063574535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6804","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6805","nonce":3063574535}]},"public_addr":"10.20.193.165:6801/3063574535","cluster_addr":"10.20.193.165:6803/3063574535","heartbeat_back_addr":"10.20.193.165:6807/3063574535","heartbeat_front_addr":"10.20.193.165:6805/3063574535","state":["exists","up"]},{"osd":3,"uuid":"6c4b0a9e-7dba-4452-acde-b0f132240d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6808","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6809","nonce":2512845559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6810","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6811","nonce":2512845559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6814","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6815","nonce":2512845559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6812","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6813","nonce":2512845559}]},"public_addr":"10.20.193.165:6809/2512845559","cluster_addr":"10.20.193.165:6811/2512845559","heartbeat_back_addr":"10.20.193.165:6815/2512845559","heartbeat_front_addr":"10.20.193.165:6813/2512845559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:19:52.707911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:20:01.512802+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:20:09.705974+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:20:18.386066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.105:0/4198816748":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/2356899514":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6801/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/3052436975":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/1156713941":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/2664861380":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/1143914845":"2026-02-25T08:19:21.248828+0000","10.20.193.105:6800/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6801/119731213":"2026-02-25T08:19:21.248828+0000","10.20.193.105:6800/119731213":"2026-02-25T08:19:21.248828+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T08:20:24.063 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-24T08:20:24.063 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T08:20:24.178 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:24.276 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.274+0000 7f7b67bb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.276 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.275+0000 7f7b67bb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.386 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:24.386 INFO:teuthology.orchestra.run.trial105.stdout:{"epoch":25,"fsid":"7561fe62-1159-11f1-9273-d404e6e7d460","created":"2026-02-24T08:19:11.143358+0000","modified":"2026-02-24T08:20:22.227981+0000","last_up_change":"2026-02-24T08:20:20.224900+0000","last_in_change":"2026-02-24T08:20:10.945432+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T08:20:11.141863+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5b6d17b0-c5d6-474b-89bc-48f24734b414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6803","nonce":869632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6805","nonce":869632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6809","nonce":869632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6807","nonce":869632794}]},"public_addr":"10.20.193.105:6803/869632794","cluster_addr":"10.20.193.105:6805/869632794","heartbeat_back_addr":"10.20.193.105:6809/869632794","heartbeat_front_addr":"10.20.193.105:6807/869632794","state":["exists","up"]},{"osd":1,"uuid":"f33507e8-8616-4090-8585-e8a08345165c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6811","nonce":2121156766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6813","nonce":2121156766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6817","nonce":2121156766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6815","nonce":2121156766}]},"public_addr":"10.20.193.105:6811/2121156766","cluster_addr":"10.20.193.105:6813/2121156766","heartbeat_back_addr":"10.20.193.105:6817/2121156766","heartbeat_front_addr":"10.20.193.105:6815/2121156766","state":["exists","up"]},{"osd":2,"uuid":"0b15ff1c-8554-41ad-b1f3-0f878aa73435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6800","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6801","nonce":3063574535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6802","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6803","nonce":3063574535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6806","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6807","nonce":3063574535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6804","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6805","nonce":3063574535}]},"public_addr":"10.20.193.165:6801/3063574535","cluster_addr":"10.20.193.165:6803/3063574535","heartbeat_back_addr":"10.20.193.165:6807/3063574535","heartbeat_front_addr":"10.20.193.165:6805/3063574535","state":["exists","up"]},{"osd":3,"uuid":"6c4b0a9e-7dba-4452-acde-b0f132240d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6808","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6809","nonce":2512845559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6810","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6811","nonce":2512845559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6814","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6815","nonce":2512845559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6812","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6813","nonce":2512845559}]},"public_addr":"10.20.193.165:6809/2512845559","cluster_addr":"10.20.193.165:6811/2512845559","heartbeat_back_addr":"10.20.193.165:6815/2512845559","heartbeat_front_addr":"10.20.193.165:6813/2512845559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:19:52.707911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:20:01.512802+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:20:09.705974+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:20:18.386066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.105:0/4198816748":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/2356899514":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6801/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/3052436975":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/1156713941":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/2664861380":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/1143914845":"2026-02-25T08:19:21.248828+0000","10.20.193.105:6800/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6801/119731213":"2026-02-25T08:19:21.248828+0000","10.20.193.105:6800/119731213":"2026-02-25T08:19:21.248828+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T08:20:24.386 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2247976994' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-24T08:20:24.387 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2707896822' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-24T08:20:24.387 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2875540122' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T08:20:24.437 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-24T08:20:24.438 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-24T08:20:24.439 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-24T08:20:24.439 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-24T08:20:24.555 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:24.556 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:24.556 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:24.557 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:24.664 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.662+0000 7f7562f99640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.664 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.663+0000 7f7562f99640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.665 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.663+0000 7f845b352640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.665 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.664+0000 7f845b352640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.664+0000 7f16f2305640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.664+0000 7f16f2305640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.668 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.666+0000 7ff4ac6ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.668 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.667+0000 7ff4ac6ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.713 INFO:teuthology.orchestra.run.trial105.stdout:73014444037 2026-02-24T08:20:24.714 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T08:20:24.719 INFO:teuthology.orchestra.run.trial105.stdout:38654705673 2026-02-24T08:20:24.720 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T08:20:24.730 INFO:teuthology.orchestra.run.trial105.stdout:98784247810 2026-02-24T08:20:24.730 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T08:20:24.745 INFO:teuthology.orchestra.run.trial105.stdout:55834574855 2026-02-24T08:20:24.745 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T08:20:24.784 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 podman[63499]: 2026-02-24 08:20:24.738033322 +0000 UTC m=+0.010870474 image pull 4fcecf061b747d0b5dc55bc7efdba26f87768d058d403b5bcc3f0904cf49f973 quay.io/prometheus/prometheus:v3.6.0 2026-02-24T08:20:24.829 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:24.858 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:24.901 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:24.902 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:24.943 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.941+0000 7efdf8a25640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.943 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.942+0000 7efdf8a25640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.950 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.948+0000 7efde2396640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:24.950 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:24.949+0000 7efde2396640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:25.003 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:25.001+0000 7f8cc953b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:25.004 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:25.002+0000 7f8cc953b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:25.004 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:25.002+0000 7fec5cd64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:25.004 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:25.002+0000 7fec5cd64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:25.056 INFO:teuthology.orchestra.run.trial105.stdout:73014444036 2026-02-24T08:20:25.061 INFO:teuthology.orchestra.run.trial105.stdout:38654705671 2026-02-24T08:20:25.095 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444037 got 73014444036 for osd.2 2026-02-24T08:20:25.101 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705673 got 38654705671 for osd.0 2026-02-24T08:20:25.118 INFO:teuthology.orchestra.run.trial105.stdout:98784247809 2026-02-24T08:20:25.118 INFO:teuthology.orchestra.run.trial105.stdout:55834574853 2026-02-24T08:20:25.157 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.1 2026-02-24T08:20:25.161 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247810 got 98784247809 for osd.3 2026-02-24T08:20:25.184 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 systemd[1]: Started Ceph prometheus.a for 7561fe62-1159-11f1-9273-d404e6e7d460. 2026-02-24T08:20:25.184 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.807Z level=INFO source=main.go:1545 msg="updated GOGC" old=100 new=75 2026-02-24T08:20:25.184 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.807Z level=INFO source=main.go:677 msg="Leaving GOMAXPROCS=24: CPU quota undefined" component=automaxprocs 2026-02-24T08:20:25.184 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.807Z level=INFO source=memlimit.go:198 msg="GOMEMLIMIT is updated" component=automemlimit package=github.com/KimMachineGun/automemlimit/memlimit GOMEMLIMIT=120212523417 previous=9223372036854775807 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.807Z level=INFO source=main.go:770 msg="Starting Prometheus Server" mode=server version="(version=3.6.0, branch=HEAD, revision=491734606591ef8c188f5489c70380805bc868c0)" 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.807Z level=INFO source=main.go:775 msg="operational information" build_context="(go=go1.24.7, platform=linux/amd64, user=root@bfdf1aa26e4d, date=20250921-19:51:16, tags=netgo,builtinassets)" host_details="(Linux 5.14.0-686.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Feb 19 10:49:27 UTC 2026 x86_64 trial165 (none))" fd_limits="(soft=1048576, hard=1048576)" vm_limits="(soft=unlimited, hard=unlimited)" 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.809Z level=INFO source=web.go:659 msg="Start listening for connections" component=web address=:9095 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.810Z level=INFO source=main.go:1289 msg="Starting TSDB ..." 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.810Z level=INFO source=tls_config.go:347 msg="Listening on" component=web address=[::]:9095 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.810Z level=INFO source=tls_config.go:350 msg="TLS is disabled." component=web http2=false address=[::]:9095 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.811Z level=INFO source=head.go:667 msg="Replaying on-disk memory mappable chunks if any" component=tsdb 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.811Z level=INFO source=head.go:754 msg="On-disk memory mappable chunks replay completed" component=tsdb duration=611ns 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.811Z level=INFO source=head.go:762 msg="Replaying WAL, this may take a while" component=tsdb 2026-02-24T08:20:25.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.812Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=0 maxSegment=0 duration=827.439µs 2026-02-24T08:20:25.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.812Z level=INFO source=head.go:872 msg="WAL replay completed" component=tsdb checkpoint_replay_duration=13.395µs wal_replay_duration=850.893µs wbl_replay_duration=130ns chunk_snapshot_load_duration=0s mmap_chunk_replay_duration=611ns total_replay_duration=887.009µs 2026-02-24T08:20:25.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.814Z level=INFO source=main.go:1310 msg="filesystem information" fs_type=XFS_SUPER_MAGIC 2026-02-24T08:20:25.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.814Z level=INFO source=main.go:1313 msg="TSDB started" 2026-02-24T08:20:25.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.814Z level=INFO source=main.go:1498 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-02-24T08:20:25.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.825Z level=INFO source=main.go:1538 msg="Completed loading of configuration file" db_storage=851ns remote_storage=982ns web_handler=221ns query_engine=461ns scrape=384.835µs scrape_sd=34.274µs notify=701ns notify_sd=330ns rules=10.305793ms tracing=4.819µs filename=/etc/prometheus/prometheus.yml totalDuration=10.892394ms 2026-02-24T08:20:25.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.825Z level=INFO source=main.go:1274 msg="Server is ready to receive web requests." 2026-02-24T08:20:25.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:24 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:24.825Z level=INFO source=manager.go:176 msg="Starting rule manager..." component="rule manager" 2026-02-24T08:20:25.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2334099415' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T08:20:25.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:25.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:25.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' 2026-02-24T08:20:25.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2026-02-24T08:20:25.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 101 KiB/s, 0 objects/s recovering 2026-02-24T08:20:25.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/894985747' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T08:20:25.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2824495132' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T08:20:25.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3063164533' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T08:20:25.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2075526334' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T08:20:26.097 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T08:20:26.101 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T08:20:26.120 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:25 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ignoring --setuser ceph since I am not root 2026-02-24T08:20:26.120 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:25 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ignoring --setgroup ceph since I am not root 2026-02-24T08:20:26.120 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:25 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:20:25.867+0000 7f69faa11fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.121 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:25 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:20:25.869+0000 7f69faa11fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.121 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:25 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:20:25.870+0000 7f69faa11fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.158 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T08:20:26.162 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T08:20:26.216 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:26.237 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:26.278 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:26.279 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:26.325 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.323+0000 7fc04e5ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.325 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.323+0000 7fc04e5ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.332 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.330+0000 7f16b1c73640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.332 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.331+0000 7f16b1c73640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.381 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.379+0000 7fbdf63fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.381 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.380+0000 7fbdf63fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.382 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.380+0000 7fdbc08f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.382 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.381+0000 7fdbc08f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.439 INFO:teuthology.orchestra.run.trial105.stdout:73014444037 2026-02-24T08:20:26.448 INFO:teuthology.orchestra.run.trial105.stdout:38654705673 2026-02-24T08:20:26.482 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.2 2026-02-24T08:20:26.483 DEBUG:teuthology.parallel:result is None 2026-02-24T08:20:26.490 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.0 2026-02-24T08:20:26.490 DEBUG:teuthology.parallel:result is None 2026-02-24T08:20:26.495 INFO:teuthology.orchestra.run.trial105.stdout:55834574855 2026-02-24T08:20:26.499 INFO:teuthology.orchestra.run.trial105.stdout:98784247810 2026-02-24T08:20:26.535 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2026-02-24T08:20:26.536 DEBUG:teuthology.parallel:result is None 2026-02-24T08:20:26.542 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247810 got 98784247810 for osd.3 2026-02-24T08:20:26.542 DEBUG:teuthology.parallel:result is None 2026-02-24T08:20:26.542 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T08:20:26.542 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:20:26.699 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:26.815 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.812+0000 7f221d389640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:26.815 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:26.813+0000 7f221d389640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:27.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:26 trial105 ceph-mon[39442]: from='mgr.14154 10.20.193.105:0/1310849701' entity='mgr.x' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-24T08:20:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:26 trial105 ceph-mon[39442]: mgrmap e15: x(active, since 54s) 2026-02-24T08:20:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4222440087' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T08:20:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2561437402' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T08:20:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1836125155' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T08:20:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/960591726' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T08:20:27.189 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:26 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T08:20:27.190 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:26 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T08:20:27.190 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:26 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: from numpy import show_config as show_numpy_config 2026-02-24T08:20:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: Active manager daemon x restarted 2026-02-24T08:20:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: Activating manager daemon x 2026-02-24T08:20:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: osdmap e26: 4 total, 4 up, 4 in 2026-02-24T08:20:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: mgrmap e16: x(active, starting, since 0.00348268s) 2026-02-24T08:20:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T08:20:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T08:20:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T08:20:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T08:20:29.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T08:20:29.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T08:20:29.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T08:20:29.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T08:20:29.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T08:20:29.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:28 trial105 ceph-mon[39442]: Manager daemon x is now available 2026-02-24T08:20:29.689 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:29.689 INFO:teuthology.orchestra.run.trial105.stderr:Warning: due to ceph-mgr restart, some PG states may not be up to date 2026-02-24T08:20:29.689 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:20:29.729 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":false,"pg_map":{"version":2,"stamp":"2026-02-24T08:20:28.687819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:28.681944+0000","last_change":"2026-02-24T08:20:28.681944+0000","last_active":"2026-02-24T08:20:28.681944+0000","last_peered":"2026-02-24T08:20:28.681944+0000","last_clean":"2026-02-24T08:20:28.681944+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:28.681944+0000","last_undegraded":"2026-02-24T08:20:28.681944+0000","last_fullsized":"2026-02-24T08:20:28.681944+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:28.681944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:28.681944+0000","last_clean_scrub_stamp":"2026-02-24T08:20:28.681944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[],"pool_statfs":[]}} 2026-02-24T08:20:29.729 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:20:29.847 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:29.954 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:29.951+0000 7f0f72594640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:29.954 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:20:29.954 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:29.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:20:29.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-24T08:20:29.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T08:20:29.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T08:20:29.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:29.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:29.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:29.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:29.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:29 trial105 ceph-mon[39442]: mgrmap e17: x(active, since 1.00606s) 2026-02-24T08:20:29.956 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:29.952+0000 7f0f72594640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:29.956 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:29] ENGINE Bus STARTING 2026-02-24T08:20:29.956 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: CherryPy Checker: 2026-02-24T08:20:29.956 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: The Application mounted at '' has an empty config. 2026-02-24T08:20:29.957 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:20:29.957 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:29] ENGINE Serving on http://:::9283 2026-02-24T08:20:29.957 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:29] ENGINE Bus STARTED 2026-02-24T08:20:30.062 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:30.063 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:20:30.099 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":3,"stamp":"2026-02-24T08:20:29.689195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2075888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42927,"internal_metadata":110319697},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"19'92","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-24T08:20:28.914212+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:20:28.914212+0000","last_peered":"2026-02-24T08:20:28.914212+0000","last_clean":"2026-02-24T08:20:28.914212+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:20:28.914212+0000","last_undegraded":"2026-02-24T08:20:28.914212+0000","last_fullsized":"2026-02-24T08:20:28.914212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6166,"internal_metadata":27584490},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":76196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:20:30.100 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T08:20:30.101 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T08:20:30.101 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-24T08:20:30.101 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph health --format=json 2026-02-24T08:20:30.221 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:30.332 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:30.329+0000 7f56bb3aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:30.332 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:30.330+0000 7f56bb3aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:30.471 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:30.471 INFO:teuthology.orchestra.run.trial105.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T08:20:30.615 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-24T08:20:30.616 INFO:tasks.cephadm:Setup complete, yielding 2026-02-24T08:20:30.616 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-24T08:20:30.639 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial105.front.sepia.ceph.com 2026-02-24T08:20:30.640 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-24T08:20:30.815 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:30.861 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: [24/Feb/2026:08:20:29] ENGINE Bus STARTING 2026-02-24T08:20:30.861 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: [24/Feb/2026:08:20:29] ENGINE Serving on http://10.20.193.105:8765 2026-02-24T08:20:30.861 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: [24/Feb/2026:08:20:29] ENGINE Serving on https://10.20.193.105:7150 2026-02-24T08:20:30.861 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: [24/Feb/2026:08:20:29] ENGINE Bus STARTED 2026-02-24T08:20:30.861 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: [24/Feb/2026:08:20:29] ENGINE Client ('10.20.193.105', 49602) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T08:20:30.862 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:20:30.862 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-24T08:20:30.862 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:20:30.862 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.862 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.862 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.862 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: Adjusting osd_memory_target on trial165 to 44071M 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: Updating trial105:/etc/ceph/ceph.conf 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: Updating trial165:/etc/ceph/ceph.conf 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.864 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.864 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:20:30.864 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.864 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:30.864 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/497053260' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-24T08:20:30.923 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:30.921+0000 7f8ce355a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:30.924 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:30.921+0000 7f8ce355a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:31.040 INFO:teuthology.orchestra.run.trial105.stdout:Backend: cephadm 2026-02-24T08:20:31.040 INFO:teuthology.orchestra.run.trial105.stdout:Available: Yes 2026-02-24T08:20:31.040 INFO:teuthology.orchestra.run.trial105.stdout:Paused: No 2026-02-24T08:20:31.077 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-24T08:20:31.193 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:31.301 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:31.299+0000 7f8ec814f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:31.301 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:31.299+0000 7f8ec814f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:31.420 INFO:teuthology.orchestra.run.trial105.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-24T08:20:31.421 INFO:teuthology.orchestra.run.trial105.stdout:mgr.x trial105 *:9283,8765 running (78s) 2s ago 78s 507M - 20.3.0-5440-gff63f3d9 3992f70354a3 4b705cc3fc1c 2026-02-24T08:20:31.421 INFO:teuthology.orchestra.run.trial105.stdout:mon.a trial105 running (79s) 2s ago 80s 45.4M 2048M 20.3.0-5440-gff63f3d9 3992f70354a3 45e9473c32d3 2026-02-24T08:20:31.421 INFO:teuthology.orchestra.run.trial105.stdout:osd.0 trial105 running (40s) 2s ago 42s 40.0M 41.0G 20.3.0-5440-gff63f3d9 3992f70354a3 f1ea039550a7 2026-02-24T08:20:31.421 INFO:teuthology.orchestra.run.trial105.stdout:osd.1 trial105 running (31s) 2s ago 33s 39.1M 41.0G 20.3.0-5440-gff63f3d9 3992f70354a3 89ad56081f06 2026-02-24T08:20:31.421 INFO:teuthology.orchestra.run.trial105.stdout:osd.2 trial165 running (23s) 1s ago 25s 40.5M 43.0G 20.3.0-5440-gff63f3d9 3992f70354a3 5dfd16aa814a 2026-02-24T08:20:31.421 INFO:teuthology.orchestra.run.trial105.stdout:osd.3 trial165 running (14s) 1s ago 16s 39.0M 43.0G 20.3.0-5440-gff63f3d9 3992f70354a3 4e928ddc1455 2026-02-24T08:20:31.421 INFO:teuthology.orchestra.run.trial105.stdout:prometheus.a trial165 *:9095 running (6s) 1s ago 6s 36.5M - 3.6.0 4fcecf061b74 e666ee5d7f4d 2026-02-24T08:20:31.462 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-24T08:20:31.583 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:31.688 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:31.686+0000 7f0dfb8e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:31.688 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:31.686+0000 7f0dfb8e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:31.801 INFO:teuthology.orchestra.run.trial105.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-24T08:20:31.801 INFO:teuthology.orchestra.run.trial105.stdout:mgr 1/1 2s ago 50s trial105=x;count:1 2026-02-24T08:20:31.801 INFO:teuthology.orchestra.run.trial105.stdout:mon 1/1 2s ago 52s trial105:10.20.193.105=a;count:1 2026-02-24T08:20:31.801 INFO:teuthology.orchestra.run.trial105.stdout:node-exporter ?:9100 0/2 - 9s trial105=a;trial165=b;count:2 2026-02-24T08:20:31.802 INFO:teuthology.orchestra.run.trial105.stdout:osd.default 4 2s ago 21s trial165 2026-02-24T08:20:31.802 INFO:teuthology.orchestra.run.trial105.stdout:prometheus ?:9095 1/1 2s ago 10s trial165=a;count:1 2026-02-24T08:20:31.840 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-24T08:20:31.955 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:31.977 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: Updating trial165:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:20:31.977 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: Updating trial105:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.conf 2026-02-24T08:20:31.977 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: Updating trial105:/etc/ceph/ceph.client.admin.keyring 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: Updating trial165:/etc/ceph/ceph.client.admin.keyring 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: from='client.14303 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: Updating trial165:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: Updating trial105:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: Deploying daemon node-exporter.a on trial105 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: mgrmap e18: x(active, since 2s) 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:31.978 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:31 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:32.059 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:32.058+0000 7fc89b2c7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:32.059 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:32.058+0000 7fc89b2c7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:32.171 INFO:teuthology.orchestra.run.trial105.stdout:HOST ADDR LABELS STATUS 2026-02-24T08:20:32.171 INFO:teuthology.orchestra.run.trial105.stdout:trial105 10.20.193.105 2026-02-24T08:20:32.171 INFO:teuthology.orchestra.run.trial105.stdout:trial165 10.20.193.165 2026-02-24T08:20:32.171 INFO:teuthology.orchestra.run.trial105.stdout:2 hosts in cluster 2026-02-24T08:20:32.206 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-24T08:20:32.323 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:32.363 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 bash[64903]: Getting image source signatures 2026-02-24T08:20:32.363 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 bash[64903]: Copying blob sha256:c6e37428e3b36731b2b7a99979e0dbb27ce0849df0c23fb2b73e99bdbcd7ca33 2026-02-24T08:20:32.363 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 bash[64903]: Copying blob sha256:9fa9226be034e47923c0457d916aa68474cdfb23af8d4525e9baeebc4760977a 2026-02-24T08:20:32.363 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 bash[64903]: Copying blob sha256:1617e25568b2231fdd0d5caff63b06f6f7738d8d961f031c80e47d35aaec9733 2026-02-24T08:20:32.421 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:32.419+0000 7fcc5b43b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:32.421 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:32.419+0000 7fcc5b43b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:32.535 INFO:teuthology.orchestra.run.trial105.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-24T08:20:32.535 INFO:teuthology.orchestra.run.trial105.stdout:trial105 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_0325108BFDBC 1788G No 13s ago Has a FileSystem, LVM detected 2026-02-24T08:20:32.535 INFO:teuthology.orchestra.run.trial105.stdout:trial105 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_0325108BFDB7 1788G No 13s ago Has a FileSystem, LVM detected 2026-02-24T08:20:32.535 INFO:teuthology.orchestra.run.trial105.stdout:trial165 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00429 1788G No 9s ago Has a FileSystem, LVM detected 2026-02-24T08:20:32.535 INFO:teuthology.orchestra.run.trial105.stdout:trial165 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B0040E 1788G No 9s ago Has a FileSystem, LVM detected 2026-02-24T08:20:32.571 INFO:teuthology.run_tasks:Running task thrashosds... 2026-02-24T08:20:32.590 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_pgnum_grow': 2, 'chance_pgpnum_fix': 1, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 2, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-24T08:20:32.590 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'wip-shraddhaag-enable-cephadm-tests', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'a78040ddef3ba5a489697ca2fe95df59a7d8bd08'}} 2026-02-24T08:20:32.590 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_pgnum_grow': 2, 'chance_pgpnum_fix': 1, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-24T08:20:32.591 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 bash[64903]: Copying config sha256:255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 bash[64903]: Writing manifest to image destination 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 podman[64903]: 2026-02-24 08:20:32.564269185 +0000 UTC m=+0.531154706 container create 07d4cd3bbba88214a8147c624a36bc24f58cc0584ee9a0e8dc98b4fb0e770d6a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 podman[64903]: 2026-02-24 08:20:32.594944905 +0000 UTC m=+0.561830446 container init 07d4cd3bbba88214a8147c624a36bc24f58cc0584ee9a0e8dc98b4fb0e770d6a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 podman[64903]: 2026-02-24 08:20:32.597230184 +0000 UTC m=+0.564115695 container start 07d4cd3bbba88214a8147c624a36bc24f58cc0584ee9a0e8dc98b4fb0e770d6a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 bash[64903]: 07d4cd3bbba88214a8147c624a36bc24f58cc0584ee9a0e8dc98b4fb0e770d6a 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 podman[64903]: 2026-02-24 08:20:32.559161928 +0000 UTC m=+0.526047459 image pull 255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 quay.io/prometheus/node-exporter:v1.9.1 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.600Z level=INFO source=node_exporter.go:216 msg="Starting node_exporter" version="(version=1.9.1, branch=HEAD, revision=f2ec547b49af53815038a50265aa2adcd1275959)" 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.600Z level=INFO source=node_exporter.go:217 msg="Build context" build_context="(go=go1.23.7, platform=linux/amd64, user=root@7023beaa563a, date=20250401-15:19:01, tags=unknown)" 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 systemd[1]: Started Ceph node-exporter.b for 7561fe62-1159-11f1-9273-d404e6e7d460. 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=diskstats_common.go:110 msg="Parsed flag --collector.diskstats.device-exclude" collector=diskstats flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=ERROR source=diskstats_linux.go:264 msg="Failed to open directory, disabling udev device properties" collector=diskstats path=/run/udev/data 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=filesystem_common.go:265 msg="Parsed flag --collector.filesystem.mount-points-exclude" collector=filesystem flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=filesystem_common.go:294 msg="Parsed flag --collector.filesystem.fs-types-exclude" collector=filesystem flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:135 msg="Enabled collectors" 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=arp 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=bcache 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=bonding 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=btrfs 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=conntrack 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=cpu 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=cpufreq 2026-02-24T08:20:32.684 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=diskstats 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=dmi 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=edac 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=entropy 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=fibrechannel 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=filefd 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=filesystem 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=hwmon 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=infiniband 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=ipvs 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=loadavg 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=mdadm 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=meminfo 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=netclass 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=netdev 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=netstat 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.601Z level=INFO source=node_exporter.go:141 msg=nfs 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=nfsd 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=nvme 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=os 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=powersupplyclass 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=pressure 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=rapl 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=schedstat 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=selinux 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=sockstat 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=softnet 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=stat 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=tapestats 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=textfile 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=thermal_zone 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=time 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=udp_queues 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=uname 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=vmstat 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=watchdog 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=xfs 2026-02-24T08:20:32.685 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=node_exporter.go:141 msg=zfs 2026-02-24T08:20:32.686 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=tls_config.go:347 msg="Listening on" address=[::]:9100 2026-02-24T08:20:32.686 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:20:32 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b[64952]: time=2026-02-24T08:20:32.602Z level=INFO source=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9100 2026-02-24T08:20:32.705 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:32.817 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:32.814+0000 7fad89abc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:32.817 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:32.815+0000 7fad89abc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:32.817 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: from='client.14309 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:20:32.817 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: from='client.14311 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:20:32.818 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: Deploying daemon node-exporter.b on trial165 2026-02-24T08:20:32.818 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: from='client.14313 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:20:32.818 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:32.818 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:32.818 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:32.818 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:32.818 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:32.818 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:32 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:20:33.010 INFO:tasks.thrashosds:Beginning thrashosds... 2026-02-24T08:20:33.011 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T08:20:33.011 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:20:33.124 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:33.226 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:33.224+0000 7f018ed33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:33.226 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:33.224+0000 7f018ed33640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:33.332 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:33.333 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:20:33.370 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2026-02-24T08:20:32.687574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2075888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42927,"internal_metadata":110319697},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.998378"},"pg_stats":[{"pgid":"1.0","version":"19'92","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-24T08:20:28.914212+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:20:28.914212+0000","last_peered":"2026-02-24T08:20:28.914212+0000","last_clean":"2026-02-24T08:20:28.914212+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:20:28.914212+0000","last_undegraded":"2026-02-24T08:20:28.914212+0000","last_fullsized":"2026-02-24T08:20:28.914212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6166,"internal_metadata":27584490},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":76196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:20:33.371 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:20:33.408 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE Bus STOPPING 2026-02-24T08:20:33.408 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-24T08:20:33.408 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE Bus STOPPED 2026-02-24T08:20:33.408 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE Bus STARTING 2026-02-24T08:20:33.408 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE Serving on http://:::9283 2026-02-24T08:20:33.408 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE Bus STARTED 2026-02-24T08:20:33.485 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:33.583 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:33.581+0000 7f65ab96a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:33.583 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:33.581+0000 7f65ab96a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:33.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 systemd[1]: Stopping Ceph prometheus.a for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:20:33.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.627Z level=WARN source=main.go:1076 msg="Received an OS signal, exiting gracefully..." signal=terminated 2026-02-24T08:20:33.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.627Z level=INFO source=main.go:1101 msg="Stopping scrape discovery manager..." 2026-02-24T08:20:33.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.627Z level=INFO source=main.go:1115 msg="Stopping notify discovery manager..." 2026-02-24T08:20:33.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.627Z level=INFO source=main.go:1097 msg="Scrape discovery manager stopped" 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.627Z level=INFO source=manager.go:190 msg="Stopping rule manager..." component="rule manager" 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.627Z level=INFO source=main.go:1111 msg="Notify discovery manager stopped" 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.627Z level=INFO source=manager.go:206 msg="Rule manager stopped" component="rule manager" 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.627Z level=INFO source=main.go:1152 msg="Stopping scrape manager..." 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.627Z level=INFO source=main.go:1144 msg="Scrape manager stopped" 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.628Z level=INFO source=manager.go:543 msg="Stopping notification manager..." component=notifier 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.628Z level=INFO source=manager.go:285 msg="Draining any remaining notifications..." component=notifier 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.628Z level=INFO source=manager.go:291 msg="Remaining notifications drained" component=notifier 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.628Z level=INFO source=manager.go:218 msg="Notification manager stopped" component=notifier 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.628Z level=INFO source=main.go:1422 msg="Notifier manager stopped" 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[63522]: time=2026-02-24T08:20:33.628Z level=INFO source=main.go:1436 msg="See you next time!" 2026-02-24T08:20:33.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 podman[65607]: 2026-02-24 08:20:33.63767057 +0000 UTC m=+0.022654537 container died e666ee5d7f4dabc5043c62c029ddb0cd484ab5210271619372bc18460949f692 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T08:20:33.686 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 podman[65607]: 2026-02-24 08:20:33.645219457 +0000 UTC m=+0.030203434 container remove e666ee5d7f4dabc5043c62c029ddb0cd484ab5210271619372bc18460949f692 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T08:20:33.686 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 bash[65607]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a 2026-02-24T08:20:33.691 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:33.691 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:20:33.729 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2026-02-24T08:20:32.687574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2075888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42927,"internal_metadata":110319697},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.998378"},"pg_stats":[{"pgid":"1.0","version":"19'92","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-24T08:20:28.914212+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:20:28.914212+0000","last_peered":"2026-02-24T08:20:28.914212+0000","last_clean":"2026-02-24T08:20:28.914212+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:20:28.914212+0000","last_undegraded":"2026-02-24T08:20:28.914212+0000","last_fullsized":"2026-02-24T08:20:28.914212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247812,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6166,"internal_metadata":27584490},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":76196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:20:33.730 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T08:20:33.730 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd dump 2026-02-24T08:20:33.887 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:33.943 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE Bus STOPPING 2026-02-24T08:20:33.944 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-24T08:20:33.944 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE Bus STOPPED 2026-02-24T08:20:33.944 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:33 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:33] ENGINE Bus STARTING 2026-02-24T08:20:33.944 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='client.14315 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:20:33.944 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='client.14317 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T08:20:33.944 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:20:33.944 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1132048915' entity='client.admin' 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-24T08:20:33.945 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:33 trial105 ceph-mon[39442]: mgrmap e19: x(active, since 4s) 2026-02-24T08:20:33.994 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:33.992+0000 7f924a277640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:33.994 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:33.993+0000 7f924a277640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:34.105 INFO:teuthology.orchestra.run.trial105.stdout:epoch 26 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:fsid 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:created 2026-02-24T08:19:11.143358+0000 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:modified 2026-02-24T08:20:28.681944+0000 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:crush_version 10 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:full_ratio 0.95 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:backfillfull_ratio 0.9 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:nearfull_ratio 0.85 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:require_min_compat_client luminous 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:min_compat_client jewel 2026-02-24T08:20:34.106 INFO:teuthology.orchestra.run.trial105.stdout:require_osd_release tentacle 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:stretch_mode_enabled false 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:allow_crimson=true 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:max_osd 4 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:osd.0 up in weight 1 up_from 9 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:10.20.193.105:6802/869632794,v1:10.20.193.105:6803/869632794] [v2:10.20.193.105:6804/869632794,v1:10.20.193.105:6805/869632794] exists,up 5b6d17b0-c5d6-474b-89bc-48f24734b414 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:10.20.193.105:6810/2121156766,v1:10.20.193.105:6811/2121156766] [v2:10.20.193.105:6812/2121156766,v1:10.20.193.105:6813/2121156766] exists,up f33507e8-8616-4090-8585-e8a08345165c 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:osd.2 up in weight 1 up_from 17 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:10.20.193.165:6800/3063574535,v1:10.20.193.165:6801/3063574535] [v2:10.20.193.165:6802/3063574535,v1:10.20.193.165:6803/3063574535] exists,up 0b15ff1c-8554-41ad-b1f3-0f878aa73435 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:osd.3 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:10.20.193.165:6808/2512845559,v1:10.20.193.165:6809/2512845559] [v2:10.20.193.165:6810/2512845559,v1:10.20.193.165:6811/2512845559] exists,up 6c4b0a9e-7dba-4452-acde-b0f132240d27 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/3562493168 expires 2026-02-25T08:20:28.681914+0000 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/3463864029 expires 2026-02-25T08:20:28.681914+0000 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:6801/4215880599 expires 2026-02-25T08:20:28.681914+0000 2026-02-24T08:20:34.107 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:6801/119731213 expires 2026-02-25T08:19:21.248828+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/1143914845 expires 2026-02-25T08:19:21.248828+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/2664861380 expires 2026-02-25T08:19:21.248828+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/4203947306 expires 2026-02-25T08:20:28.681914+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:6800/1386409091 expires 2026-02-25T08:19:30.935349+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/1156713941 expires 2026-02-25T08:19:21.248828+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/3052436975 expires 2026-02-25T08:19:30.935349+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:6801/1386409091 expires 2026-02-25T08:19:30.935349+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/2356899514 expires 2026-02-25T08:19:30.935349+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:6800/119731213 expires 2026-02-25T08:19:21.248828+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/4198816748 expires 2026-02-25T08:19:30.935349+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:0/1553193359 expires 2026-02-25T08:20:28.681914+0000 2026-02-24T08:20:34.108 INFO:teuthology.orchestra.run.trial105.stdout:blocklist 10.20.193.105:6800/4215880599 expires 2026-02-25T08:20:28.681914+0000 2026-02-24T08:20:34.142 INFO:tasks.cephadm.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:10.20.193.105:6802/869632794,v1:10.20.193.105:6803/869632794] [v2:10.20.193.105:6804/869632794,v1:10.20.193.105:6805/869632794] exists,up 5b6d17b0-c5d6-474b-89bc-48f24734b414', 'osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:10.20.193.105:6810/2121156766,v1:10.20.193.105:6811/2121156766] [v2:10.20.193.105:6812/2121156766,v1:10.20.193.105:6813/2121156766] exists,up f33507e8-8616-4090-8585-e8a08345165c', 'osd.2 up in weight 1 up_from 17 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:10.20.193.165:6800/3063574535,v1:10.20.193.165:6801/3063574535] [v2:10.20.193.165:6802/3063574535,v1:10.20.193.165:6803/3063574535] exists,up 0b15ff1c-8554-41ad-b1f3-0f878aa73435', 'osd.3 up in weight 1 up_from 23 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:10.20.193.165:6808/2512845559,v1:10.20.193.165:6809/2512845559] [v2:10.20.193.165:6810/2512845559,v1:10.20.193.165:6811/2512845559] exists,up 6c4b0a9e-7dba-4452-acde-b0f132240d27'] 2026-02-24T08:20:34.143 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph daemon mon.a config show 2026-02-24T08:20:34.184 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 systemd[1]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460@prometheus.a.service: Deactivated successfully. 2026-02-24T08:20:34.184 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 systemd[1]: Stopped Ceph prometheus.a for 7561fe62-1159-11f1-9273-d404e6e7d460. 2026-02-24T08:20:34.184 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 systemd[1]: Starting Ceph prometheus.a for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:20:34.184 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 podman[65738]: 2026-02-24 08:20:33.800673338 +0000 UTC m=+0.016963995 container create d57224ac37b717e1255683ba42ae3bceb81fea28a55dd3d01d74a13ab51963d0 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T08:20:34.184 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 podman[65738]: 2026-02-24 08:20:33.830028964 +0000 UTC m=+0.046319631 container init d57224ac37b717e1255683ba42ae3bceb81fea28a55dd3d01d74a13ab51963d0 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 podman[65738]: 2026-02-24 08:20:33.832028332 +0000 UTC m=+0.048318989 container start d57224ac37b717e1255683ba42ae3bceb81fea28a55dd3d01d74a13ab51963d0 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 bash[65738]: d57224ac37b717e1255683ba42ae3bceb81fea28a55dd3d01d74a13ab51963d0 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 podman[65738]: 2026-02-24 08:20:33.793345743 +0000 UTC m=+0.009636400 image pull 4fcecf061b747d0b5dc55bc7efdba26f87768d058d403b5bcc3f0904cf49f973 quay.io/prometheus/prometheus:v3.6.0 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 systemd[1]: Started Ceph prometheus.a for 7561fe62-1159-11f1-9273-d404e6e7d460. 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.857Z level=INFO source=main.go:1545 msg="updated GOGC" old=100 new=75 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.858Z level=INFO source=main.go:677 msg="Leaving GOMAXPROCS=24: CPU quota undefined" component=automaxprocs 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.858Z level=INFO source=memlimit.go:198 msg="GOMEMLIMIT is updated" component=automemlimit package=github.com/KimMachineGun/automemlimit/memlimit GOMEMLIMIT=120212523417 previous=9223372036854775807 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.858Z level=INFO source=main.go:770 msg="Starting Prometheus Server" mode=server version="(version=3.6.0, branch=HEAD, revision=491734606591ef8c188f5489c70380805bc868c0)" 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.858Z level=INFO source=main.go:775 msg="operational information" build_context="(go=go1.24.7, platform=linux/amd64, user=root@bfdf1aa26e4d, date=20250921-19:51:16, tags=netgo,builtinassets)" host_details="(Linux 5.14.0-686.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Feb 19 10:49:27 UTC 2026 x86_64 trial165 (none))" fd_limits="(soft=1048576, hard=1048576)" vm_limits="(soft=unlimited, hard=unlimited)" 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.859Z level=INFO source=web.go:659 msg="Start listening for connections" component=web address=:9095 2026-02-24T08:20:34.185 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.859Z level=INFO source=main.go:1289 msg="Starting TSDB ..." 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.860Z level=INFO source=tls_config.go:347 msg="Listening on" component=web address=[::]:9095 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.860Z level=INFO source=tls_config.go:350 msg="TLS is disabled." component=web http2=false address=[::]:9095 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.861Z level=INFO source=head.go:667 msg="Replaying on-disk memory mappable chunks if any" component=tsdb 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.861Z level=INFO source=head.go:754 msg="On-disk memory mappable chunks replay completed" component=tsdb duration=501ns 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.861Z level=INFO source=head.go:762 msg="Replaying WAL, this may take a while" component=tsdb 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.861Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=0 maxSegment=1 duration=164.406µs 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.862Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=1 maxSegment=1 duration=153.295µs 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.862Z level=INFO source=head.go:872 msg="WAL replay completed" component=tsdb checkpoint_replay_duration=17.783µs wal_replay_duration=333.691µs wbl_replay_duration=220ns chunk_snapshot_load_duration=0s mmap_chunk_replay_duration=501ns total_replay_duration=379.856µs 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.864Z level=INFO source=main.go:1310 msg="filesystem information" fs_type=XFS_SUPER_MAGIC 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.864Z level=INFO source=main.go:1313 msg="TSDB started" 2026-02-24T08:20:34.186 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.864Z level=INFO source=main.go:1498 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-02-24T08:20:34.187 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.873Z level=INFO source=main.go:1538 msg="Completed loading of configuration file" db_storage=751ns remote_storage=942ns web_handler=320ns query_engine=732ns scrape=393.742µs scrape_sd=206.544µs notify=831ns notify_sd=1.393µs rules=9.048345ms tracing=3.166µs filename=/etc/prometheus/prometheus.yml totalDuration=9.830019ms 2026-02-24T08:20:34.187 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.873Z level=INFO source=main.go:1274 msg="Server is ready to receive web requests." 2026-02-24T08:20:34.187 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:33 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:33.873Z level=INFO source=manager.go:176 msg="Starting rule manager..." component="rule manager" 2026-02-24T08:20:34.267 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:34.289 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:34 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:34] ENGINE Serving on http://:::9283 2026-02-24T08:20:34.290 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:34 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:20:34] ENGINE Bus STARTED 2026-02-24T08:20:34.380 INFO:teuthology.orchestra.run.trial105.stdout:{ 2026-02-24T08:20:34.380 INFO:teuthology.orchestra.run.trial105.stdout: "name": "mon.a", 2026-02-24T08:20:34.380 INFO:teuthology.orchestra.run.trial105.stdout: "cluster": "ceph", 2026-02-24T08:20:34.380 INFO:teuthology.orchestra.run.trial105.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2026-02-24T08:20:34.380 INFO:teuthology.orchestra.run.trial105.stdout: "admin_socket_mode": "", 2026-02-24T08:20:34.380 INFO:teuthology.orchestra.run.trial105.stdout: "auth_allow_insecure_global_id_reclaim": "false", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "auth_client_required": "cephx, none", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "auth_cluster_required": "cephx", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "auth_debug": "true", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "auth_mon_ticket_ttl": "660.000000", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "auth_service_required": "cephx", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "auth_service_ticket_ttl": "240.000000", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "auth_supported": "", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_aio": "true", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_aio_poll_ms": "250", 2026-02-24T08:20:34.381 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_aio_reap_max": "16", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_async_discard": "false", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_async_discard_threads": "0", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_block_size": "4096", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_debug_aio": "false", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_debug_discard_sleep": "0", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_debug_inflight_ios": "false", 2026-02-24T08:20:34.382 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_enable_discard": "false", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_flock_retry": "3", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_inject_crash": "0", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_ioring": "false", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_ioring_hipri": "false", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_max_discard_length": "2147483648", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-24T08:20:34.383 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bdev_type": "", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_alloc_size": "1048576", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_allocator": "hybrid", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_buffered_io": "true", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_check_for_zeros": "false", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_compact_log_sync": "false", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-24T08:20:34.384 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_max_log_runway": "4194304", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_max_prefetch": "1048576", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_min_flush_size": "524288", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_min_log_runway": "1048576", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_replay_recovery": "false", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_sync_write": "false", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-24T08:20:34.385 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_allocation_from_file": "true", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_allocator": "hybrid", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_async_db_compaction": "true", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_bdev_label_multi": "true", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-24T08:20:34.386 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_create": "true", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_db_create": "false", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_db_path": "", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_db_size": "0", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_path": "", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_preallocate_file": "false", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_size": "107374182400", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_wal_create": "false", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_wal_path": "", 2026-02-24T08:20:34.387 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_block_wal_size": "100663296", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_bluefs": "true", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_autotune": "true", 2026-02-24T08:20:34.388 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_size": "0", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cache_type": "2q", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_clone_cow": "true", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-24T08:20:34.389 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_compression_mode": "none", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_csum_type": "crc32c", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_freelist": "false", 2026-02-24T08:20:34.390 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-24T08:20:34.391 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_small_allocations": "0", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_default_buffered_read": "true", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_default_buffered_write": "false", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-24T08:20:34.392 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fail_eio": "false", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_on_mount": "false", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_on_umount": "false", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-24T08:20:34.393 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_ignore_data_csum": "false", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-24T08:20:34.394 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_log_op_age": "5.000000", 2026-02-24T08:20:34.396 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_max_alloc_size": "0", 2026-02-24T08:20:34.396 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_max_blob_size": "0", 2026-02-24T08:20:34.396 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-24T08:20:34.396 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-24T08:20:34.396 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_max_deferred_txc": "32", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_min_alloc_size": "0", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_nid_prealloc": "1024", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_onode_segment_size": "0", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-24T08:20:34.397 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_retry_disk_reads": "3", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_rocksdb_cf": "true", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_spdk_mem": "512", 2026-02-24T08:20:34.398 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_tracing": "false", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-24T08:20:34.399 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_write_v2": "false", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_write_v2_random": "false", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "bluestore_zero_block_detection": "false", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "breakpad": "false", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "ceph_assert_supresssions": "", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-24T08:20:34.400 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephx_cluster_require_signatures": "false", 2026-02-24T08:20:34.401 INFO:teuthology.orchestra.run.trial105.stdout: "cephx_cluster_require_version": "2", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "cephx_require_signatures": "false", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "cephx_require_version": "2", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "cephx_service_require_signatures": "false", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "cephx_service_require_version": "2", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "cephx_sign_messages": "true", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "chdir": "", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "client_acl_type": "", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "client_asio_thread_count": "2", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "client_cache_mid": "0.750000", 2026-02-24T08:20:34.402 INFO:teuthology.orchestra.run.trial105.stdout: "client_cache_size": "16384", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_caps_release_delay": "5", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_check_pool_perm": "true", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_debug_force_sync_read": "false", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_debug_getattr_caps": "false", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_debug_inject_features": "", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_debug_inject_tick_delay": "0", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_die_on_failed_remount": "false", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_dirsize_rbytes": "true", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-24T08:20:34.403 INFO:teuthology.orchestra.run.trial105.stdout: "client_force_lazyio": "false", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_fs": "", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_fscrypt_as": "true", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_inject_release_failure": "false", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_inject_write_delay_secs": "0", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_max_inline_size": "4096", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_mds_namespace": "", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_metadata": "", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_mount_gid": "-1", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_mount_timeout": "300", 2026-02-24T08:20:34.404 INFO:teuthology.orchestra.run.trial105.stdout: "client_mount_uid": "-1", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_mountpoint": "/", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_notify_timeout": "10", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_oc": "true", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_oc_max_dirty": "104857600", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_oc_max_objects": "1000", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_oc_size": "209715200", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_oc_target_dirty": "8388608", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_permissions": "true", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_quota": "true", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_quota_df": "true", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_readahead_max_bytes": "0", 2026-02-24T08:20:34.405 INFO:teuthology.orchestra.run.trial105.stdout: "client_readahead_max_periods": "4", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_readahead_min": "131072", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_reconnect_stale": "false", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_shutdown_timeout": "30", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_snapdir": ".snap", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_tick_interval": "1", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_trace": "", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_try_dentry_invalidate": "false", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_use_faked_inos": "false", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "client_use_random_mds": "false", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "clog_to_graylog": "false", 2026-02-24T08:20:34.406 INFO:teuthology.orchestra.run.trial105.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "clog_to_graylog_port": "12201", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "clog_to_monitors": "default=true", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "clog_to_syslog": "false", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "clog_to_syslog_level": "info", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "cluster_addr": "-", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "cluster_network": "", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "cluster_network_interface": "", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "compressor_zlib_isal": "false", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "compressor_zlib_level": "5", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "compressor_zlib_winsize": "-15", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "compressor_zstd_level": "1", 2026-02-24T08:20:34.407 INFO:teuthology.orchestra.run.trial105.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_allow_pg_split": "false", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_bluestore_cpu_set": "", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_bluestore_num_threads": "6", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_cpu_num": "0", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_cpu_set": "", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_osd_obc_lru_size": "512", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_osd_stat_interval": "0", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_poll_mode": "false", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_reactor_backend": "", 2026-02-24T08:20:34.408 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "crush_location": "", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "crush_location_hook": "", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "crush_location_hook_timeout": "10", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "d4n_writecache_enabled": "false", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "daemonize": "false", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "daos_pool": "tank", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "debug_alienstore": "0/5", 2026-02-24T08:20:34.409 INFO:teuthology.orchestra.run.trial105.stdout: "debug_allow_any_pool_priority": "false", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_asok": "1/5", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_asok_assert_abort": "false", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_asserts_on_shutdown": "true", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_auth": "1/5", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_bdev": "1/3", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_bluefs": "1/5", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_bluestore": "1/5", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_bluestore_compression": "1/5", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_buffer": "0/1", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_ceph_dedup": "0/5", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_ceph_exporter": "1/5", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_cephfs_mirror": "0/5", 2026-02-24T08:20:34.410 INFO:teuthology.orchestra.run.trial105.stdout: "debug_cephsqlite": "0/5", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_client": "0/5", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_compressor": "1/5", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_context": "0/1", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_crimson_interrupt": "0/5", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_crush": "1/1", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_crypto": "1/5", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_cyanstore": "0/5", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_deliberately_leak_memory": "false", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_disable_randomized_ping": "false", 2026-02-24T08:20:34.411 INFO:teuthology.orchestra.run.trial105.stdout: "debug_dpdk": "1/5", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_eventtrace": "1/5", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_filer": "0/1", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_filestore": "1/3", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_finisher": "1/1", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_fuse": "1/5", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_heartbeat_testing_span": "0", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_heartbeatmap": "1/5", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_javaclient": "1/5", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_journal": "1/3", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_journaler": "0/5", 2026-02-24T08:20:34.412 INFO:teuthology.orchestra.run.trial105.stdout: "debug_kstore": "1/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_lockdep": "0/1", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mclock": "1/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mds": "1/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mds_balancer": "1/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mds_locker": "1/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mds_log": "1/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mds_log_expire": "1/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mds_migrator": "1/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mds_quiesce": "3/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_memstore": "1/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mgr": "2/5", 2026-02-24T08:20:34.413 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mgrc": "1/5", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_mon": "20/20", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_monc": "0/10", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_ms": "1/1", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_none": "0/5", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_objclass": "0/5", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_objectcacher": "0/5", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_objecter": "0/1", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_optracker": "0/5", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_osd": "1/5", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_paxos": "20/20", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_perfcounter": "1/5", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_prioritycache": "1/5", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rados": "0/5", 2026-02-24T08:20:34.414 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rbd": "0/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rbd_mirror": "0/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rbd_pwl": "0/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rbd_replay": "0/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_refs": "0/0", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_reserver": "1/1", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw": "1/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_access": "1/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_datacache": "1/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_dbstore": "1/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_dedup": "1/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_flight": "1/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_notification": "1/5", 2026-02-24T08:20:34.415 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_restore": "1/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rgw_sync": "1/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_rocksdb": "4/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_backref": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_cache": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_cleaner": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_device": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_epm": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_fixedkv_tree": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_journal": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_lba": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_odata": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_omap": "0/5", 2026-02-24T08:20:34.416 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_onode": "0/5", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_t": "0/5", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "debug_seastore_tm": "0/5", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "debug_striper": "0/1", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "debug_test": "0/5", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "debug_throttle": "1/1", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "debug_timer": "0/1", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "debug_tp": "0/5", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "debug_trace": "1/5", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "device_failure_prediction_mode": "none", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "ec_extent_cache_size": "10485760", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "ec_pdw_write_mode": "0", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "enable_availability_tracking": "false", 2026-02-24T08:20:34.417 INFO:teuthology.orchestra.run.trial105.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "err_to_graylog": "false", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "err_to_journald": "false", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "err_to_stderr": "true", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "err_to_syslog": "false", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "event_tracing": "false", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "exporter_addr": "0.0.0.0", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "exporter_cert_file": "", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "exporter_http_port": "9926", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "exporter_key_file": "", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "exporter_prio_limit": "5", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "exporter_sort_metrics": "true", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "exporter_stats_period": "5", 2026-02-24T08:20:34.418 INFO:teuthology.orchestra.run.trial105.stdout: "fake_statfs_for_testing": "0", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "fatal_signal_handlers": "true", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filer_max_purge_ops": "10", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filer_max_truncate_ops": "128", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_apply_finisher_threads": "1", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_blackhole": "false", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_btrfs_clone_range": "true", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_btrfs_snap": "true", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_caller_concurrency": "10", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_collect_device_partition_information": "true", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_commit_timeout": "600.000000", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_debug_inject_read_err": "false", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_debug_omap_check": "false", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_debug_verify_split": "false", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_dump_file": "", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-24T08:20:34.419 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_fadvise": "true", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_fail_eio": "true", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_fd_cache_shards": "16", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_fd_cache_size": "128", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_fiemap": "false", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_fiemap_threshold": "4096", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_inject_stall": "0", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_journal_parallel": "false", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_journal_trailing": "false", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_journal_writeahead": "false", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_kill_at": "0", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-24T08:20:34.420 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_inline_xattrs": "0", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_xattr_value_size": "0", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_merge_threshold": "-10", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_odsync_write": "false", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_omap_backend": "rocksdb", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_omap_backend_path": "", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-24T08:20:34.421 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_ondisk_finisher_threads": "1", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_op_thread_timeout": "60", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_op_threads": "2", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_punch_hole": "false", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_queue_max_ops": "50", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_seek_data_hole": "false", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_sloppy_crc": "false", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-24T08:20:34.422 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_splice": "false", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_split_multiple": "2", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_split_rand_factor": "20", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_update_to": "1000", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_enable": "true", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_xfs_extsize": "false", 2026-02-24T08:20:34.423 INFO:teuthology.orchestra.run.trial105.stdout: "filestore_zfs_snap": "false", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fio_dir": "/tmp/fio", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fsid": "7561fe62-1159-11f1-9273-d404e6e7d460", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_allow_other": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_atomic_o_trunc": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_big_writes": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_debug": "false", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_default_permissions": "false", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_disable_pagecache": "false", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_max_write": "0", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_multithreaded": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_require_active_mds": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_set_user_groups": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_splice_move": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_splice_read": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_splice_write": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-24T08:20:34.424 INFO:teuthology.orchestra.run.trial105.stdout: "fuse_use_invalidate_cb": "true", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "gss_target_name": "ceph", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "heartbeat_file": "", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "heartbeat_inject_failure": "0", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "heartbeat_interval": "5", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "host": "trial105", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-24T08:20:34.425 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "inject_early_sigterm": "false", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "jaeger_agent_port": "6799", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "jaeger_tracing_enable": "false", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_aio": "true", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_align_min_size": "65536", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_block_align": "true", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_block_size": "4096", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_dio": "true", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_discard": "false", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_force_aio": "false", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_ignore_corruption": "false", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_max_write_bytes": "10485760", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_max_write_entries": "100", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_replay_from": "0", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-24T08:20:34.426 INFO:teuthology.orchestra.run.trial105.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "journal_write_header_frequency": "0", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "journal_zero_on_create": "false", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "journaler_prefetch_periods": "10", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "journaler_prezero_periods": "5", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "journaler_write_head_interval": "15", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "key": "", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "keyfile": "", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "librados_thread_count": "2", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "lockdep": "false", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "lockdep_force_backtrace": "false", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "log_coarse_timestamps": "true", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "log_flush_on_exit": "false", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "log_graylog_host": "127.0.0.1", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "log_graylog_port": "12201", 2026-02-24T08:20:34.427 INFO:teuthology.orchestra.run.trial105.stdout: "log_max_new": "1000", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "log_max_recent": "10000", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "log_stderr_prefix": "", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "log_stop_at_utilization": "0.970000", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "log_to_file": "true", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "log_to_graylog": "false", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "log_to_journald": "false", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "log_to_stderr": "false", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "log_to_syslog": "false", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "max_rotating_auth_attempts": "10", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_action_on_write_error": "1", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_allow_async_dirops": "true", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_allow_batched_ops": "true", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_alternate_name_max": "8192", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_asio_thread_count": "2", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_export_pin": "true", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_fragment_dirs": "true", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-24T08:20:34.428 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_fragment_interval": "5", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_interval": "10", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_max": "-1", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_max_until": "-1", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_merge_size": "50", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_midchunk": "0.300000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_min_start": "0.200000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_minchunk": "0.001000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_mode": "0", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_need_max": "1.200000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_need_min": "0.800000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_overload_epochs": "2", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_split_bits": "3", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_split_size": "10000", 2026-02-24T08:20:34.429 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_target_decay": "10.000000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_beacon_grace": "15.000000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_beacon_interval": "4.000000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_mid": "0.700000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_quiesce_delay": "0", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_release_free_interval": "10", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_reservation": "0.050000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_trim_interval": "1", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cache_trim_threshold": "262144", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-24T08:20:34.430 INFO:teuthology.orchestra.run.trial105.stdout: "mds_client_prealloc_inos": "1000", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_connect_bootstrapping": "false", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_damage_table_max_entries": "10000", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_debug_auth_pins": "false", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_debug_frag": "false", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_debug_scatterstat": "false", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_debug_subtrees": "false", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_decay_halflife": "5.000000", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_default_dir_hash": "2", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_defer_session_stale": "true", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_deny_all_reconnect": "false", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_dir_keys_per_op": "16384", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_dir_max_commit_size": "10", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_dir_max_entries": "0", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_dir_prefetch": "true", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_dump_cache_on_map": "false", 2026-02-24T08:20:34.431 INFO:teuthology.orchestra.run.trial105.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_early_reply": "true", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_enable_op_tracker": "true", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_enforce_unique_name": "true", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_export_ephemeral_random": "true", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_health_summarize_threshold": "10", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_inject_health_dummy": "false", 2026-02-24T08:20:34.432 INFO:teuthology.orchestra.run.trial105.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_inject_migrator_session_race": "false", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_join_fs": "", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_journal_format": "1", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_create_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_dirfrag_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_export_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_import_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_journal_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_journal_expire_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_journal_replay_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_link_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_mdstable_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_openc_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_rename_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_kill_shutdown_at": "0", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_event_large_threshold": "524288", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_events_per_segment": "1024", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_max_events": "-1", 2026-02-24T08:20:34.433 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_max_segments": "128", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_pause": "false", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_segment_size": "0", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_trim_threshold": "128", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_log_warn_factor": "2.000000", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_caps_per_client": "1048576", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_completed_flushes": "100000", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_completed_requests": "100000", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_export_size": "20971520", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_file_recover": "32", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_purge_files": "64", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_purge_ops": "8192", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_max_snaps_per_dir": "100", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_metrics_update_interval": "2", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_min_caps_per_client": "100", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_min_caps_working_set": "10000", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-24T08:20:34.434 INFO:teuthology.orchestra.run.trial105.stdout: "mds_numa_node": "-1", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_op_complaint_time": "30.000000", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_op_history_duration": "600", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_op_history_size": "20", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_op_history_slow_op_size": "20", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_op_log_threshold": "5", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_ping_grace": "15", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_ping_interval": "5", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_recall_max_caps": "30000", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_recall_warning_threshold": "262144", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_replay_interval": "1.000000", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_root_ino_gid": "0", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_root_ino_uid": "0", 2026-02-24T08:20:34.435 INFO:teuthology.orchestra.run.trial105.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_scrub_stats_review_period": "1", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_shutdown_check": "0", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_skip_ino": "0", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_snap_max_uid": "4294967294", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_snap_min_uid": "0", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_snap_rstat": "false", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_standby_replay_damaged": "false", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_symlink_recovery": "true", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_thrash_exports": "0", 2026-02-24T08:20:34.436 INFO:teuthology.orchestra.run.trial105.stdout: "mds_thrash_fragments": "0", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mds_tick_interval": "5.000000", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mds_valgrind_exit": "false", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mds_verify_backtrace": "1", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mds_verify_scatter": "false", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mds_wipe_sessions": "false", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mempool_debug": "false", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "memstore_device_bytes": "1073741824", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "memstore_page_set": "false", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "memstore_page_size": "65536", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_client_bytes": "134217728", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_client_messages": "512", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_disabled_modules": "", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_enable_op_tracker": "true", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_max_pg_creating": "1024", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_max_pg_num_change": "128", 2026-02-24T08:20:34.437 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_mds_bytes": "134217728", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_mds_messages": "128", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_mon_bytes": "134217728", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_mon_messages": "128", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_op_history_duration": "600", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_op_history_size": "20", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_op_log_threshold": "5", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_osd_bytes": "536870912", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_osd_messages": "8192", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_pool": "true", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_standby_modules": "true", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_stats_period": "5", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_stats_threshold": "5", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_tick_period": "2", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mon_allow_pool_delete": "true", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mon_allow_pool_size_one": "false", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mon_auth_validate_all_caps": "true", 2026-02-24T08:20:34.438 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_bytes": "104857600", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_directed_command_retry": "2", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_hunt_on_resend": "true", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_hunt_parallel": "3", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_log_interval": "1.000000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_ping_interval": "10.000000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_client_target_rank": "-1", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_level": "debug", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_to_file": "true", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_to_journald": "true", 2026-02-24T08:20:34.439 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_compact_on_bootstrap": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_compact_on_start": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_compact_on_trim": "true", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_cpu_threads": "4", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_crush_min_required_version": "hammer", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_daemon_bytes": "419430400", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_data_avail_crit": "5", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_data_avail_warn": "5", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_data_size_warn": "16106127360", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_dump_json": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_dump_transactions": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_extra_checks": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_no_require_squid": "false", 2026-02-24T08:20:34.440 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_down_added_grace": "180", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_down_mkfs_grace": "60", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_down_uptime_grace": "60", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_election_default_strategy": "1", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_election_timeout": "5.000000", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_elector_ping_divisor": "2", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_enable_op_tracker": "true", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_fake_pool_delete": "false", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_force_quorum_join": "false", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_globalid_prealloc": "10000", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_health_detail_to_clog": "true", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_health_log_update_period": "5", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_health_max_detail": "50", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_health_to_clog": "true", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_health_to_clog_interval": "600", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_host": "[v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0]", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_host_override": "", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_initial_members": "", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-24T08:20:34.441 INFO:teuthology.orchestra.run.trial105.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_lease": "5.000000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_log_full_interval": "50", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_log_max": "10000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_log_max_summary": "50", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_max_log_epochs": "500", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_max_osd": "10000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_max_pg_per_osd": "10000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_max_pool_pg_num": "65536", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_mds_force_trim_to": "0", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_mds_skip_sanity": "false", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_memory_autotune": "true", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_memory_target": "2147483648", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_mgr_beacon_grace": "30", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-24T08:20:34.442 INFO:teuthology.orchestra.run.trial105.stdout: "mon_mgr_digest_period": "5", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_mgr_inactive_grace": "60", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_mgr_mkfs_grace": "240", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_min_osdmap_epochs": "50", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_netsplit_grace_period": "9", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_op_complaint_time": "30", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_op_history_duration": "600", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_op_history_size": "20", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_op_history_slow_op_size": "20", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_op_log_threshold": "5", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_auto_mark_in": "false", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_cache_size": "500", 2026-02-24T08:20:34.443 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_down_out_interval": "600", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_force_trim_to": "0", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_min_down_reporters": "2", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_report_timeout": "900", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_reporter_subtree_level": "osd", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osdmap_full_prune_interval": "2", 2026-02-24T08:20:34.444 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osdmap_full_prune_min": "15", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_osdmap_full_prune_txsize": "2", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_pg_stuck_threshold": "60", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_probe_timeout": "2.000000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_reweight_max_change": "0.050000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_reweight_max_osds": "4", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_reweight_min_bytes_per_osd": "10", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_reweight_min_pgs_per_osd": "4", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_scrub_interval": "86400", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_scrub_max_keys": "100", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_scrub_timeout": "300", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_session_timeout": "300", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_smart_report_timeout": "5", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_stat_smooth_intervals": "6", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_stretch_pool_min_size": "2", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_stretch_pool_size": "4", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-24T08:20:34.445 INFO:teuthology.orchestra.run.trial105.stdout: "mon_sync_debug": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_sync_provider_kill_at": "0", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_sync_requester_kill_at": "0", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_sync_timeout": "60.000000", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_target_pg_per_osd": "100", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_tick_interval": "5", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_timecheck_interval": "300.000000", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_use_min_delay_socket": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_older_version_delay": "604800", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_filestore_osds": "true", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_misplaced": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_older_version": "true", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_pool_no_redundancy": "true", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-24T08:20:34.446 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "monmap": "", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "motr_tracing_enabled": "false", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_op_threads": "3", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_cm": "false", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_device_name": "", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_dscp": "96", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_local_gid": "", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_port_num": "1", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_sl": "3", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_support_srq": "true", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_rdma_type": "ib", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_async_reap_threshold": "5", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_before_connect": "false", 2026-02-24T08:20:34.447 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_ipv4": "true", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_ipv6": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_msgr1": "true", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_msgr2": "true", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_port_max": "7568", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_port_min": "6800", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_retry_count": "3", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_bind_retry_delay": "5", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_blackhole_client": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_blackhole_mds": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_blackhole_mgr": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_blackhole_mon": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_blackhole_osd": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_client_mode": "crc", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_cluster_mode": "crc", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_cluster_type": "", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_compress_secure": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_connection_idle_timeout": "900", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_connection_ready_timeout": "10", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_crc_data": "true", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_crc_header": "true", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_die_on_bad_msg": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_die_on_bug": "true", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_die_on_old_message": "true", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_die_on_skipped_message": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_coremask": "0xF", 2026-02-24T08:20:34.448 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_enable_tso": "true", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_hugepages": "", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_lro": "true", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_memory_channel": "4", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_pmd": "", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_port_id": "0", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_dump_on_send": "false", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_initial_backoff": "0.200000", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_inject_delay_max": "1.000000", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_inject_delay_type": "", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_inject_network_congestion": "0", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_inject_socket_failures": "0", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_learn_addr_from_peer": "true", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_max_accept_failures": "4", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_max_backoff": "15.000000", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_mon_client_mode": "crc", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_mon_cluster_mode": "crc", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_mon_service_mode": "crc", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_osd_compress_min_size": "1024", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_osd_compress_mode": "none", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-24T08:20:34.449 INFO:teuthology.orchestra.run.trial105.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "ms_pq_min_cost": "65536", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "ms_public_type": "", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "ms_service_mode": "crc", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "ms_tcp_listen_backlog": "512", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "ms_tcp_nodelay": "true", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "ms_tcp_rcvbuf": "0", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "ms_type": "async+posix", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "no_config_file": "false", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objecter_completion_locks_per_session": "32", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objecter_inflight_ops": "1024", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objecter_tick_interval": "5.000000", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objecter_timeout": "10.000000", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objectstore_blackhole": "false", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "openssl_conf": "", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "osd_agent_delay_time": "5.000000", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "osd_agent_hist_halflife": "1000", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "osd_agent_max_low_ops": "2", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "osd_agent_max_ops": "4", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-24T08:20:34.450 INFO:teuthology.orchestra.run.trial105.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_agent_slop": "0.020000", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_asio_thread_count": "2", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_async_recovery_min_cost": "100", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_backfill_scan_max": "512", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_backfill_scan_min": "64", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_backoff_on_degraded": "false", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_backoff_on_peering": "false", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_backoff_on_unfound": "true", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_beacon_report_interval": "300", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_bench_duration": "30", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_bench_max_block_size": "67108864", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_blkin_trace_all": "false", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_check_for_log_corruption": "false", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_class_update_on_start": "true", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_client_message_cap": "256", 2026-02-24T08:20:34.451 INFO:teuthology.orchestra.run.trial105.stdout: "osd_client_message_size_cap": "524288000", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_client_op_priority": "63", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_client_watch_timeout": "30", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_command_max_records": "256", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_compact_on_start": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_crush_chooseleaf_type": "1", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_crush_update_on_start": "true", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_crush_update_weight_set": "true", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_feed_pullee": "-1", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_misdirected_ops": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_no_acting_change": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_no_purge_strays": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_op_order": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_pg_log_writeout": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_shutdown": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_trim_objects": "false", 2026-02-24T08:20:34.452 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_verify_snaps": "false", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_debug_verify_stray_on_activate": "false", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_deep_scrub_keys": "1024", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_default_data_pool_replay_window": "45", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_default_notify_timeout": "30", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_delete_sleep": "0.000000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_discard_disconnected_ops": "true", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_ec_partial_reads": "true", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_enable_op_tracker": "true", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_fast_info": "true", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_fast_shutdown": "true", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_function_tracing": "false", 2026-02-24T08:20:34.453 INFO:teuthology.orchestra.run.trial105.stdout: "osd_heartbeat_grace": "20", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_heartbeat_interval": "6", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_heartbeat_min_peers": "10", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_heartbeat_min_size": "2000", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_heartbeat_stale": "600", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_hit_set_max_size": "100000", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_hit_set_min_size": "1000", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_journal_size": "5120", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_kill_backfill_at": "0", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_map_cache_size": "50", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_map_dedup": "true", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_map_message_max": "40", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_map_share_max_epochs": "40", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_attr_name_len": "100", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_attr_size": "0", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_backfills": "1", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_markdown_count": "5", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_markdown_period": "600", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_object_name_len": "2048", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_object_namespace_len": "256", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_object_size": "134217728", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_pg_blocked_by": "16", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_pg_log_entries": "10000", 2026-02-24T08:20:34.454 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_pgls": "1024", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_push_cost": "8388608", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_push_objects": "10", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_scrubs": "3", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_trimming_pgs": "2", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_write_op_reply_len": "64", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_max_write_size": "90", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_profile": "balanced", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-24T08:20:34.455 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mclock_skip_benchmark": "false", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_memory_base": "805306368", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_memory_cache_min": "134217728", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_memory_target": "4294967296", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_memory_target_autotune": "false", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_min_pg_log_entries": "250", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_min_recovery_priority": "0", 2026-02-24T08:20:34.456 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mon_report_interval": "5", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_num_cache_shards": "32", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_num_op_tracker_shard": "32", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_numa_auto_affinity": "true", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_numa_node": "-1", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_numa_prefer_iface": "true", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_objecter_finishers": "1", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_objectstore": "bluestore", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_objectstore_fuse": "false", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_objectstore_tracing": "false", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_complaint_time": "30.000000", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_history_duration": "600", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_history_size": "20", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_history_slow_op_size": "20", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_log_threshold": "5", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_num_shards": "0", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_num_shards_hdd": "1", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_num_shards_ssd": "8", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_pq_min_cost": "65536", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_queue_cut_off": "high", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_op_thread_timeout": "15", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_open_classes_on_start": "true", 2026-02-24T08:20:34.457 INFO:teuthology.orchestra.run.trial105.stdout: "osd_os_flags": "0", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_peering_op_priority": "255", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_delete_cost": "1048576", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_delete_priority": "5", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_log_trim_max": "10000", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_log_trim_min": "100", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_crimson": "true", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_flags": "0", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_min_size": "2", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_pg_num": "32", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_pgp_num": "0", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-24T08:20:34.458 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_read_ratio": "70", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_size": "3", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_default_type": "replicated", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_push_per_object_cost": "1000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recover_clone_overlap": "true", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_cost": "20971520", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_max_active": "0", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_max_chunk": "8388608", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_max_single_start": "1", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_op_priority": "3", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_priority": "5", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_sleep": "0.000000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_requested_scrub_priority": "5", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_auto_repair": "false", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_begin_hour": "0", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_begin_week_day": "0", 2026-02-24T08:20:34.459 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_chunk_max": "15", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_chunk_min": "5", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_cost": "52428800", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_during_recovery": "false", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_end_hour": "0", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_end_week_day": "0", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_event_cost": "4096", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_invalid_stats": "true", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_load_threshold": "10.000000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_max_interval": "604800.000000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_max_preemptions": "5", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_priority": "5", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_retry_delay": "30", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_retry_trimming": "10", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_scrub_sleep": "0.000000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_skip_data_digest": "false", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_smart_report_timeout": "5", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_snap_trim_cost": "1048576", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_snap_trim_priority": "5", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_target_transaction_size": "30", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-24T08:20:34.460 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_tracing": "false", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_use_stale_snap": "false", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "osdc_blkin_trace_all": "false", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_kill_at": "0", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_max_join_drift": "10", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_min": "500", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_min_wait": "0.050000", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_propose_interval": "1.000000", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_service_trim_max": "500", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_service_trim_min": "10", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_stash_full_interval": "25", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_trim_max": "500", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "paxos_trim_min": "250", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "perf": "true", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "pid_file": "", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "pool_availability_update_interval": "1.000000", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "public_addr": "-", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "public_addrv": "", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "public_bind_addr": "-", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "public_network": "", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "public_network_interface": "", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "qat_compressor_busy_polling": "false", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "qat_compressor_enabled": "false", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "qat_compressor_session_max_number": "256", 2026-02-24T08:20:34.461 INFO:teuthology.orchestra.run.trial105.stdout: "rados_mon_op_timeout": "0", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rados_osd_op_timeout": "0", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rados_replica_read_policy": "default", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rados_tracing": "false", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_atime_update_interval": "60", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_balance_parent_reads": "false", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_balance_snap_reads": "false", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_blkin_trace_all": "false", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_cache": "true", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_cache_policy": "writearound", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_cache_size": "33554432", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_clone_copy_on_read": "false", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_compression_hint": "none", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_concurrent_management_ops": "10", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_clone_format": "auto", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_data_pool": "", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_features": "61", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_format": "2", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_map_options": "", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_order": "22", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_pool": "rbd", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_stripe_count": "0", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_default_stripe_unit": "0", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-24T08:20:34.462 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_enable_alloc_hint": "true", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_io_scheduler": "simple", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_order": "24", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_pool": "", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_journal_splay_width": "4", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_localize_parent_reads": "false", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_localize_snap_reads": "false", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-24T08:20:34.463 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_mtime_update_interval": "60", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_non_blocking_aio": "true", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_op_thread_timeout": "60", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_op_threads": "1", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_parent_cache_enabled": "false", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_plugins": "", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_bps_burst": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_bps_limit": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_exclude_ops": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_iops_burst": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_iops_limit": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_read_from_replica_policy": "default", 2026-02-24T08:20:34.464 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_skip_partial_discard": "true", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_tracing": "false", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_validate_names": "true", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rbd_validate_pool": "true", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "restapi_base_url": "", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "restapi_log_level": "", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_acl_grants_max_num": "100", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_admin_entry": "admin", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_asio_assert_yielding": "false", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_backend_store": "rados", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_barbican_url": "", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_beast_enable_async": "true", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_counters_cache": "false", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_eexist_override": "false", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_cache_enabled": "true", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_cache_expiry_interval": "900", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_cache_lru_size": "25000", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_config_store": "rados", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_content_length_compat": "false", 2026-02-24T08:20:34.465 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_copy_obj_progress": "true", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_cors_rules_max_num": "100", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_cross_domain_policy": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_kmip_addr": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_kmip_password": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_kmip_username": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_require_ssl": "true", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_addr": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_auth": "token", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_namespace": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_prefix": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_token_file": "", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_curl_buffersize": "524288", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_curl_low_speed_time": "300", 2026-02-24T08:20:34.466 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_data_log_changes_size": "1000", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_data_log_num_shards": "128", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_data_log_window": "30", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_disable_s3select": "false", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-24T08:20:34.467 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dns_name": "", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dns_s3website_name": "", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dynamic_resharding": "true", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_gc_threads": "true", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_lc_threads": "true", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_mdsearch": "true", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_ops_log": "false", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_quota_threads": "true", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_restore_threads": "true", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_static_website": "false", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enable_usage_log": "false", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_enforce_swift_acls": "true", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_exit_timeout_secs": "120", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_expose_bucket": "false", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_extended_http_attrs": "", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_filter": "none", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_frontends": "beast port=7480", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_gc_max_deferred": "50", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_gc_max_objs": "32", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_gc_processor_period": "3600", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-24T08:20:34.468 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_graceful_stop": "false", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_init_timeout": "300", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_kafka_connection_idle": "300", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_admin_domain": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_admin_password": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_admin_password_path": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_admin_project": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_admin_tenant": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_admin_user": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_barbican_domain": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_barbican_password": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_barbican_project": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_barbican_user": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_url": "", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lc_debug_interval": "-1", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lc_list_cnt": "1000", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lc_lock_max_time": "90", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lc_max_objs": "32", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lc_max_rules": "1000", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lc_max_worker": "3", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lc_thread_delay": "0", 2026-02-24T08:20:34.469 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ldap_dnattr": "uid", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ldap_searchfilter": "", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ldap_uri": "", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_log_http_headers": "", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_log_object_name_utc": "false", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lua_enable": "true", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_attr_name_len": "0", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_attr_size": "0", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_chunk_size": "4194304", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_control_aio": "8", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_listing_results": "5000", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_notify_retries": "10", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_put_param_size": "1048576", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_put_size": "5368709120", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_max_slo_entries": "1000", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_md_log_max_shards": "64", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_mp_lock_max_time": "600", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-24T08:20:34.470 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_max_gc": "300", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_num_async_rados_threads": "32", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_num_control_oids": "8", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_numa_node": "-1", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_objexp_chunk_size": "100", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_objexp_gc_interval": "600", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_op_thread_timeout": "600", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_op_tracing": "false", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_opa_token": "", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_opa_url": "", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_opa_verify_ssl": "true", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ops_log_rados": "false", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ops_log_socket_path": "", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_period_push_interval": "2.000000", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_posix_cache_lanes": "3", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_posix_cache_partitions": "3", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-24T08:20:34.471 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_print_continue": "true", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_rados_tracing": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_ratelimit_interval": "60", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_realm": "", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_realm_id": "", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_region": "", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_request_uri": "", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_reshard_batch_size": "64", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_reshard_max_aio": "128", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_reshard_num_logs": "16", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_reshard_thread_interval": "600", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_resolve_cname": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_restore_debug_interval": "-1", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_restore_lock_max_time": "90", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_restore_max_objs": "32", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_restore_processor_period": "900", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_run_sync_thread": "true", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_scheduler_type": "throttler", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_script_uri": "", 2026-02-24T08:20:34.472 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_service_provider_name": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sts_client_id": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sts_client_secret": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sts_entry": "sts", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sts_key": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sts_min_session_duration": "900", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sts_token_introspection_url": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_account_in_url": "false", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_auth_entry": "auth", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_auth_url": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_custom_header": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_need_stats": "true", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_tenant_name": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_token_expiration": "86400", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_url": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_url_prefix": "swift", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_lease_period": "120", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_thread_pool_size": "512", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_torrent_comment": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_torrent_createby": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_torrent_encoding": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_torrent_flag": "false", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_torrent_origin": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_torrent_tracker": "", 2026-02-24T08:20:34.473 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_trust_forwarded_https": "false", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_usage_log_key_transition": "true", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_usage_max_shards": "32", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_usage_max_user_shards": "1", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_use_opa_authz": "false", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_counters_cache": "false", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_max_buckets": "1000", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_policies_max_num": "100", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_user_unique_email": "true", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_verify_ssl": "true", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_zone": "", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_zone_id": "", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_zonegroup": "", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_zonegroup_id": "", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgwlc_auto_session_clear": "true", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_block_size": "4096", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_cache_size": "536870912", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_index_type": "binary_search", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-24T08:20:34.474 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_partition_filters": "false", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_perf": "false", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "run_dir": "/var/run/ceph", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_block_create": "true", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_cachepin_size_pershard": "2147483648", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_cachepin_type": "LRU", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_cold_tier_generations": "3", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_default_max_object_size": "16777216", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_device_size": "53687091200", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_full_integrity_check": "false", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_hot_tier_generations": "5", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_journal_batch_capacity": "16", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_main_device_type": "SSD", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_max_concurrent_transactions": "128", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_max_data_allocation_size": "0", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "seastore_segment_size": "67108864", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "service_unique_id": "", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "set_keepcaps": "false", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "setgroup": "ceph", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "setuser": "ceph", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "setuser_match_path": "", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "subv_metrics_window_interval": "30", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "thp": "false", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "threadpool_default_timeout": "60", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "throttler_perf_counter": "true", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "tmp_dir": "/tmp", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2026-02-24T08:20:34.475 INFO:teuthology.orchestra.run.trial105.stdout: "uadk_compressor_enabled": "false", 2026-02-24T08:20:34.476 INFO:teuthology.orchestra.run.trial105.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-24T08:20:34.476 INFO:teuthology.orchestra.run.trial105.stdout:} 2026-02-24T08:20:34.476 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2026-02-24T08:20:34.592 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:34.691 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:34.688+0000 7fa3cd887640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:34.691 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:34.689+0000 7fa3cd887640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:34.697 INFO:teuthology.orchestra.run.trial105.stdout:{} 2026-02-24T08:20:34.698 INFO:teuthology.orchestra.run.trial105.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-24T08:20:34.733 INFO:teuthology.run_tasks:Running task full_sequential... 2026-02-24T08:20:34.749 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T08:20:34.753 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T08:20:34.754 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-24T08:20:34.754 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool create unique_pool_0 16 2026-02-24T08:20:34.754 INFO:tasks.thrashosds.thrasher:starting do_thrash 2026-02-24T08:20:34.755 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:20:34.755 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:20:34.755 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2026-02-24T08:20:34.755 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:20:34.870 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:34.871 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:34.892 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: Reconfiguring prometheus.a deps ['8765', 'alertmanager_configured:False', 'ceph-exporter_configured:False', 'ingress_configured:False', 'mgmt-gateway_configured:False', 'mgr.x', 'nfs_configured:False', 'node-exporter_configured:False', 'nvmeof_configured:False', 'oauth2-proxy_configured:False', 'secure_monitoring_stack:False', 'smb_configured:False'] -> ['8765', 'alertmanager_configured:False', 'ceph-exporter_configured:False', 'ingress_configured:False', 'mgmt-gateway_configured:False', 'mgr.x', 'nfs_configured:False', 'node-exporter_configured:True', 'nvmeof_configured:False', 'oauth2-proxy_configured:False', 'secure_monitoring_stack:False', 'smb_configured:False'] (diff {'node-exporter_configured:False', 'node-exporter_configured:True'}) 2026-02-24T08:20:34.892 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: Reconfiguring daemon prometheus.a on trial165 2026-02-24T08:20:34.892 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-24T08:20:34.892 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='client.14321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:20:34.892 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='client.14323 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:20:34.892 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://trial165:9095"} : dispatch 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial165:9095"}]: dispatch 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-24T08:20:34.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:20:34.894 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3179648396' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-24T08:20:34.894 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:34.894 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:34.894 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:20:34.894 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:20:34.894 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:20:34.894 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:20:34.894 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2020170383' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T08:20:34.971 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:34.969+0000 7f86a8931640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:34.971 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:34.969+0000 7f86a8931640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:34.973 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:34.971+0000 7f7092b7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:34.973 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:34.971+0000 7f7092b7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:34.984 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:34.984 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:34.995 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:34.995 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:35.007 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:35.008 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:35.018 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:35.018 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:35.857 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_0' created 2026-02-24T08:20:35.915 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-24T08:20:36.029 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:36.137 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:36.135+0000 7fdb4fe89640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:36.137 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:36.135+0000 7fdb4fe89640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:36.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:35 trial105 ceph-mon[39442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-24T08:20:36.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:35 trial105 ceph-mon[39442]: Certificate for "cephadm-signed_agent_cert (trial105)" is still valid for 1824 days. 2026-02-24T08:20:36.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:35 trial105 ceph-mon[39442]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:20:36.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/841051088' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:36.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1083617895' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} : dispatch 2026-02-24T08:20:36.857 INFO:teuthology.orchestra.run.trial105.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-24T08:20:37.055 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:20:37.174 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:37.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:36 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1083617895' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2026-02-24T08:20:37.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:36 trial105 ceph-mon[39442]: osdmap e27: 4 total, 4 up, 4 in 2026-02-24T08:20:37.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:36 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/564050553' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:20:37.273 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:37.271+0000 7f3436cb9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:37.274 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:37.272+0000 7f3436cb9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:37.286 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:37.286 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:37.296 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:37.296 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:37.308 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:37.308 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:37.320 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:37.320 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:37.902 DEBUG:teuthology.orchestra.run.trial105:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_0 bench 90 write' 2026-02-24T08:20:37.902 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T08:20:37.903 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:20:37.908 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T08:20:37.908 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T08:20:37.956 INFO:tasks.radosbench.radosbench.0.trial105.stdout:hints = 1 2026-02-24T08:20:37.956 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T08:20:37.956 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object prefix: benchmark_data_trial105_81672 2026-02-24T08:20:37.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:20:37.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 0 0 0 0 0 0 - 0 2026-02-24T08:20:38.039 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:38.156 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:37 trial105 ceph-mon[39442]: pgmap v8: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2026-02-24T08:20:38.156 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/564050553' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:20:38.156 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:37 trial105 ceph-mon[39442]: osdmap e28: 4 total, 4 up, 4 in 2026-02-24T08:20:38.156 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3272077106' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:38.163 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:38.161+0000 7f07d5ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:38.163 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:38.161+0000 7f07d5ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:38.301 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:38.301 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:20:38.343 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2026-02-24T08:20:37.861401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110460,"kb_used_data":2604,"kb_used_omap":41,"kb_used_meta":107734,"kb_avail":2935902340,"statfs":{"total":3006477107200,"available":3006363996160,"internally_reserved":0,"allocated":2666496,"data_stored":2075888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42927,"internal_metadata":110319697},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":176,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.174027"},"pg_stats":[{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-24T08:20:30.892858+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:20:30.892858+0000","last_peered":"2026-02-24T08:20:30.892858+0000","last_clean":"2026-02-24T08:20:30.892858+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:20:30.892858+0000","last_undegraded":"2026-02-24T08:20:30.892858+0000","last_fullsized":"2026-02-24T08:20:30.892858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:20:35.854055+0000","last_change":"2026-02-24T08:20:35.854055+0000","last_active":"2026-02-24T08:20:35.854055+0000","last_peered":"2026-02-24T08:20:35.854055+0000","last_clean":"2026-02-24T08:20:35.854055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:20:35.854055+0000","last_undegraded":"2026-02-24T08:20:35.854055+0000","last_fullsized":"2026-02-24T08:20:35.854055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247813,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6166,"internal_metadata":27584490},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27180,"kb_used_data":216,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733976020,"statfs":{"total":751619276800,"available":751591444480,"internally_reserved":0,"allocated":221184,"data_stored":76196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":27578615},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":14,"kb_used_meta":26929,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":666564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":27576011},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:20:38.345 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:20:38.345 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 26 2026-02-24T08:20:38.480 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:38.604 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:38.602+0000 7fa5c012b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:38.604 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:38.602+0000 7fa5c012b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:38.749 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:20:38.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:20:38.956 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 1 128 8837 8709 68.0335 68.0391 0.0101301 0.0145565 2026-02-24T08:20:39.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:38 trial105 ceph-mon[39442]: osdmap e29: 4 total, 4 up, 4 in 2026-02-24T08:20:39.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:38 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/537261526' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T08:20:39.354 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:20:39.492 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:39.619 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:39.616+0000 7f9969dea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:39.619 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:39.617+0000 7f9969dea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:39.634 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:39.634 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:39.634 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:20:39] "GET /metrics HTTP/1.1" 200 3625 "" "Prometheus/3.6.0" 2026-02-24T08:20:39.661 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:39.661 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:39.674 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:39.674 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:39.689 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:39.689 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:39.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:20:39.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:39 trial105 ceph-mon[39442]: from='client.14342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:20:39.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:39 trial105 ceph-mon[39442]: pgmap v11: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 29 KiB/s rd, 0 B/s wr, 11 op/s 2026-02-24T08:20:39.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:39 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2823173089' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:39.956 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 2 127 17863 17736 69.2759 70.5234 0.00820377 0.0143829 2026-02-24T08:20:40.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 3 128 26898 26770 69.7082 70.5781 0.0235999 0.0142859 2026-02-24T08:20:41.732 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:20:41.873 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:41.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 4 128 35039 34911 68.1804 63.6016 0.0240686 0.0146292 2026-02-24T08:20:42.002 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:42.000+0000 7fd4db6b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:42.002 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:42.000+0000 7fd4db6b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:42.017 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:42.018 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:42.018 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:41 trial105 ceph-mon[39442]: pgmap v12: 17 pgs: 17 active+clean; 121 MiB data, 364 MiB used, 2.7 TiB / 2.7 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 2.57k op/s 2026-02-24T08:20:42.031 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:42.032 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:42.045 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:42.045 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:42.058 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:42.058 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:42.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 5 128 43534 43406 67.8125 66.3672 0.0124719 0.0147174 2026-02-24T08:20:43.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:42 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1634877628' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:43.786 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:20:43.786 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:20:43.940 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:43.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 6 128 51491 51363 66.8704 62.1641 0.0107794 0.014926 2026-02-24T08:20:44.064 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:44.062+0000 7f3f082aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:44.065 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:43 trial105 ceph-mon[39442]: pgmap v13: 17 pgs: 17 active+clean; 121 MiB data, 364 MiB used, 2.7 TiB / 2.7 TiB avail; 18 MiB/s wr, 2.25k op/s 2026-02-24T08:20:44.065 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:44.062+0000 7f3f082aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:44.103 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:20:44.250 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:44.379 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:44.377+0000 7f8107d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:44.379 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:44.378+0000 7f8107d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:44.396 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:44.396 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:44.415 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:44.416 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:44.430 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:44.430 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:44.445 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:44.445 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:44.874 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:20:44.923 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:20:44.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 7 128 59190 59062 65.9095 60.1484 0.00925474 0.0151328 2026-02-24T08:20:45.062 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:45.128 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:20:45.129 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/211535572' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:20:45.129 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2882401989' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:45.227 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:45.225+0000 7f1fba162640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:45.227 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:45.225+0000 7f1fba162640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:45.874 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:20:45.926 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:20:45.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 8 128 66938 66810 65.2366 60.5312 0.00910284 0.0153027 2026-02-24T08:20:46.108 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:46.131 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:45 trial105 ceph-mon[39442]: pgmap v14: 17 pgs: 17 active+clean; 121 MiB data, 364 MiB used, 2.7 TiB / 2.7 TiB avail; 15 MiB/s wr, 1.92k op/s 2026-02-24T08:20:46.131 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/211535572' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:20:46.131 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:45 trial105 ceph-mon[39442]: osdmap e30: 4 total, 4 up, 4 in 2026-02-24T08:20:46.132 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1572816958' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:20:46.230 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:46.226+0000 7fc985962640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:46.230 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:46.227+0000 7fc985962640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:46.490 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:20:46.644 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:46.781 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:46.777+0000 7f1a00ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:46.781 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:46.777+0000 7f1a00ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:46.796 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:46.797 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:46.811 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:46.811 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:46.824 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:46.824 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:46.839 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:46.839 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:46.881 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:20:46.926 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:20:46.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 9 127 74064 73937 64.1743 55.6797 0.0119688 0.0155583 2026-02-24T08:20:46.983 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1572816958' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:20:46.984 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:46 trial105 ceph-mon[39442]: osdmap e31: 4 total, 4 up, 4 in 2026-02-24T08:20:46.984 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3016127008' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:20:46.984 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:46 trial105 ceph-mon[39442]: pgmap v17: 17 pgs: 17 active+clean; 446 MiB data, 1.5 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.13k op/s 2026-02-24T08:20:46.984 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/736196446' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:47.114 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:47.240 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:47.237+0000 7fbaa15ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:47.240 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:47.237+0000 7fbaa15ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:47.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 10 127 80732 80605 62.9659 52.0938 0.00653765 0.0158544 2026-02-24T08:20:48.014 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:20:48.061 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:20:48.061 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:20:48.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:47 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3016127008' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:20:48.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:47 trial105 ceph-mon[39442]: osdmap e32: 4 total, 4 up, 4 in 2026-02-24T08:20:48.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:47 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1222260412' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:20:48.256 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:48.390 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:48.387+0000 7fcb5f530640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:48.390 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:48.387+0000 7fcb5f530640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:48.555 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:48.556 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:20:48.603 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-24T08:20:48.013919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":467673632,"num_objects":7132,"num_object_clones":0,"num_object_copies":21396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7132,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":57152,"num_write_kb":458286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57116,"ondisk_log_size":57116,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":1587892,"kb_used_data":1317604,"kb_used_omap":49,"kb_used_meta":270158,"kb_avail":2934424908,"statfs":{"total":3006477107200,"available":3004851105792,"internally_reserved":0,"allocated":1349226496,"data_stored":1348545532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50756,"internal_metadata":276642236},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[22,13,6,2,18,17],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":341303296,"num_objects":5209,"num_object_clones":0,"num_object_copies":15627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41663,"num_write_kb":333304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.325132"},"pg_stats":[{"pgid":"2.f","version":"29'3488","reported_seq":3502,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.648787+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:20:44.648787+0000","last_peered":"2026-02-24T08:20:44.648787+0000","last_clean":"2026-02-24T08:20:44.648787+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:20:44.648787+0000","last_undegraded":"2026-02-24T08:20:44.648787+0000","last_fullsized":"2026-02-24T08:20:44.648787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3488,"log_dups_size":0,"ondisk_log_size":3488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28573696,"num_objects":436,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3488,"num_write_kb":27904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"29'3504","reported_seq":3518,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.681397+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:20:44.681397+0000","last_peered":"2026-02-24T08:20:44.681397+0000","last_clean":"2026-02-24T08:20:44.681397+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:20:44.681397+0000","last_undegraded":"2026-02-24T08:20:44.681397+0000","last_fullsized":"2026-02-24T08:20:44.681397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704768,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3504,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"29'3667","reported_seq":3671,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.694206+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:20:44.694206+0000","last_peered":"2026-02-24T08:20:44.694206+0000","last_clean":"2026-02-24T08:20:44.694206+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:20:44.694206+0000","last_undegraded":"2026-02-24T08:20:44.694206+0000","last_fullsized":"2026-02-24T08:20:44.694206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3667,"log_dups_size":0,"ondisk_log_size":3667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30040064,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3667,"num_write_kb":29336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"29'3456","reported_seq":3470,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.688733+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:20:44.688733+0000","last_peered":"2026-02-24T08:20:44.688733+0000","last_clean":"2026-02-24T08:20:44.688733+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:20:44.688733+0000","last_undegraded":"2026-02-24T08:20:44.688733+0000","last_fullsized":"2026-02-24T08:20:44.688733+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3456,"log_dups_size":0,"ondisk_log_size":3456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3456,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:37.862590+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:20:37.862590+0000","last_peered":"2026-02-24T08:20:37.862590+0000","last_clean":"2026-02-24T08:20:37.862590+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:20:37.862590+0000","last_undegraded":"2026-02-24T08:20:37.862590+0000","last_fullsized":"2026-02-24T08:20:37.862590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3624","reported_seq":3638,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.686169+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:20:44.686169+0000","last_peered":"2026-02-24T08:20:44.686169+0000","last_clean":"2026-02-24T08:20:44.686169+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:20:44.686169+0000","last_undegraded":"2026-02-24T08:20:44.686169+0000","last_fullsized":"2026-02-24T08:20:44.686169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3624,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"29'3416","reported_seq":3430,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.672539+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:20:44.672539+0000","last_peered":"2026-02-24T08:20:44.672539+0000","last_clean":"2026-02-24T08:20:44.672539+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:20:44.672539+0000","last_undegraded":"2026-02-24T08:20:44.672539+0000","last_fullsized":"2026-02-24T08:20:44.672539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3416,"log_dups_size":0,"ondisk_log_size":3416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3416,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"29'3368","reported_seq":3382,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.677668+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:20:44.677668+0000","last_peered":"2026-02-24T08:20:44.677668+0000","last_clean":"2026-02-24T08:20:44.677668+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:20:44.677668+0000","last_undegraded":"2026-02-24T08:20:44.677668+0000","last_fullsized":"2026-02-24T08:20:44.677668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3368,"log_dups_size":0,"ondisk_log_size":3368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3368,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"29'3552","reported_seq":3564,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.685319+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:20:44.685319+0000","last_peered":"2026-02-24T08:20:44.685319+0000","last_clean":"2026-02-24T08:20:44.685319+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:20:44.685319+0000","last_undegraded":"2026-02-24T08:20:44.685319+0000","last_fullsized":"2026-02-24T08:20:44.685319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29097984,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3552,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"29'3633","reported_seq":3645,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.687500+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:20:44.687500+0000","last_peered":"2026-02-24T08:20:44.687500+0000","last_clean":"2026-02-24T08:20:44.687500+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:20:44.687500+0000","last_undegraded":"2026-02-24T08:20:44.687500+0000","last_fullsized":"2026-02-24T08:20:44.687500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29761536,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3633,"num_write_kb":29064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3760","reported_seq":3774,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.660696+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:20:44.660696+0000","last_peered":"2026-02-24T08:20:44.660696+0000","last_clean":"2026-02-24T08:20:44.660696+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:20:44.660696+0000","last_undegraded":"2026-02-24T08:20:44.660696+0000","last_fullsized":"2026-02-24T08:20:44.660696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3760,"log_dups_size":0,"ondisk_log_size":3760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3760,"num_write_kb":30080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3824","reported_seq":3837,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.691963+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:20:44.691963+0000","last_peered":"2026-02-24T08:20:44.691963+0000","last_clean":"2026-02-24T08:20:44.691963+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:20:44.691963+0000","last_undegraded":"2026-02-24T08:20:44.691963+0000","last_fullsized":"2026-02-24T08:20:44.691963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3824,"log_dups_size":0,"ondisk_log_size":3824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3824,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"29'3592","reported_seq":3602,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.683053+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:20:44.683053+0000","last_peered":"2026-02-24T08:20:44.683053+0000","last_clean":"2026-02-24T08:20:44.683053+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:20:44.683053+0000","last_undegraded":"2026-02-24T08:20:44.683053+0000","last_fullsized":"2026-02-24T08:20:44.683053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29425664,"num_objects":449,"num_object_clones":0,"num_object_copies":1347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3592,"num_write_kb":28736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3571","reported_seq":3584,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.690202+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:20:44.690202+0000","last_peered":"2026-02-24T08:20:44.690202+0000","last_clean":"2026-02-24T08:20:44.690202+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:20:44.690202+0000","last_undegraded":"2026-02-24T08:20:44.690202+0000","last_fullsized":"2026-02-24T08:20:44.690202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3571,"log_dups_size":0,"ondisk_log_size":3571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29253632,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3571,"num_write_kb":28568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3560","reported_seq":3574,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.692172+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:20:44.692172+0000","last_peered":"2026-02-24T08:20:44.692172+0000","last_clean":"2026-02-24T08:20:44.692172+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:20:44.692172+0000","last_undegraded":"2026-02-24T08:20:44.692172+0000","last_fullsized":"2026-02-24T08:20:44.692172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3560,"num_write_kb":28480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"29'3346","reported_seq":3349,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.691283+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:20:44.691283+0000","last_peered":"2026-02-24T08:20:44.691283+0000","last_clean":"2026-02-24T08:20:44.691283+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:20:44.691283+0000","last_undegraded":"2026-02-24T08:20:44.691283+0000","last_fullsized":"2026-02-24T08:20:44.691283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27410432,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3346,"num_write_kb":26768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"29'3656","reported_seq":3670,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.686024+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:20:44.686024+0000","last_peered":"2026-02-24T08:20:44.686024+0000","last_clean":"2026-02-24T08:20:44.686024+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:20:44.686024+0000","last_undegraded":"2026-02-24T08:20:44.686024+0000","last_fullsized":"2026-02-24T08:20:44.686024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3656,"log_dups_size":0,"ondisk_log_size":3656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3656,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":467083264,"num_objects":7130,"num_object_clones":0,"num_object_copies":21390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57017,"num_write_kb":456136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1401372672,"data_stored":1401372672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57017,"ondisk_log_size":57017,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247815,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":473012,"kb_used_data":391904,"kb_used_omap":7,"kb_used_meta":81080,"kb_avail":733530188,"statfs":{"total":751619276800,"available":751134912512,"internally_reserved":0,"allocated":401309696,"data_stored":401138567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":83025989},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":357948,"kb_used_data":294888,"kb_used_omap":11,"kb_used_meta":63028,"kb_avail":733645252,"statfs":{"total":751619276800,"available":751252738048,"internally_reserved":0,"allocated":301965312,"data_stored":301794183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":64540919},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":381080,"kb_used_data":318020,"kb_used_omap":13,"kb_used_meta":63026,"kb_avail":733622120,"statfs":{"total":751619276800,"available":751229050880,"internally_reserved":0,"allocated":325652480,"data_stored":325484903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":64538966},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[21,13,6,2,18,17],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":375852,"kb_used_data":312792,"kb_used_omap":16,"kb_used_meta":63023,"kb_avail":733627348,"statfs":{"total":751619276800,"available":751234404352,"internally_reserved":0,"allocated":320299008,"data_stored":320127879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":64536362},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":320110592,"data_stored":320110592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":348610560,"data_stored":348610560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":324018176,"data_stored":324018176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":408633344,"data_stored":408633344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:20:48.606 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:20:48.759 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:48.885 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:48.882+0000 7fd38aa0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:48.885 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:48.882+0000 7fd38aa0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:48.900 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:20:48.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 11 128 87312 87184 61.914 51.3984 0.033093 0.0161142 2026-02-24T08:20:49.045 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:49.046 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:20:49.062 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:49.067 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1222260412' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:20:49.068 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:49 trial105 ceph-mon[39442]: osdmap e33: 4 total, 4 up, 4 in 2026-02-24T08:20:49.068 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:49 trial105 ceph-mon[39442]: from='client.14362 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:20:49.068 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:49 trial105 ceph-mon[39442]: pgmap v20: 17 pgs: 17 active+clean; 446 MiB data, 1.5 GiB used, 2.7 TiB / 2.7 TiB avail; 81 MiB/s wr, 10.41k op/s 2026-02-24T08:20:49.100 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-24T08:20:48.689430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":467673632,"num_objects":7132,"num_object_clones":0,"num_object_copies":21396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7132,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":57152,"num_write_kb":458286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57116,"ondisk_log_size":57116,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":1587892,"kb_used_data":1317604,"kb_used_omap":49,"kb_used_meta":270158,"kb_avail":2934424908,"statfs":{"total":3006477107200,"available":3004851105792,"internally_reserved":0,"allocated":1349226496,"data_stored":1348545532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50756,"internal_metadata":276642236},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[22,13,6,2,18,17],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":341303296,"num_objects":5209,"num_object_clones":0,"num_object_copies":15627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41663,"num_write_kb":333304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000422"},"pg_stats":[{"pgid":"2.f","version":"29'3488","reported_seq":3502,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.648787+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:20:44.648787+0000","last_peered":"2026-02-24T08:20:44.648787+0000","last_clean":"2026-02-24T08:20:44.648787+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:20:44.648787+0000","last_undegraded":"2026-02-24T08:20:44.648787+0000","last_fullsized":"2026-02-24T08:20:44.648787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3488,"log_dups_size":0,"ondisk_log_size":3488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28573696,"num_objects":436,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3488,"num_write_kb":27904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"29'3504","reported_seq":3518,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.681397+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:20:44.681397+0000","last_peered":"2026-02-24T08:20:44.681397+0000","last_clean":"2026-02-24T08:20:44.681397+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:20:44.681397+0000","last_undegraded":"2026-02-24T08:20:44.681397+0000","last_fullsized":"2026-02-24T08:20:44.681397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704768,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3504,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"29'3667","reported_seq":3671,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.694206+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:20:44.694206+0000","last_peered":"2026-02-24T08:20:44.694206+0000","last_clean":"2026-02-24T08:20:44.694206+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:20:44.694206+0000","last_undegraded":"2026-02-24T08:20:44.694206+0000","last_fullsized":"2026-02-24T08:20:44.694206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3667,"log_dups_size":0,"ondisk_log_size":3667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30040064,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3667,"num_write_kb":29336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"29'3456","reported_seq":3470,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.688733+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:20:44.688733+0000","last_peered":"2026-02-24T08:20:44.688733+0000","last_clean":"2026-02-24T08:20:44.688733+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:20:44.688733+0000","last_undegraded":"2026-02-24T08:20:44.688733+0000","last_fullsized":"2026-02-24T08:20:44.688733+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3456,"log_dups_size":0,"ondisk_log_size":3456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3456,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:37.862590+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:20:37.862590+0000","last_peered":"2026-02-24T08:20:37.862590+0000","last_clean":"2026-02-24T08:20:37.862590+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:20:37.862590+0000","last_undegraded":"2026-02-24T08:20:37.862590+0000","last_fullsized":"2026-02-24T08:20:37.862590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3624","reported_seq":3638,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.686169+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:20:44.686169+0000","last_peered":"2026-02-24T08:20:44.686169+0000","last_clean":"2026-02-24T08:20:44.686169+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:20:44.686169+0000","last_undegraded":"2026-02-24T08:20:44.686169+0000","last_fullsized":"2026-02-24T08:20:44.686169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3624,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"29'3416","reported_seq":3430,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.672539+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:20:44.672539+0000","last_peered":"2026-02-24T08:20:44.672539+0000","last_clean":"2026-02-24T08:20:44.672539+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:20:44.672539+0000","last_undegraded":"2026-02-24T08:20:44.672539+0000","last_fullsized":"2026-02-24T08:20:44.672539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3416,"log_dups_size":0,"ondisk_log_size":3416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3416,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"29'3368","reported_seq":3382,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.677668+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:20:44.677668+0000","last_peered":"2026-02-24T08:20:44.677668+0000","last_clean":"2026-02-24T08:20:44.677668+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:20:44.677668+0000","last_undegraded":"2026-02-24T08:20:44.677668+0000","last_fullsized":"2026-02-24T08:20:44.677668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3368,"log_dups_size":0,"ondisk_log_size":3368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3368,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"29'3552","reported_seq":3564,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.685319+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:20:44.685319+0000","last_peered":"2026-02-24T08:20:44.685319+0000","last_clean":"2026-02-24T08:20:44.685319+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:20:44.685319+0000","last_undegraded":"2026-02-24T08:20:44.685319+0000","last_fullsized":"2026-02-24T08:20:44.685319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29097984,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3552,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"29'3633","reported_seq":3645,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.687500+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:20:44.687500+0000","last_peered":"2026-02-24T08:20:44.687500+0000","last_clean":"2026-02-24T08:20:44.687500+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:20:44.687500+0000","last_undegraded":"2026-02-24T08:20:44.687500+0000","last_fullsized":"2026-02-24T08:20:44.687500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29761536,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3633,"num_write_kb":29064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3760","reported_seq":3774,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.660696+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:20:44.660696+0000","last_peered":"2026-02-24T08:20:44.660696+0000","last_clean":"2026-02-24T08:20:44.660696+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:20:44.660696+0000","last_undegraded":"2026-02-24T08:20:44.660696+0000","last_fullsized":"2026-02-24T08:20:44.660696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3760,"log_dups_size":0,"ondisk_log_size":3760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3760,"num_write_kb":30080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3824","reported_seq":3837,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.691963+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:20:44.691963+0000","last_peered":"2026-02-24T08:20:44.691963+0000","last_clean":"2026-02-24T08:20:44.691963+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:20:44.691963+0000","last_undegraded":"2026-02-24T08:20:44.691963+0000","last_fullsized":"2026-02-24T08:20:44.691963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3824,"log_dups_size":0,"ondisk_log_size":3824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3824,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"29'3592","reported_seq":3602,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.683053+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:20:44.683053+0000","last_peered":"2026-02-24T08:20:44.683053+0000","last_clean":"2026-02-24T08:20:44.683053+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:20:44.683053+0000","last_undegraded":"2026-02-24T08:20:44.683053+0000","last_fullsized":"2026-02-24T08:20:44.683053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29425664,"num_objects":449,"num_object_clones":0,"num_object_copies":1347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3592,"num_write_kb":28736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3571","reported_seq":3584,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.690202+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:20:44.690202+0000","last_peered":"2026-02-24T08:20:44.690202+0000","last_clean":"2026-02-24T08:20:44.690202+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:20:44.690202+0000","last_undegraded":"2026-02-24T08:20:44.690202+0000","last_fullsized":"2026-02-24T08:20:44.690202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3571,"log_dups_size":0,"ondisk_log_size":3571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29253632,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3571,"num_write_kb":28568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3560","reported_seq":3574,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.692172+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:20:44.692172+0000","last_peered":"2026-02-24T08:20:44.692172+0000","last_clean":"2026-02-24T08:20:44.692172+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:20:44.692172+0000","last_undegraded":"2026-02-24T08:20:44.692172+0000","last_fullsized":"2026-02-24T08:20:44.692172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3560,"num_write_kb":28480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"29'3346","reported_seq":3349,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.691283+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:20:44.691283+0000","last_peered":"2026-02-24T08:20:44.691283+0000","last_clean":"2026-02-24T08:20:44.691283+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:20:44.691283+0000","last_undegraded":"2026-02-24T08:20:44.691283+0000","last_fullsized":"2026-02-24T08:20:44.691283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27410432,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3346,"num_write_kb":26768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"29'3656","reported_seq":3670,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.686024+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:20:44.686024+0000","last_peered":"2026-02-24T08:20:44.686024+0000","last_clean":"2026-02-24T08:20:44.686024+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:20:44.686024+0000","last_undegraded":"2026-02-24T08:20:44.686024+0000","last_fullsized":"2026-02-24T08:20:44.686024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3656,"log_dups_size":0,"ondisk_log_size":3656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3656,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":467083264,"num_objects":7130,"num_object_clones":0,"num_object_copies":21390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57017,"num_write_kb":456136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1401372672,"data_stored":1401372672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57017,"ondisk_log_size":57017,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247815,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":473012,"kb_used_data":391904,"kb_used_omap":7,"kb_used_meta":81080,"kb_avail":733530188,"statfs":{"total":751619276800,"available":751134912512,"internally_reserved":0,"allocated":401309696,"data_stored":401138567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":83025989},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":357948,"kb_used_data":294888,"kb_used_omap":11,"kb_used_meta":63028,"kb_avail":733645252,"statfs":{"total":751619276800,"available":751252738048,"internally_reserved":0,"allocated":301965312,"data_stored":301794183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":64540919},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":381080,"kb_used_data":318020,"kb_used_omap":13,"kb_used_meta":63026,"kb_avail":733622120,"statfs":{"total":751619276800,"available":751229050880,"internally_reserved":0,"allocated":325652480,"data_stored":325484903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":64538966},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[21,13,6,2,18,17],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":375852,"kb_used_data":312792,"kb_used_omap":16,"kb_used_meta":63023,"kb_avail":733627348,"statfs":{"total":751619276800,"available":751234404352,"internally_reserved":0,"allocated":320299008,"data_stored":320127879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":64536362},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":320110592,"data_stored":320110592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":348610560,"data_stored":348610560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":324018176,"data_stored":324018176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":408633344,"data_stored":408633344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:20:49.102 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:20:49.102 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:20:49.102 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T08:20:49.103 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:20:49.189 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:49.185+0000 7faf2a1e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:49.190 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:49.187+0000 7faf2a1e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:49.209 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:49.209 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:49.222 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:49.222 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:49.236 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:49.236 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:49.250 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:49.250 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:49.258 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:49.381 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:49.378+0000 7f6a34589640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:49.381 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:49.378+0000 7f6a34589640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:49.540 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:49.540 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:20:49.575 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:20:49] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-24T08:20:49.589 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-24T08:20:48.689430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":467673632,"num_objects":7132,"num_object_clones":0,"num_object_copies":21396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7132,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":57152,"num_write_kb":458286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57116,"ondisk_log_size":57116,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":1587892,"kb_used_data":1317604,"kb_used_omap":49,"kb_used_meta":270158,"kb_avail":2934424908,"statfs":{"total":3006477107200,"available":3004851105792,"internally_reserved":0,"allocated":1349226496,"data_stored":1348545532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50756,"internal_metadata":276642236},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[22,13,6,2,18,17],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":341303296,"num_objects":5209,"num_object_clones":0,"num_object_copies":15627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41663,"num_write_kb":333304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000422"},"pg_stats":[{"pgid":"2.f","version":"29'3488","reported_seq":3502,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.648787+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:20:44.648787+0000","last_peered":"2026-02-24T08:20:44.648787+0000","last_clean":"2026-02-24T08:20:44.648787+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:20:44.648787+0000","last_undegraded":"2026-02-24T08:20:44.648787+0000","last_fullsized":"2026-02-24T08:20:44.648787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3488,"log_dups_size":0,"ondisk_log_size":3488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28573696,"num_objects":436,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3488,"num_write_kb":27904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"29'3504","reported_seq":3518,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.681397+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:20:44.681397+0000","last_peered":"2026-02-24T08:20:44.681397+0000","last_clean":"2026-02-24T08:20:44.681397+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:20:44.681397+0000","last_undegraded":"2026-02-24T08:20:44.681397+0000","last_fullsized":"2026-02-24T08:20:44.681397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704768,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3504,"num_write_kb":28032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"29'3667","reported_seq":3671,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.694206+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:20:44.694206+0000","last_peered":"2026-02-24T08:20:44.694206+0000","last_clean":"2026-02-24T08:20:44.694206+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:20:44.694206+0000","last_undegraded":"2026-02-24T08:20:44.694206+0000","last_fullsized":"2026-02-24T08:20:44.694206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3667,"log_dups_size":0,"ondisk_log_size":3667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30040064,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3667,"num_write_kb":29336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"29'3456","reported_seq":3470,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.688733+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:20:44.688733+0000","last_peered":"2026-02-24T08:20:44.688733+0000","last_clean":"2026-02-24T08:20:44.688733+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:20:44.688733+0000","last_undegraded":"2026-02-24T08:20:44.688733+0000","last_fullsized":"2026-02-24T08:20:44.688733+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3456,"log_dups_size":0,"ondisk_log_size":3456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3456,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:37.862590+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:20:37.862590+0000","last_peered":"2026-02-24T08:20:37.862590+0000","last_clean":"2026-02-24T08:20:37.862590+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:20:37.862590+0000","last_undegraded":"2026-02-24T08:20:37.862590+0000","last_fullsized":"2026-02-24T08:20:37.862590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3624","reported_seq":3638,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.686169+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:20:44.686169+0000","last_peered":"2026-02-24T08:20:44.686169+0000","last_clean":"2026-02-24T08:20:44.686169+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:20:44.686169+0000","last_undegraded":"2026-02-24T08:20:44.686169+0000","last_fullsized":"2026-02-24T08:20:44.686169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3624,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"29'3416","reported_seq":3430,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.672539+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:20:44.672539+0000","last_peered":"2026-02-24T08:20:44.672539+0000","last_clean":"2026-02-24T08:20:44.672539+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:20:44.672539+0000","last_undegraded":"2026-02-24T08:20:44.672539+0000","last_fullsized":"2026-02-24T08:20:44.672539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3416,"log_dups_size":0,"ondisk_log_size":3416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3416,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"29'3368","reported_seq":3382,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.677668+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:20:44.677668+0000","last_peered":"2026-02-24T08:20:44.677668+0000","last_clean":"2026-02-24T08:20:44.677668+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:20:44.677668+0000","last_undegraded":"2026-02-24T08:20:44.677668+0000","last_fullsized":"2026-02-24T08:20:44.677668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3368,"log_dups_size":0,"ondisk_log_size":3368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3368,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"29'3552","reported_seq":3564,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.685319+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:20:44.685319+0000","last_peered":"2026-02-24T08:20:44.685319+0000","last_clean":"2026-02-24T08:20:44.685319+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:20:44.685319+0000","last_undegraded":"2026-02-24T08:20:44.685319+0000","last_fullsized":"2026-02-24T08:20:44.685319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29097984,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3552,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"29'3633","reported_seq":3645,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.687500+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:20:44.687500+0000","last_peered":"2026-02-24T08:20:44.687500+0000","last_clean":"2026-02-24T08:20:44.687500+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:20:44.687500+0000","last_undegraded":"2026-02-24T08:20:44.687500+0000","last_fullsized":"2026-02-24T08:20:44.687500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29761536,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3633,"num_write_kb":29064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'3760","reported_seq":3774,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.660696+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:20:44.660696+0000","last_peered":"2026-02-24T08:20:44.660696+0000","last_clean":"2026-02-24T08:20:44.660696+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:20:44.660696+0000","last_undegraded":"2026-02-24T08:20:44.660696+0000","last_fullsized":"2026-02-24T08:20:44.660696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3760,"log_dups_size":0,"ondisk_log_size":3760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3760,"num_write_kb":30080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3824","reported_seq":3837,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.691963+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:20:44.691963+0000","last_peered":"2026-02-24T08:20:44.691963+0000","last_clean":"2026-02-24T08:20:44.691963+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:20:44.691963+0000","last_undegraded":"2026-02-24T08:20:44.691963+0000","last_fullsized":"2026-02-24T08:20:44.691963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3824,"log_dups_size":0,"ondisk_log_size":3824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3824,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"29'3592","reported_seq":3602,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.683053+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:20:44.683053+0000","last_peered":"2026-02-24T08:20:44.683053+0000","last_clean":"2026-02-24T08:20:44.683053+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:20:44.683053+0000","last_undegraded":"2026-02-24T08:20:44.683053+0000","last_fullsized":"2026-02-24T08:20:44.683053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29425664,"num_objects":449,"num_object_clones":0,"num_object_copies":1347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3592,"num_write_kb":28736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3571","reported_seq":3584,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.690202+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:20:44.690202+0000","last_peered":"2026-02-24T08:20:44.690202+0000","last_clean":"2026-02-24T08:20:44.690202+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:20:44.690202+0000","last_undegraded":"2026-02-24T08:20:44.690202+0000","last_fullsized":"2026-02-24T08:20:44.690202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3571,"log_dups_size":0,"ondisk_log_size":3571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29253632,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3571,"num_write_kb":28568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3560","reported_seq":3574,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.692172+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:20:44.692172+0000","last_peered":"2026-02-24T08:20:44.692172+0000","last_clean":"2026-02-24T08:20:44.692172+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:20:44.692172+0000","last_undegraded":"2026-02-24T08:20:44.692172+0000","last_fullsized":"2026-02-24T08:20:44.692172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3560,"log_dups_size":0,"ondisk_log_size":3560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3560,"num_write_kb":28480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"29'3346","reported_seq":3349,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.691283+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:20:44.691283+0000","last_peered":"2026-02-24T08:20:44.691283+0000","last_clean":"2026-02-24T08:20:44.691283+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:20:44.691283+0000","last_undegraded":"2026-02-24T08:20:44.691283+0000","last_fullsized":"2026-02-24T08:20:44.691283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27410432,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3346,"num_write_kb":26768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"29'3656","reported_seq":3670,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T08:20:44.686024+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:20:44.686024+0000","last_peered":"2026-02-24T08:20:44.686024+0000","last_clean":"2026-02-24T08:20:44.686024+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:20:44.686024+0000","last_undegraded":"2026-02-24T08:20:44.686024+0000","last_fullsized":"2026-02-24T08:20:44.686024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":3656,"log_dups_size":0,"ondisk_log_size":3656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3656,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":467083264,"num_objects":7130,"num_object_clones":0,"num_object_copies":21390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57017,"num_write_kb":456136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1401372672,"data_stored":1401372672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57017,"ondisk_log_size":57017,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247815,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":473012,"kb_used_data":391904,"kb_used_omap":7,"kb_used_meta":81080,"kb_avail":733530188,"statfs":{"total":751619276800,"available":751134912512,"internally_reserved":0,"allocated":401309696,"data_stored":401138567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":83025989},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444041,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":357948,"kb_used_data":294888,"kb_used_omap":11,"kb_used_meta":63028,"kb_avail":733645252,"statfs":{"total":751619276800,"available":751252738048,"internally_reserved":0,"allocated":301965312,"data_stored":301794183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12041,"internal_metadata":64540919},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":381080,"kb_used_data":318020,"kb_used_omap":13,"kb_used_meta":63026,"kb_avail":733622120,"statfs":{"total":751619276800,"available":751229050880,"internally_reserved":0,"allocated":325652480,"data_stored":325484903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13994,"internal_metadata":64538966},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[21,13,6,2,18,17],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":375852,"kb_used_data":312792,"kb_used_omap":16,"kb_used_meta":63023,"kb_avail":733627348,"statfs":{"total":751619276800,"available":751234404352,"internally_reserved":0,"allocated":320299008,"data_stored":320127879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":64536362},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":320110592,"data_stored":320110592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":348610560,"data_stored":348610560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":324018176,"data_stored":324018176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":408633344,"data_stored":408633344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:20:49.591 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:20:49.591 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 36 2026-02-24T08:20:49.745 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:49.873 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:49.870+0000 7fa197c75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:49.873 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:49.870+0000 7fa197c75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:49.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:20:49.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 12 127 93583 93456 60.8376 49 0.013717 0.0164185 2026-02-24T08:20:50.020 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:20:50.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:20:50.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:50 trial105 ceph-mon[39442]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:20:50.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3904057926' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:50 trial105 ceph-mon[39442]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:20:50.957 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 13 128 99782 99654 59.8823 48.4219 0.0121651 0.0166742 2026-02-24T08:20:51.301 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:20:51.326 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/60695083' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T08:20:51.326 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:51 trial105 ceph-mon[39442]: pgmap v21: 17 pgs: 17 active+clean; 717 MiB data, 2.4 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s wr, 5.97k op/s 2026-02-24T08:20:51.454 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:51.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 14 128 105403 105275 58.7415 43.9141 0.0126699 0.0169962 2026-02-24T08:20:51.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:51.965+0000 7f5b3ee3c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:51.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:51.966+0000 7f5b3ee3c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:51.998 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:51.999 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:52.013 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:52.013 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:52.028 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:52.028 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:52.044 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:52.045 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:52.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2257240572' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:52.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 15 127 110228 110101 57.3376 37.7031 0.024547 0.0174172 2026-02-24T08:20:53.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:53 trial105 ceph-mon[39442]: pgmap v22: 17 pgs: 17 active+clean; 717 MiB data, 2.4 GiB used, 2.7 TiB / 2.7 TiB avail; 40 MiB/s wr, 5.10k op/s 2026-02-24T08:20:53.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 16 128 115484 115356 56.3198 41.0547 0.00829509 0.017736 2026-02-24T08:20:54.622 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:20:54.783 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:54.900 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:54.897+0000 7f6eb9745640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:54.900 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:54.897+0000 7f6eb9745640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:54.914 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:54.914 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:54.928 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:54.929 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:54.941 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:54.941 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:54.956 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:54.956 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:54.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 17 128 120781 120653 55.441 41.3828 0.018252 0.018008 2026-02-24T08:20:55.065 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:20:55.065 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:20:55.066 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:20:55.066 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:20:55.213 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:55.346 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:55.343+0000 7fc83864d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:55.347 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:55.345+0000 7fc83864d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:55.508 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:20:55.508 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:20:55.557 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-24T08:20:54.690181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":752255520,"num_objects":11474,"num_object_clones":0,"num_object_copies":34422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11474,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":91891,"num_write_kb":736198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91855,"ondisk_log_size":91855,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":2568276,"kb_used_data":2153604,"kb_used_omap":59,"kb_used_meta":414532,"kb_avail":2933444524,"statfs":{"total":3006477107200,"available":3003847192576,"internally_reserved":0,"allocated":2205290496,"data_stored":2204483468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61168,"internal_metadata":424481040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":284581888,"num_objects":4342,"num_object_clones":0,"num_object_copies":13026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34739,"num_write_kb":277912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000959"},"pg_stats":[{"pgid":"2.f","version":"33'5712","reported_seq":5734,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.649201+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:20:49.649201+0000","last_peered":"2026-02-24T08:20:49.649201+0000","last_clean":"2026-02-24T08:20:49.649201+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:20:49.649201+0000","last_undegraded":"2026-02-24T08:20:49.649201+0000","last_fullsized":"2026-02-24T08:20:49.649201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5712,"log_dups_size":0,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46792704,"num_objects":714,"num_object_clones":0,"num_object_copies":2142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5712,"num_write_kb":45696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"33'5689","reported_seq":5710,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.698755+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:20:49.698755+0000","last_peered":"2026-02-24T08:20:49.698755+0000","last_clean":"2026-02-24T08:20:49.698755+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:20:49.698755+0000","last_undegraded":"2026-02-24T08:20:49.698755+0000","last_fullsized":"2026-02-24T08:20:49.698755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46604288,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":712,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5689,"num_write_kb":45512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"33'6013","reported_seq":6034,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.699496+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:20:49.699496+0000","last_peered":"2026-02-24T08:20:49.699496+0000","last_clean":"2026-02-24T08:20:49.699496+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:20:49.699496+0000","last_undegraded":"2026-02-24T08:20:49.699496+0000","last_fullsized":"2026-02-24T08:20:49.699496+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":6013,"log_dups_size":0,"ondisk_log_size":6013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49258496,"num_objects":752,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6013,"num_write_kb":48104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"33'5532","reported_seq":5550,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.697986+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:20:49.697986+0000","last_peered":"2026-02-24T08:20:49.697986+0000","last_clean":"2026-02-24T08:20:49.697986+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:20:49.697986+0000","last_undegraded":"2026-02-24T08:20:49.697986+0000","last_fullsized":"2026-02-24T08:20:49.697986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5532,"log_dups_size":0,"ondisk_log_size":5532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45318144,"num_objects":692,"num_object_clones":0,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5532,"num_write_kb":44256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:48.017149+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:20:48.017149+0000","last_peered":"2026-02-24T08:20:48.017149+0000","last_clean":"2026-02-24T08:20:48.017149+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:20:48.017149+0000","last_undegraded":"2026-02-24T08:20:48.017149+0000","last_fullsized":"2026-02-24T08:20:48.017149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'5800","reported_seq":5822,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.675221+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:20:49.675221+0000","last_peered":"2026-02-24T08:20:49.675221+0000","last_clean":"2026-02-24T08:20:49.675221+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:20:49.675221+0000","last_undegraded":"2026-02-24T08:20:49.675221+0000","last_fullsized":"2026-02-24T08:20:49.675221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5800,"log_dups_size":0,"ondisk_log_size":5800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47513600,"num_objects":725,"num_object_clones":0,"num_object_copies":2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5800,"num_write_kb":46400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"33'5616","reported_seq":5638,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.624711+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:20:49.624711+0000","last_peered":"2026-02-24T08:20:49.624711+0000","last_clean":"2026-02-24T08:20:49.624711+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:20:49.624711+0000","last_undegraded":"2026-02-24T08:20:49.624711+0000","last_fullsized":"2026-02-24T08:20:49.624711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5616,"log_dups_size":0,"ondisk_log_size":5616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5616,"num_write_kb":44928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"33'5632","reported_seq":5654,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.669526+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:20:49.669526+0000","last_peered":"2026-02-24T08:20:49.669526+0000","last_clean":"2026-02-24T08:20:49.669526+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:20:49.669526+0000","last_undegraded":"2026-02-24T08:20:49.669526+0000","last_fullsized":"2026-02-24T08:20:49.669526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5632,"log_dups_size":0,"ondisk_log_size":5632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5632,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"33'5704","reported_seq":5726,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.678666+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:20:49.678666+0000","last_peered":"2026-02-24T08:20:49.678666+0000","last_clean":"2026-02-24T08:20:49.678666+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:20:49.678666+0000","last_undegraded":"2026-02-24T08:20:49.678666+0000","last_fullsized":"2026-02-24T08:20:49.678666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5704,"log_dups_size":0,"ondisk_log_size":5704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46727168,"num_objects":713,"num_object_clones":0,"num_object_copies":2139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5704,"num_write_kb":45632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"33'5864","reported_seq":5886,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.682232+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:20:49.682232+0000","last_peered":"2026-02-24T08:20:49.682232+0000","last_clean":"2026-02-24T08:20:49.682232+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:20:49.682232+0000","last_undegraded":"2026-02-24T08:20:49.682232+0000","last_fullsized":"2026-02-24T08:20:49.682232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5864,"log_dups_size":0,"ondisk_log_size":5864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":733,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5864,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'5648","reported_seq":5670,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.685688+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:20:49.685688+0000","last_peered":"2026-02-24T08:20:49.685688+0000","last_clean":"2026-02-24T08:20:49.685688+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:20:49.685688+0000","last_undegraded":"2026-02-24T08:20:49.685688+0000","last_fullsized":"2026-02-24T08:20:49.685688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5648,"log_dups_size":0,"ondisk_log_size":5648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46268416,"num_objects":706,"num_object_clones":0,"num_object_copies":2118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5648,"num_write_kb":45184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'5912","reported_seq":5934,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.669195+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:20:49.669195+0000","last_peered":"2026-02-24T08:20:49.669195+0000","last_clean":"2026-02-24T08:20:49.669195+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:20:49.669195+0000","last_undegraded":"2026-02-24T08:20:49.669195+0000","last_fullsized":"2026-02-24T08:20:49.669195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5912,"log_dups_size":0,"ondisk_log_size":5912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48431104,"num_objects":739,"num_object_clones":0,"num_object_copies":2217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5912,"num_write_kb":47296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"33'5800","reported_seq":5822,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.668061+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:20:49.668061+0000","last_peered":"2026-02-24T08:20:49.668061+0000","last_clean":"2026-02-24T08:20:49.668061+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:20:49.668061+0000","last_undegraded":"2026-02-24T08:20:49.668061+0000","last_fullsized":"2026-02-24T08:20:49.668061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5800,"log_dups_size":0,"ondisk_log_size":5800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47513600,"num_objects":725,"num_object_clones":0,"num_object_copies":2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":725,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5800,"num_write_kb":46400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"33'5536","reported_seq":5558,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.675705+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:20:49.675705+0000","last_peered":"2026-02-24T08:20:49.675705+0000","last_clean":"2026-02-24T08:20:49.675705+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:20:49.675705+0000","last_undegraded":"2026-02-24T08:20:49.675705+0000","last_fullsized":"2026-02-24T08:20:49.675705+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5536,"log_dups_size":0,"ondisk_log_size":5536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45350912,"num_objects":692,"num_object_clones":0,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5536,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'5693","reported_seq":5713,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.694085+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:20:49.694085+0000","last_peered":"2026-02-24T08:20:49.694085+0000","last_clean":"2026-02-24T08:20:49.694085+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:20:49.694085+0000","last_undegraded":"2026-02-24T08:20:49.694085+0000","last_fullsized":"2026-02-24T08:20:49.694085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46637056,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":712,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5693,"num_write_kb":45544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"33'5600","reported_seq":5622,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.690221+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:20:49.690221+0000","last_peered":"2026-02-24T08:20:49.690221+0000","last_clean":"2026-02-24T08:20:49.690221+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:20:49.690221+0000","last_undegraded":"2026-02-24T08:20:49.690221+0000","last_fullsized":"2026-02-24T08:20:49.690221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":5600,"log_dups_size":0,"ondisk_log_size":5600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45875200,"num_objects":700,"num_object_clones":0,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":700,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5600,"num_write_kb":44800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"33'6005","reported_seq":6025,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:49.690642+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:20:49.690642+0000","last_peered":"2026-02-24T08:20:49.690642+0000","last_clean":"2026-02-24T08:20:49.690642+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:20:49.690642+0000","last_undegraded":"2026-02-24T08:20:49.690642+0000","last_fullsized":"2026-02-24T08:20:49.690642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":6005,"log_dups_size":0,"ondisk_log_size":6005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49192960,"num_objects":751,"num_object_clones":0,"num_object_copies":2253,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6005,"num_write_kb":48040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":751665152,"num_objects":11472,"num_object_clones":0,"num_object_copies":34416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91756,"num_write_kb":734048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2254618624,"data_stored":2254618624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91756,"ondisk_log_size":91756,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247816,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":752420,"kb_used_data":635216,"kb_used_omap":10,"kb_used_meta":117173,"kb_avail":733250780,"statfs":{"total":751619276800,"available":750848798720,"internally_reserved":0,"allocated":650461184,"data_stored":650258539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10723,"internal_metadata":119985693},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":583916,"kb_used_data":484760,"kb_used_omap":14,"kb_used_meta":99121,"kb_avail":733419284,"statfs":{"total":751619276800,"available":751021346816,"internally_reserved":0,"allocated":496394240,"data_stored":496191595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":101500619},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":629784,"kb_used_data":530628,"kb_used_omap":16,"kb_used_meta":99119,"kb_avail":733373416,"statfs":{"total":751619276800,"available":750974377984,"internally_reserved":0,"allocated":543363072,"data_stored":543163979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":101498666},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":602156,"kb_used_data":503000,"kb_used_omap":18,"kb_used_meta":99117,"kb_avail":733401044,"statfs":{"total":751619276800,"available":751002669056,"internally_reserved":0,"allocated":515072000,"data_stored":514869355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19202,"internal_metadata":101496062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":515301376,"data_stored":515301376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":564240384,"data_stored":564240384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":518209536,"data_stored":518209536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":656867328,"data_stored":656867328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:20:55.559 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:20:55.560 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 11 2026-02-24T08:20:55.702 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:55.760 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:55 trial105 ceph-mon[39442]: pgmap v23: 17 pgs: 17 active+clean; 717 MiB data, 2.4 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.34k op/s 2026-02-24T08:20:55.760 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1908887318' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:55.834 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:55.832+0000 7f05d37a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:55.834 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:55.832+0000 7f05d37a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:55.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 18 128 125622 125494 54.4619 37.8203 0.0146811 0.0183408 2026-02-24T08:20:55.978 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:20:56.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:20:56.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:56 trial105 ceph-mon[39442]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:20:56.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/444456115' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "11"} : dispatch 2026-02-24T08:20:56.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 19 128 130543 130415 53.6189 38.4453 0.014071 0.0186282 2026-02-24T08:20:56.999 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:20:57.144 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:57.265 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:57.263+0000 7fce8c3a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:57.266 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:57.263+0000 7fce8c3a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:57.280 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:57.280 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:57.294 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:57.295 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:57.306 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:57.307 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:57.322 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:57.323 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:57.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:20:57.957831+0000 min lat: 0.000730736 max lat: 0.12584 avg lat: 0.0189484 2026-02-24T08:20:57.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:20:57.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 20 128 135115 134987 52.7238 35.7188 0.0571357 0.0189484 2026-02-24T08:20:58.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:57 trial105 ceph-mon[39442]: pgmap v24: 17 pgs: 17 active+clean; 933 MiB data, 3.2 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.36k op/s 2026-02-24T08:20:58.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2918638185' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:58.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 21 128 139619 139491 51.8886 35.1875 0.0164377 0.0192472 2026-02-24T08:20:59.371 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:20:59.517 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:20:59.644 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:59.642+0000 7fabeb376640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:59.644 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:20:59.642+0000 7fabeb376640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:20:59.660 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:20:59.661 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:20:59.661 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:20:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:20:59] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-24T08:20:59.674 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:20:59.674 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:20:59.686 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:20:59.686 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:20:59.700 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:20:59.700 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:20:59.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:20:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:20:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:20:59.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:59 trial105 ceph-mon[39442]: pgmap v25: 17 pgs: 17 active+clean; 933 MiB data, 3.2 GiB used, 2.7 TiB / 2.7 TiB avail; 46 MiB/s wr, 5.84k op/s 2026-02-24T08:20:59.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:20:59.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:20:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2530203836' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:20:59.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 22 128 143972 143844 51.0758 34.0078 0.0520877 0.0195601 2026-02-24T08:21:00.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 23 128 148457 148329 50.3784 35.0391 0.0165945 0.0198326 2026-02-24T08:21:01.023 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:21:01.023 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:21:01.024 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T08:21:01.024 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:01.167 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:01.294 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:01.292+0000 7f84ebd38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:01.294 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:01.292+0000 7f84ebd38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:01.450 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:01.450 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:01.494 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-24T08:21:00.690938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1170891296,"num_objects":17861,"num_object_clones":0,"num_object_copies":53583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17861,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":142994,"num_write_kb":1145022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142958,"ondisk_log_size":142958,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4188276,"kb_used_data":3394596,"kb_used_omap":59,"kb_used_meta":793540,"kb_avail":2931824524,"statfs":{"total":3006477107200,"available":3002188312576,"internally_reserved":0,"allocated":3476066304,"data_stored":3475259276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61168,"internal_metadata":812585232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,6,9,21,28,29,28],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":703217664,"num_objects":10729,"num_object_clones":0,"num_object_copies":32187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85842,"num_write_kb":686736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001507"},"pg_stats":[{"pgid":"2.f","version":"33'8792","reported_seq":8814,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.682561+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:20:59.682561+0000","last_peered":"2026-02-24T08:20:59.682561+0000","last_clean":"2026-02-24T08:20:59.682561+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:20:59.682561+0000","last_undegraded":"2026-02-24T08:20:59.682561+0000","last_fullsized":"2026-02-24T08:20:59.682561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":8792,"log_dups_size":0,"ondisk_log_size":8792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72024064,"num_objects":1099,"num_object_clones":0,"num_object_copies":3297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8792,"num_write_kb":70336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"33'8832","reported_seq":8854,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.734645+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:20:59.734645+0000","last_peered":"2026-02-24T08:20:59.734645+0000","last_clean":"2026-02-24T08:20:59.734645+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:20:59.734645+0000","last_undegraded":"2026-02-24T08:20:59.734645+0000","last_fullsized":"2026-02-24T08:20:59.734645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":8832,"log_dups_size":0,"ondisk_log_size":8832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72351744,"num_objects":1104,"num_object_clones":0,"num_object_copies":3312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8832,"num_write_kb":70656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"33'9295","reported_seq":9315,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.731418+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:20:59.731418+0000","last_peered":"2026-02-24T08:20:59.731418+0000","last_clean":"2026-02-24T08:20:59.731418+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:20:59.731418+0000","last_undegraded":"2026-02-24T08:20:59.731418+0000","last_fullsized":"2026-02-24T08:20:59.731418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":9295,"log_dups_size":0,"ondisk_log_size":9295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76144640,"num_objects":1162,"num_object_clones":0,"num_object_copies":3486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9295,"num_write_kb":74360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"33'8504","reported_seq":8526,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.733387+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:20:59.733387+0000","last_peered":"2026-02-24T08:20:59.733387+0000","last_clean":"2026-02-24T08:20:59.733387+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:20:59.733387+0000","last_undegraded":"2026-02-24T08:20:59.733387+0000","last_fullsized":"2026-02-24T08:20:59.733387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":8504,"log_dups_size":0,"ondisk_log_size":8504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69664768,"num_objects":1063,"num_object_clones":0,"num_object_copies":3189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:48.017149+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:20:48.017149+0000","last_peered":"2026-02-24T08:20:48.017149+0000","last_clean":"2026-02-24T08:20:48.017149+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:20:48.017149+0000","last_undegraded":"2026-02-24T08:20:48.017149+0000","last_fullsized":"2026-02-24T08:20:48.017149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'8872","reported_seq":8886,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.704195+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:20:59.704195+0000","last_peered":"2026-02-24T08:20:59.704195+0000","last_clean":"2026-02-24T08:20:59.704195+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:20:59.704195+0000","last_undegraded":"2026-02-24T08:20:59.704195+0000","last_fullsized":"2026-02-24T08:20:59.704195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":8872,"log_dups_size":0,"ondisk_log_size":8872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72679424,"num_objects":1109,"num_object_clones":0,"num_object_copies":3327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8872,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"33'8837","reported_seq":8855,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.661130+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:20:59.661130+0000","last_peered":"2026-02-24T08:20:59.661130+0000","last_clean":"2026-02-24T08:20:59.661130+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:20:59.661130+0000","last_undegraded":"2026-02-24T08:20:59.661130+0000","last_fullsized":"2026-02-24T08:20:59.661130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":8837,"log_dups_size":0,"ondisk_log_size":8837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72392704,"num_objects":1105,"num_object_clones":0,"num_object_copies":3315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8837,"num_write_kb":70696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"33'8904","reported_seq":8925,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.726441+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:20:59.726441+0000","last_peered":"2026-02-24T08:20:59.726441+0000","last_clean":"2026-02-24T08:20:59.726441+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:20:59.726441+0000","last_undegraded":"2026-02-24T08:20:59.726441+0000","last_fullsized":"2026-02-24T08:20:59.726441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":8904,"log_dups_size":0,"ondisk_log_size":8904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72941568,"num_objects":1113,"num_object_clones":0,"num_object_copies":3339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8904,"num_write_kb":71232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"33'9072","reported_seq":9094,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.696316+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:20:59.696316+0000","last_peered":"2026-02-24T08:20:59.696316+0000","last_clean":"2026-02-24T08:20:59.696316+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:20:59.696316+0000","last_undegraded":"2026-02-24T08:20:59.696316+0000","last_fullsized":"2026-02-24T08:20:59.696316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":9072,"log_dups_size":0,"ondisk_log_size":9072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74317824,"num_objects":1134,"num_object_clones":0,"num_object_copies":3402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9072,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"33'9114","reported_seq":9136,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.733476+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:20:59.733476+0000","last_peered":"2026-02-24T08:20:59.733476+0000","last_clean":"2026-02-24T08:20:59.733476+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:20:59.733476+0000","last_undegraded":"2026-02-24T08:20:59.733476+0000","last_fullsized":"2026-02-24T08:20:59.733476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":9114,"log_dups_size":0,"ondisk_log_size":9114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74661888,"num_objects":1140,"num_object_clones":0,"num_object_copies":3420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9114,"num_write_kb":72912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'8736","reported_seq":8758,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.633077+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:20:59.633077+0000","last_peered":"2026-02-24T08:20:59.633077+0000","last_clean":"2026-02-24T08:20:59.633077+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:20:59.633077+0000","last_undegraded":"2026-02-24T08:20:59.633077+0000","last_fullsized":"2026-02-24T08:20:59.633077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":8736,"log_dups_size":0,"ondisk_log_size":8736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71565312,"num_objects":1092,"num_object_clones":0,"num_object_copies":3276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8736,"num_write_kb":69888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'9048","reported_seq":9070,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.675574+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:20:59.675574+0000","last_peered":"2026-02-24T08:20:59.675574+0000","last_clean":"2026-02-24T08:20:59.675574+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:20:59.675574+0000","last_undegraded":"2026-02-24T08:20:59.675574+0000","last_fullsized":"2026-02-24T08:20:59.675574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":9048,"log_dups_size":0,"ondisk_log_size":9048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74121216,"num_objects":1131,"num_object_clones":0,"num_object_copies":3393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9048,"num_write_kb":72384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"33'9272","reported_seq":9294,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.688979+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:20:59.688979+0000","last_peered":"2026-02-24T08:20:59.688979+0000","last_clean":"2026-02-24T08:20:59.688979+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:20:59.688979+0000","last_undegraded":"2026-02-24T08:20:59.688979+0000","last_fullsized":"2026-02-24T08:20:59.688979+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":9272,"log_dups_size":0,"ondisk_log_size":9272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75956224,"num_objects":1159,"num_object_clones":0,"num_object_copies":3477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9272,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"33'8536","reported_seq":8558,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.701145+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:20:59.701145+0000","last_peered":"2026-02-24T08:20:59.701145+0000","last_clean":"2026-02-24T08:20:59.701145+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:20:59.701145+0000","last_undegraded":"2026-02-24T08:20:59.701145+0000","last_fullsized":"2026-02-24T08:20:59.701145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":8536,"log_dups_size":0,"ondisk_log_size":8536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69926912,"num_objects":1067,"num_object_clones":0,"num_object_copies":3201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1067,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8536,"num_write_kb":68288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'9096","reported_seq":9118,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.707728+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:20:59.707728+0000","last_peered":"2026-02-24T08:20:59.707728+0000","last_clean":"2026-02-24T08:20:59.707728+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:20:59.707728+0000","last_undegraded":"2026-02-24T08:20:59.707728+0000","last_fullsized":"2026-02-24T08:20:59.707728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":9096,"log_dups_size":0,"ondisk_log_size":9096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74514432,"num_objects":1137,"num_object_clones":0,"num_object_copies":3411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9096,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"33'8765","reported_seq":8782,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.724394+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:20:59.724394+0000","last_peered":"2026-02-24T08:20:59.724394+0000","last_clean":"2026-02-24T08:20:59.724394+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:20:59.724394+0000","last_undegraded":"2026-02-24T08:20:59.724394+0000","last_fullsized":"2026-02-24T08:20:59.724394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":8765,"log_dups_size":0,"ondisk_log_size":8765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71802880,"num_objects":1096,"num_object_clones":0,"num_object_copies":3288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8765,"num_write_kb":70120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"33'9184","reported_seq":9206,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-24T08:20:59.688514+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:20:59.688514+0000","last_peered":"2026-02-24T08:20:59.688514+0000","last_clean":"2026-02-24T08:20:59.688514+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:20:59.688514+0000","last_undegraded":"2026-02-24T08:20:59.688514+0000","last_fullsized":"2026-02-24T08:20:59.688514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":9184,"log_dups_size":0,"ondisk_log_size":9184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75235328,"num_objects":1148,"num_object_clones":0,"num_object_copies":3444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9184,"num_write_kb":73472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":1170300928,"num_objects":17859,"num_object_clones":0,"num_object_copies":53577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142859,"num_write_kb":1142872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3509936128,"data_stored":3509936128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142859,"ondisk_log_size":142859,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247818,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1219572,"kb_used_data":994080,"kb_used_omap":10,"kb_used_meta":225461,"kb_avail":732783628,"statfs":{"total":751619276800,"available":750370435072,"internally_reserved":0,"allocated":1017937920,"data_stored":1017735275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10723,"internal_metadata":230872605},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":960780,"kb_used_data":771384,"kb_used_omap":14,"kb_used_meta":189361,"kb_avail":733042420,"statfs":{"total":751619276800,"available":750635438080,"internally_reserved":0,"allocated":789897216,"data_stored":789694571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14645,"internal_metadata":193906379},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,8,12],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1037008,"kb_used_data":847612,"kb_used_omap":16,"kb_used_meta":189359,"kb_avail":732966192,"statfs":{"total":751619276800,"available":750557380608,"internally_reserved":0,"allocated":867954688,"data_stored":867755595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16598,"internal_metadata":193904426},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,5,8,21,20,17,28],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":970916,"kb_used_data":781520,"kb_used_omap":18,"kb_used_meta":189357,"kb_avail":733032284,"statfs":{"total":751619276800,"available":750625058816,"internally_reserved":0,"allocated":800276480,"data_stored":800073835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19202,"internal_metadata":193901822},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":800858112,"data_stored":800858112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":881860608,"data_stored":881860608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":804225024,"data_stored":804225024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1022992384,"data_stored":1022992384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:01.496 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:21:01.496 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 46 2026-02-24T08:21:01.645 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:01.746 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:01.774 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:01.772+0000 7fc1fe2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:01.775 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:01.772+0000 7fc1fe2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:01.885 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:01.923 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:21:01.954 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:01 trial105 ceph-mon[39442]: pgmap v26: 17 pgs: 17 active+clean; 1.1 GiB data, 4.0 GiB used, 2.7 TiB / 2.7 TiB avail; 56 MiB/s wr, 7.15k op/s 2026-02-24T08:21:01.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 24 128 152378 152250 49.5556 30.6328 0.00848155 0.0201561 2026-02-24T08:21:01.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:21:02.007 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:02.006+0000 7f7084631640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:02.008 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:02.006+0000 7f7084631640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:02.027 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:02.027 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:02.045 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:02.046 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:02.061 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:02.061 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:02.074 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:02.075 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:02.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 25 128 156257 156129 48.7855 30.3047 0.0106598 0.0204769 2026-02-24T08:21:03.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:02 trial105 ceph-mon[39442]: from='client.14384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:03.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1106098098' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T08:21:03.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/793089957' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:03.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 26 128 160305 160177 48.1254 31.625 0.026112 0.0207605 2026-02-24T08:21:04.119 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:04.143 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:03 trial105 ceph-mon[39442]: pgmap v27: 17 pgs: 17 active+clean; 1.1 GiB data, 4.0 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.26k op/s 2026-02-24T08:21:04.143 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:03 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:21:04.143 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:03 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:21:04.264 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:04.392 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:04.390+0000 7f3b8f9c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:04.392 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:04.390+0000 7f3b8f9c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:04.408 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:04.408 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:04.422 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:04.423 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:04.435 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:04.436 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:04.449 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:04.450 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:04.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 27 128 164141 164013 47.4528 29.9688 0.0133659 0.0210541 2026-02-24T08:21:05.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:04 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:21:05.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:04 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:21:05.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:04 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2407844309' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:05.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 28 128 167926 167798 46.8141 29.5703 0.115522 0.0213321 2026-02-24T08:21:06.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:05 trial105 ceph-mon[39442]: pgmap v28: 17 pgs: 17 active+clean; 1.1 GiB data, 4.0 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.26k op/s 2026-02-24T08:21:06.498 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:06.646 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:06.764 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:06.761+0000 7f6027d2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:06.764 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:06.762+0000 7f6027d2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:06.777 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:06.777 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:06.790 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:06.791 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:06.804 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:06.805 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:06.818 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:06.819 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:06.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 29 127 171468 171341 46.1542 27.6797 0.0331517 0.0216444 2026-02-24T08:21:06.967 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:21:06.967 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:21:07.110 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:07.238 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:07.236+0000 7fc885bcf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:07.239 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:07.237+0000 7fc885bcf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:07.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 30 128 175070 174942 45.5535 28.1328 0.0280131 0.021916 2026-02-24T08:21:08.017 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:21:08.017 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:07 trial105 ceph-mon[39442]: pgmap v29: 17 pgs: 17 active+clean; 1.2 GiB data, 4.5 GiB used, 2.7 TiB / 2.7 TiB avail; 46 MiB/s wr, 5.95k op/s 2026-02-24T08:21:08.017 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3866839654' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:08.017 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/638123664' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:21:08.255 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:21:08.399 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:08.521 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:08.519+0000 7f15f4bca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:08.521 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:08.520+0000 7f15f4bca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:08.864 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:08.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 31 128 178701 178573 44.999 28.3672 0.00714245 0.0222076 2026-02-24T08:21:09.010 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:09.022 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:21:09.075 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:21:09.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:09 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/638123664' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:21:09.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:09 trial105 ceph-mon[39442]: osdmap e34: 4 total, 4 up, 4 in 2026-02-24T08:21:09.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:09 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2841929848' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:21:09.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:09 trial105 ceph-mon[39442]: pgmap v31: 17 pgs: 17 active+clean; 1.2 GiB data, 4.5 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.38k op/s 2026-02-24T08:21:09.139 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:09.136+0000 7f64cf737640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:09.139 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:09.136+0000 7f64cf737640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:09.155 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:09.155 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:09.171 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:09.171 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:09.184 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:09.184 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:09.201 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:09.201 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:09.230 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:09.353 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:09.352+0000 7f1f71210640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:09.354 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:09.352+0000 7f1f71210640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:09.840 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:21:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:21:09.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:21:09.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:21:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:21:09] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-24T08:21:09.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 32 127 182322 182195 44.477 28.2969 0.00762725 0.0224649 2026-02-24T08:21:10.020 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:21:10.067 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:21:10.210 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:10.271 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2841929848' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:21:10.272 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:10 trial105 ceph-mon[39442]: osdmap e35: 4 total, 4 up, 4 in 2026-02-24T08:21:10.272 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/963297619' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:10.272 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3441392602' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:21:10.339 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:10.336+0000 7fe532d49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:10.339 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:10.337+0000 7fe532d49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:10.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 33 128 185918 185790 43.9803 28.0859 0.0121582 0.0227153 2026-02-24T08:21:11.027 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:21:11.071 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:21:11.072 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:11.222 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:11.251 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:11.275 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3441392602' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:21:11.275 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:11 trial105 ceph-mon[39442]: osdmap e36: 4 total, 4 up, 4 in 2026-02-24T08:21:11.276 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3187655762' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:21:11.276 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:11 trial105 ceph-mon[39442]: pgmap v34: 17 pgs: 17 active+clean; 1.4 GiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.43k op/s 2026-02-24T08:21:11.347 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:11.345+0000 7ff7c735b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:11.347 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:11.345+0000 7ff7c735b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:11.400 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:11.501 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:11.502 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:11.523 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:11.521+0000 7fd8ef98a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:11.525 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:11.524+0000 7fd8ef98a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:11.543 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:11.544 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:11.553 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2026-02-24T08:21:11.023979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1486881312,"num_objects":22683,"num_object_clones":0,"num_object_copies":68049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22683,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":181567,"num_write_kb":1453606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160631,"ondisk_log_size":160631,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5264396,"kb_used_data":4326332,"kb_used_omap":66,"kb_used_meta":937917,"kb_avail":2930748404,"statfs":{"total":3006477107200,"available":3001086365696,"internally_reserved":0,"allocated":4430163968,"data_stored":4429293908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67692,"internal_metadata":960427924},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,3,12,13,57,31,10,37],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":149463040,"num_objects":2280,"num_object_clones":0,"num_object_copies":6840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18245,"num_write_kb":145960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.332284"},"pg_stats":[{"pgid":"2.f","version":"35'11016","reported_seq":11042,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.677686+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:09.677686+0000","last_peered":"2026-02-24T08:21:09.677686+0000","last_clean":"2026-02-24T08:21:09.677686+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:09.677686+0000","last_undegraded":"2026-02-24T08:21:09.677686+0000","last_fullsized":"2026-02-24T08:21:09.677686+0000","mapping_epoch":27,"log_start":"29'1000","ondisk_log_start":"29'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90243072,"num_objects":1377,"num_object_clones":0,"num_object_copies":4131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11016,"num_write_kb":88128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"35'11264","reported_seq":11287,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.763486+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:21:09.763486+0000","last_peered":"2026-02-24T08:21:09.763486+0000","last_clean":"2026-02-24T08:21:09.763486+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:09.763486+0000","last_undegraded":"2026-02-24T08:21:09.763486+0000","last_fullsized":"2026-02-24T08:21:09.763486+0000","mapping_epoch":27,"log_start":"29'1200","ondisk_log_start":"29'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11264,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"35'11816","reported_seq":11842,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.762911+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:09.762911+0000","last_peered":"2026-02-24T08:21:09.762911+0000","last_clean":"2026-02-24T08:21:09.762911+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:09.762911+0000","last_undegraded":"2026-02-24T08:21:09.762911+0000","last_fullsized":"2026-02-24T08:21:09.762911+0000","mapping_epoch":27,"log_start":"29'1800","ondisk_log_start":"29'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96796672,"num_objects":1477,"num_object_clones":0,"num_object_copies":4431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1477,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11816,"num_write_kb":94528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"35'11142","reported_seq":11166,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.761570+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:21:09.761570+0000","last_peered":"2026-02-24T08:21:09.761570+0000","last_clean":"2026-02-24T08:21:09.761570+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:09.761570+0000","last_undegraded":"2026-02-24T08:21:09.761570+0000","last_fullsized":"2026-02-24T08:21:09.761570+0000","mapping_epoch":27,"log_start":"29'1100","ondisk_log_start":"29'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91275264,"num_objects":1393,"num_object_clones":0,"num_object_copies":4179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11142,"num_write_kb":89136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.024693+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:21:09.024693+0000","last_peered":"2026-02-24T08:21:09.024693+0000","last_clean":"2026-02-24T08:21:09.024693+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:09.024693+0000","last_undegraded":"2026-02-24T08:21:09.024693+0000","last_fullsized":"2026-02-24T08:21:09.024693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'11344","reported_seq":11370,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.729775+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:21:09.729775+0000","last_peered":"2026-02-24T08:21:09.729775+0000","last_clean":"2026-02-24T08:21:09.729775+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:09.729775+0000","last_undegraded":"2026-02-24T08:21:09.729775+0000","last_fullsized":"2026-02-24T08:21:09.729775+0000","mapping_epoch":27,"log_start":"29'1300","ondisk_log_start":"29'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92930048,"num_objects":1418,"num_object_clones":0,"num_object_copies":4254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11344,"num_write_kb":90752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"35'11424","reported_seq":11450,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.680416+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:21:09.680416+0000","last_peered":"2026-02-24T08:21:09.680416+0000","last_clean":"2026-02-24T08:21:09.680416+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:09.680416+0000","last_undegraded":"2026-02-24T08:21:09.680416+0000","last_fullsized":"2026-02-24T08:21:09.680416+0000","mapping_epoch":27,"log_start":"29'1400","ondisk_log_start":"29'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93585408,"num_objects":1428,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11424,"num_write_kb":91392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"35'11352","reported_seq":11378,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.761077+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:09.761077+0000","last_peered":"2026-02-24T08:21:09.761077+0000","last_clean":"2026-02-24T08:21:09.761077+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:09.761077+0000","last_undegraded":"2026-02-24T08:21:09.761077+0000","last_fullsized":"2026-02-24T08:21:09.761077+0000","mapping_epoch":27,"log_start":"29'1300","ondisk_log_start":"29'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92995584,"num_objects":1419,"num_object_clones":0,"num_object_copies":4257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11352,"num_write_kb":90816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'11713","reported_seq":11734,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.730779+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:21:09.730779+0000","last_peered":"2026-02-24T08:21:09.730779+0000","last_clean":"2026-02-24T08:21:09.730779+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:09.730779+0000","last_undegraded":"2026-02-24T08:21:09.730779+0000","last_fullsized":"2026-02-24T08:21:09.730779+0000","mapping_epoch":27,"log_start":"29'1700","ondisk_log_start":"29'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95952896,"num_objects":1465,"num_object_clones":0,"num_object_copies":4395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11713,"num_write_kb":93704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"35'11512","reported_seq":11538,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.733022+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:21:09.733022+0000","last_peered":"2026-02-24T08:21:09.733022+0000","last_clean":"2026-02-24T08:21:09.733022+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:09.733022+0000","last_undegraded":"2026-02-24T08:21:09.733022+0000","last_fullsized":"2026-02-24T08:21:09.733022+0000","mapping_epoch":27,"log_start":"29'1500","ondisk_log_start":"29'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94306304,"num_objects":1439,"num_object_clones":0,"num_object_copies":4317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11512,"num_write_kb":92096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"35'10904","reported_seq":10930,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.697790+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:21:09.697790+0000","last_peered":"2026-02-24T08:21:09.697790+0000","last_clean":"2026-02-24T08:21:09.697790+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:09.697790+0000","last_undegraded":"2026-02-24T08:21:09.697790+0000","last_fullsized":"2026-02-24T08:21:09.697790+0000","mapping_epoch":27,"log_start":"29'900","ondisk_log_start":"29'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89325568,"num_objects":1363,"num_object_clones":0,"num_object_copies":4089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10904,"num_write_kb":87232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"35'11440","reported_seq":11459,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.751656+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:09.751656+0000","last_peered":"2026-02-24T08:21:09.751656+0000","last_clean":"2026-02-24T08:21:09.751656+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:09.751656+0000","last_undegraded":"2026-02-24T08:21:09.751656+0000","last_fullsized":"2026-02-24T08:21:09.751656+0000","mapping_epoch":27,"log_start":"29'1400","ondisk_log_start":"29'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93716480,"num_objects":1430,"num_object_clones":0,"num_object_copies":4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11440,"num_write_kb":91520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"35'11832","reported_seq":11858,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.720884+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:21:09.720884+0000","last_peered":"2026-02-24T08:21:09.720884+0000","last_clean":"2026-02-24T08:21:09.720884+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:09.720884+0000","last_undegraded":"2026-02-24T08:21:09.720884+0000","last_fullsized":"2026-02-24T08:21:09.720884+0000","mapping_epoch":27,"log_start":"29'1800","ondisk_log_start":"29'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96927744,"num_objects":1479,"num_object_clones":0,"num_object_copies":4437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11832,"num_write_kb":94656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'10624","reported_seq":10650,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.685840+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:21:09.685840+0000","last_peered":"2026-02-24T08:21:09.685840+0000","last_clean":"2026-02-24T08:21:09.685840+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:09.685840+0000","last_undegraded":"2026-02-24T08:21:09.685840+0000","last_fullsized":"2026-02-24T08:21:09.685840+0000","mapping_epoch":27,"log_start":"29'600","ondisk_log_start":"29'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87031808,"num_objects":1328,"num_object_clones":0,"num_object_copies":3984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10624,"num_write_kb":84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"35'11384","reported_seq":11410,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.734934+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:21:09.734934+0000","last_peered":"2026-02-24T08:21:09.734934+0000","last_clean":"2026-02-24T08:21:09.734934+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:09.734934+0000","last_undegraded":"2026-02-24T08:21:09.734934+0000","last_fullsized":"2026-02-24T08:21:09.734934+0000","mapping_epoch":27,"log_start":"29'1300","ondisk_log_start":"29'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93257728,"num_objects":1423,"num_object_clones":0,"num_object_copies":4269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11384,"num_write_kb":91072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"35'11258","reported_seq":11282,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.736778+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:09.736778+0000","last_peered":"2026-02-24T08:21:09.736778+0000","last_clean":"2026-02-24T08:21:09.736778+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:09.736778+0000","last_undegraded":"2026-02-24T08:21:09.736778+0000","last_fullsized":"2026-02-24T08:21:09.736778+0000","mapping_epoch":27,"log_start":"29'1200","ondisk_log_start":"29'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92225536,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11258,"num_write_kb":90064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"35'11407","reported_seq":11430,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.736040+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:21:09.736040+0000","last_peered":"2026-02-24T08:21:09.736040+0000","last_clean":"2026-02-24T08:21:09.736040+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:09.736040+0000","last_undegraded":"2026-02-24T08:21:09.736040+0000","last_fullsized":"2026-02-24T08:21:09.736040+0000","mapping_epoch":27,"log_start":"29'1400","ondisk_log_start":"29'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93446144,"num_objects":1426,"num_object_clones":0,"num_object_copies":4278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1426,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11407,"num_write_kb":91256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":1486290944,"num_objects":22681,"num_object_clones":0,"num_object_copies":68043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181432,"num_write_kb":1451456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4457406464,"data_stored":4457406464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160532,"ondisk_log_size":160532,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247820,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1526748,"kb_used_data":1265160,"kb_used_omap":11,"kb_used_meta":261556,"kb_avail":732476452,"statfs":{"total":751619276800,"available":750055886848,"internally_reserved":0,"allocated":1295523840,"data_stored":1295305437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12039,"internal_metadata":267833593},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,0,4,8,27,15,2,20],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1207492,"kb_used_data":982000,"kb_used_omap":15,"kb_used_meta":225456,"kb_avail":732795708,"statfs":{"total":751619276800,"available":750382804992,"internally_reserved":0,"allocated":1005568000,"data_stored":1005349597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":230867381},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,4,5,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1314408,"kb_used_data":1088916,"kb_used_omap":18,"kb_used_meta":225453,"kb_avail":732688792,"statfs":{"total":751619276800,"available":750273323008,"internally_reserved":0,"allocated":1115049984,"data_stored":1114835133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18551,"internal_metadata":230864777},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,4,0,23,16,8,17],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1215748,"kb_used_data":990256,"kb_used_omap":20,"kb_used_meta":225451,"kb_avail":732787452,"statfs":{"total":751619276800,"available":750374350848,"internally_reserved":0,"allocated":1014022144,"data_stored":1013803741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":230862173},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1013669888,"data_stored":1013669888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1126596608,"data_stored":1126596608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1017544704,"data_stored":1017544704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1299595264,"data_stored":1299595264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:11.555 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:11.557 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:11.558 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:11.573 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:11.573 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:11.587 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:11.588 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:11.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 34 128 189150 189022 43.4293 25.25 0.0144837 0.0230013 2026-02-24T08:21:12.139 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:12 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3187655762' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:21:12.139 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:12 trial105 ceph-mon[39442]: osdmap e37: 4 total, 4 up, 4 in 2026-02-24T08:21:12.139 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:12 trial105 ceph-mon[39442]: from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:12.140 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:12 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4035939427' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:12.222 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:12.358 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:12.355+0000 7fbfc9308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:12.358 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:12.355+0000 7fbfc9308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:12.505 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:12.506 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:12.552 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2026-02-24T08:21:11.023979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1486881312,"num_objects":22683,"num_object_clones":0,"num_object_copies":68049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22683,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":181567,"num_write_kb":1453606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160631,"ondisk_log_size":160631,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5264396,"kb_used_data":4326332,"kb_used_omap":66,"kb_used_meta":937917,"kb_avail":2930748404,"statfs":{"total":3006477107200,"available":3001086365696,"internally_reserved":0,"allocated":4430163968,"data_stored":4429293908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67692,"internal_metadata":960427924},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,3,12,13,57,31,10,37],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":149463040,"num_objects":2280,"num_object_clones":0,"num_object_copies":6840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18245,"num_write_kb":145960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.332284"},"pg_stats":[{"pgid":"2.f","version":"35'11016","reported_seq":11042,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.677686+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:09.677686+0000","last_peered":"2026-02-24T08:21:09.677686+0000","last_clean":"2026-02-24T08:21:09.677686+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:09.677686+0000","last_undegraded":"2026-02-24T08:21:09.677686+0000","last_fullsized":"2026-02-24T08:21:09.677686+0000","mapping_epoch":27,"log_start":"29'1000","ondisk_log_start":"29'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90243072,"num_objects":1377,"num_object_clones":0,"num_object_copies":4131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11016,"num_write_kb":88128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"35'11264","reported_seq":11287,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.763486+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:21:09.763486+0000","last_peered":"2026-02-24T08:21:09.763486+0000","last_clean":"2026-02-24T08:21:09.763486+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:09.763486+0000","last_undegraded":"2026-02-24T08:21:09.763486+0000","last_fullsized":"2026-02-24T08:21:09.763486+0000","mapping_epoch":27,"log_start":"29'1200","ondisk_log_start":"29'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11264,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"35'11816","reported_seq":11842,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.762911+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:09.762911+0000","last_peered":"2026-02-24T08:21:09.762911+0000","last_clean":"2026-02-24T08:21:09.762911+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:09.762911+0000","last_undegraded":"2026-02-24T08:21:09.762911+0000","last_fullsized":"2026-02-24T08:21:09.762911+0000","mapping_epoch":27,"log_start":"29'1800","ondisk_log_start":"29'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96796672,"num_objects":1477,"num_object_clones":0,"num_object_copies":4431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1477,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11816,"num_write_kb":94528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"35'11142","reported_seq":11166,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.761570+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:21:09.761570+0000","last_peered":"2026-02-24T08:21:09.761570+0000","last_clean":"2026-02-24T08:21:09.761570+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:09.761570+0000","last_undegraded":"2026-02-24T08:21:09.761570+0000","last_fullsized":"2026-02-24T08:21:09.761570+0000","mapping_epoch":27,"log_start":"29'1100","ondisk_log_start":"29'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91275264,"num_objects":1393,"num_object_clones":0,"num_object_copies":4179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11142,"num_write_kb":89136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.024693+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:21:09.024693+0000","last_peered":"2026-02-24T08:21:09.024693+0000","last_clean":"2026-02-24T08:21:09.024693+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:09.024693+0000","last_undegraded":"2026-02-24T08:21:09.024693+0000","last_fullsized":"2026-02-24T08:21:09.024693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'11344","reported_seq":11370,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.729775+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:21:09.729775+0000","last_peered":"2026-02-24T08:21:09.729775+0000","last_clean":"2026-02-24T08:21:09.729775+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:09.729775+0000","last_undegraded":"2026-02-24T08:21:09.729775+0000","last_fullsized":"2026-02-24T08:21:09.729775+0000","mapping_epoch":27,"log_start":"29'1300","ondisk_log_start":"29'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92930048,"num_objects":1418,"num_object_clones":0,"num_object_copies":4254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11344,"num_write_kb":90752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"35'11424","reported_seq":11450,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.680416+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:21:09.680416+0000","last_peered":"2026-02-24T08:21:09.680416+0000","last_clean":"2026-02-24T08:21:09.680416+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:09.680416+0000","last_undegraded":"2026-02-24T08:21:09.680416+0000","last_fullsized":"2026-02-24T08:21:09.680416+0000","mapping_epoch":27,"log_start":"29'1400","ondisk_log_start":"29'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93585408,"num_objects":1428,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11424,"num_write_kb":91392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"35'11352","reported_seq":11378,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.761077+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:09.761077+0000","last_peered":"2026-02-24T08:21:09.761077+0000","last_clean":"2026-02-24T08:21:09.761077+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:09.761077+0000","last_undegraded":"2026-02-24T08:21:09.761077+0000","last_fullsized":"2026-02-24T08:21:09.761077+0000","mapping_epoch":27,"log_start":"29'1300","ondisk_log_start":"29'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92995584,"num_objects":1419,"num_object_clones":0,"num_object_copies":4257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11352,"num_write_kb":90816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'11713","reported_seq":11734,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.730779+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:21:09.730779+0000","last_peered":"2026-02-24T08:21:09.730779+0000","last_clean":"2026-02-24T08:21:09.730779+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:09.730779+0000","last_undegraded":"2026-02-24T08:21:09.730779+0000","last_fullsized":"2026-02-24T08:21:09.730779+0000","mapping_epoch":27,"log_start":"29'1700","ondisk_log_start":"29'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95952896,"num_objects":1465,"num_object_clones":0,"num_object_copies":4395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11713,"num_write_kb":93704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"35'11512","reported_seq":11538,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.733022+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:21:09.733022+0000","last_peered":"2026-02-24T08:21:09.733022+0000","last_clean":"2026-02-24T08:21:09.733022+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:09.733022+0000","last_undegraded":"2026-02-24T08:21:09.733022+0000","last_fullsized":"2026-02-24T08:21:09.733022+0000","mapping_epoch":27,"log_start":"29'1500","ondisk_log_start":"29'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94306304,"num_objects":1439,"num_object_clones":0,"num_object_copies":4317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11512,"num_write_kb":92096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"35'10904","reported_seq":10930,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.697790+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:21:09.697790+0000","last_peered":"2026-02-24T08:21:09.697790+0000","last_clean":"2026-02-24T08:21:09.697790+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:09.697790+0000","last_undegraded":"2026-02-24T08:21:09.697790+0000","last_fullsized":"2026-02-24T08:21:09.697790+0000","mapping_epoch":27,"log_start":"29'900","ondisk_log_start":"29'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89325568,"num_objects":1363,"num_object_clones":0,"num_object_copies":4089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10904,"num_write_kb":87232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"35'11440","reported_seq":11459,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.751656+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:09.751656+0000","last_peered":"2026-02-24T08:21:09.751656+0000","last_clean":"2026-02-24T08:21:09.751656+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:09.751656+0000","last_undegraded":"2026-02-24T08:21:09.751656+0000","last_fullsized":"2026-02-24T08:21:09.751656+0000","mapping_epoch":27,"log_start":"29'1400","ondisk_log_start":"29'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93716480,"num_objects":1430,"num_object_clones":0,"num_object_copies":4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11440,"num_write_kb":91520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"35'11832","reported_seq":11858,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.720884+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:21:09.720884+0000","last_peered":"2026-02-24T08:21:09.720884+0000","last_clean":"2026-02-24T08:21:09.720884+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:09.720884+0000","last_undegraded":"2026-02-24T08:21:09.720884+0000","last_fullsized":"2026-02-24T08:21:09.720884+0000","mapping_epoch":27,"log_start":"29'1800","ondisk_log_start":"29'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96927744,"num_objects":1479,"num_object_clones":0,"num_object_copies":4437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11832,"num_write_kb":94656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'10624","reported_seq":10650,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.685840+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:21:09.685840+0000","last_peered":"2026-02-24T08:21:09.685840+0000","last_clean":"2026-02-24T08:21:09.685840+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:09.685840+0000","last_undegraded":"2026-02-24T08:21:09.685840+0000","last_fullsized":"2026-02-24T08:21:09.685840+0000","mapping_epoch":27,"log_start":"29'600","ondisk_log_start":"29'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87031808,"num_objects":1328,"num_object_clones":0,"num_object_copies":3984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10624,"num_write_kb":84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"35'11384","reported_seq":11410,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.734934+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:21:09.734934+0000","last_peered":"2026-02-24T08:21:09.734934+0000","last_clean":"2026-02-24T08:21:09.734934+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:09.734934+0000","last_undegraded":"2026-02-24T08:21:09.734934+0000","last_fullsized":"2026-02-24T08:21:09.734934+0000","mapping_epoch":27,"log_start":"29'1300","ondisk_log_start":"29'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93257728,"num_objects":1423,"num_object_clones":0,"num_object_copies":4269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11384,"num_write_kb":91072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"35'11258","reported_seq":11282,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.736778+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:09.736778+0000","last_peered":"2026-02-24T08:21:09.736778+0000","last_clean":"2026-02-24T08:21:09.736778+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:09.736778+0000","last_undegraded":"2026-02-24T08:21:09.736778+0000","last_fullsized":"2026-02-24T08:21:09.736778+0000","mapping_epoch":27,"log_start":"29'1200","ondisk_log_start":"29'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92225536,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11258,"num_write_kb":90064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"35'11407","reported_seq":11430,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.736040+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:21:09.736040+0000","last_peered":"2026-02-24T08:21:09.736040+0000","last_clean":"2026-02-24T08:21:09.736040+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:09.736040+0000","last_undegraded":"2026-02-24T08:21:09.736040+0000","last_fullsized":"2026-02-24T08:21:09.736040+0000","mapping_epoch":27,"log_start":"29'1400","ondisk_log_start":"29'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93446144,"num_objects":1426,"num_object_clones":0,"num_object_copies":4278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1426,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11407,"num_write_kb":91256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":1486290944,"num_objects":22681,"num_object_clones":0,"num_object_copies":68043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181432,"num_write_kb":1451456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4457406464,"data_stored":4457406464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160532,"ondisk_log_size":160532,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247820,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1526748,"kb_used_data":1265160,"kb_used_omap":11,"kb_used_meta":261556,"kb_avail":732476452,"statfs":{"total":751619276800,"available":750055886848,"internally_reserved":0,"allocated":1295523840,"data_stored":1295305437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12039,"internal_metadata":267833593},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,0,4,8,27,15,2,20],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1207492,"kb_used_data":982000,"kb_used_omap":15,"kb_used_meta":225456,"kb_avail":732795708,"statfs":{"total":751619276800,"available":750382804992,"internally_reserved":0,"allocated":1005568000,"data_stored":1005349597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":230867381},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,4,5,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1314408,"kb_used_data":1088916,"kb_used_omap":18,"kb_used_meta":225453,"kb_avail":732688792,"statfs":{"total":751619276800,"available":750273323008,"internally_reserved":0,"allocated":1115049984,"data_stored":1114835133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18551,"internal_metadata":230864777},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,4,0,23,16,8,17],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1215748,"kb_used_data":990256,"kb_used_omap":20,"kb_used_meta":225451,"kb_avail":732787452,"statfs":{"total":751619276800,"available":750374350848,"internally_reserved":0,"allocated":1014022144,"data_stored":1013803741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":230862173},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1013669888,"data_stored":1013669888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1126596608,"data_stored":1126596608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1017544704,"data_stored":1017544704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1299595264,"data_stored":1299595264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:12.554 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:21:12.554 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:21:12.555 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2026-02-24T08:21:12.555 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:12.706 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:12.830 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:12.828+0000 7fad0d4ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:12.830 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:12.828+0000 7fad0d4ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:12.959 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 35 127 192676 192549 42.9757 27.5547 0.0208417 0.0232511 2026-02-24T08:21:12.985 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:12.986 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:13.034 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2026-02-24T08:21:12.692535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1486881312,"num_objects":22683,"num_object_clones":0,"num_object_copies":68049,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22683,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":181567,"num_write_kb":1453606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160631,"ondisk_log_size":160631,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5264396,"kb_used_data":4326332,"kb_used_omap":66,"kb_used_meta":937917,"kb_avail":2930748404,"statfs":{"total":3006477107200,"available":3001086365696,"internally_reserved":0,"allocated":4430163968,"data_stored":4429293908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67692,"internal_metadata":960427924},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,3,12,13,57,31,10,37],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":149463040,"num_objects":2280,"num_object_clones":0,"num_object_copies":6840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18245,"num_write_kb":145960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.676429"},"pg_stats":[{"pgid":"2.f","version":"35'11016","reported_seq":11042,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.677686+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:09.677686+0000","last_peered":"2026-02-24T08:21:09.677686+0000","last_clean":"2026-02-24T08:21:09.677686+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:09.677686+0000","last_undegraded":"2026-02-24T08:21:09.677686+0000","last_fullsized":"2026-02-24T08:21:09.677686+0000","mapping_epoch":27,"log_start":"29'1000","ondisk_log_start":"29'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90243072,"num_objects":1377,"num_object_clones":0,"num_object_copies":4131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1377,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11016,"num_write_kb":88128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"35'11264","reported_seq":11287,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.763486+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:21:09.763486+0000","last_peered":"2026-02-24T08:21:09.763486+0000","last_clean":"2026-02-24T08:21:09.763486+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:09.763486+0000","last_undegraded":"2026-02-24T08:21:09.763486+0000","last_fullsized":"2026-02-24T08:21:09.763486+0000","mapping_epoch":27,"log_start":"29'1200","ondisk_log_start":"29'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11264,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"35'11816","reported_seq":11842,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.762911+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:09.762911+0000","last_peered":"2026-02-24T08:21:09.762911+0000","last_clean":"2026-02-24T08:21:09.762911+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:09.762911+0000","last_undegraded":"2026-02-24T08:21:09.762911+0000","last_fullsized":"2026-02-24T08:21:09.762911+0000","mapping_epoch":27,"log_start":"29'1800","ondisk_log_start":"29'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96796672,"num_objects":1477,"num_object_clones":0,"num_object_copies":4431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1477,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11816,"num_write_kb":94528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"35'11142","reported_seq":11166,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.761570+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:21:09.761570+0000","last_peered":"2026-02-24T08:21:09.761570+0000","last_clean":"2026-02-24T08:21:09.761570+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:09.761570+0000","last_undegraded":"2026-02-24T08:21:09.761570+0000","last_fullsized":"2026-02-24T08:21:09.761570+0000","mapping_epoch":27,"log_start":"29'1100","ondisk_log_start":"29'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91275264,"num_objects":1393,"num_object_clones":0,"num_object_copies":4179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11142,"num_write_kb":89136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.024693+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:21:09.024693+0000","last_peered":"2026-02-24T08:21:09.024693+0000","last_clean":"2026-02-24T08:21:09.024693+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:09.024693+0000","last_undegraded":"2026-02-24T08:21:09.024693+0000","last_fullsized":"2026-02-24T08:21:09.024693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"35'11344","reported_seq":11370,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.729775+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:21:09.729775+0000","last_peered":"2026-02-24T08:21:09.729775+0000","last_clean":"2026-02-24T08:21:09.729775+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:09.729775+0000","last_undegraded":"2026-02-24T08:21:09.729775+0000","last_fullsized":"2026-02-24T08:21:09.729775+0000","mapping_epoch":27,"log_start":"29'1300","ondisk_log_start":"29'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92930048,"num_objects":1418,"num_object_clones":0,"num_object_copies":4254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11344,"num_write_kb":90752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"35'11424","reported_seq":11450,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.680416+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:21:09.680416+0000","last_peered":"2026-02-24T08:21:09.680416+0000","last_clean":"2026-02-24T08:21:09.680416+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:09.680416+0000","last_undegraded":"2026-02-24T08:21:09.680416+0000","last_fullsized":"2026-02-24T08:21:09.680416+0000","mapping_epoch":27,"log_start":"29'1400","ondisk_log_start":"29'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93585408,"num_objects":1428,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11424,"num_write_kb":91392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"35'11352","reported_seq":11378,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.761077+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:09.761077+0000","last_peered":"2026-02-24T08:21:09.761077+0000","last_clean":"2026-02-24T08:21:09.761077+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:09.761077+0000","last_undegraded":"2026-02-24T08:21:09.761077+0000","last_fullsized":"2026-02-24T08:21:09.761077+0000","mapping_epoch":27,"log_start":"29'1300","ondisk_log_start":"29'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92995584,"num_objects":1419,"num_object_clones":0,"num_object_copies":4257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11352,"num_write_kb":90816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"35'11713","reported_seq":11734,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.730779+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:21:09.730779+0000","last_peered":"2026-02-24T08:21:09.730779+0000","last_clean":"2026-02-24T08:21:09.730779+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:09.730779+0000","last_undegraded":"2026-02-24T08:21:09.730779+0000","last_fullsized":"2026-02-24T08:21:09.730779+0000","mapping_epoch":27,"log_start":"29'1700","ondisk_log_start":"29'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95952896,"num_objects":1465,"num_object_clones":0,"num_object_copies":4395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11713,"num_write_kb":93704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"35'11512","reported_seq":11538,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.733022+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:21:09.733022+0000","last_peered":"2026-02-24T08:21:09.733022+0000","last_clean":"2026-02-24T08:21:09.733022+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:09.733022+0000","last_undegraded":"2026-02-24T08:21:09.733022+0000","last_fullsized":"2026-02-24T08:21:09.733022+0000","mapping_epoch":27,"log_start":"29'1500","ondisk_log_start":"29'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94306304,"num_objects":1439,"num_object_clones":0,"num_object_copies":4317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1439,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11512,"num_write_kb":92096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"35'10904","reported_seq":10930,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.697790+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:21:09.697790+0000","last_peered":"2026-02-24T08:21:09.697790+0000","last_clean":"2026-02-24T08:21:09.697790+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:09.697790+0000","last_undegraded":"2026-02-24T08:21:09.697790+0000","last_fullsized":"2026-02-24T08:21:09.697790+0000","mapping_epoch":27,"log_start":"29'900","ondisk_log_start":"29'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89325568,"num_objects":1363,"num_object_clones":0,"num_object_copies":4089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10904,"num_write_kb":87232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"35'11440","reported_seq":11459,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.751656+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:09.751656+0000","last_peered":"2026-02-24T08:21:09.751656+0000","last_clean":"2026-02-24T08:21:09.751656+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:09.751656+0000","last_undegraded":"2026-02-24T08:21:09.751656+0000","last_fullsized":"2026-02-24T08:21:09.751656+0000","mapping_epoch":27,"log_start":"29'1400","ondisk_log_start":"29'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93716480,"num_objects":1430,"num_object_clones":0,"num_object_copies":4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11440,"num_write_kb":91520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"35'11832","reported_seq":11858,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.720884+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:21:09.720884+0000","last_peered":"2026-02-24T08:21:09.720884+0000","last_clean":"2026-02-24T08:21:09.720884+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:09.720884+0000","last_undegraded":"2026-02-24T08:21:09.720884+0000","last_fullsized":"2026-02-24T08:21:09.720884+0000","mapping_epoch":27,"log_start":"29'1800","ondisk_log_start":"29'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96927744,"num_objects":1479,"num_object_clones":0,"num_object_copies":4437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11832,"num_write_kb":94656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"35'10624","reported_seq":10650,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.685840+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:21:09.685840+0000","last_peered":"2026-02-24T08:21:09.685840+0000","last_clean":"2026-02-24T08:21:09.685840+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:09.685840+0000","last_undegraded":"2026-02-24T08:21:09.685840+0000","last_fullsized":"2026-02-24T08:21:09.685840+0000","mapping_epoch":27,"log_start":"29'600","ondisk_log_start":"29'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87031808,"num_objects":1328,"num_object_clones":0,"num_object_copies":3984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10624,"num_write_kb":84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"35'11384","reported_seq":11410,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.734934+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:21:09.734934+0000","last_peered":"2026-02-24T08:21:09.734934+0000","last_clean":"2026-02-24T08:21:09.734934+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:09.734934+0000","last_undegraded":"2026-02-24T08:21:09.734934+0000","last_fullsized":"2026-02-24T08:21:09.734934+0000","mapping_epoch":27,"log_start":"29'1300","ondisk_log_start":"29'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93257728,"num_objects":1423,"num_object_clones":0,"num_object_copies":4269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11384,"num_write_kb":91072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"35'11258","reported_seq":11282,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.736778+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:09.736778+0000","last_peered":"2026-02-24T08:21:09.736778+0000","last_clean":"2026-02-24T08:21:09.736778+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:09.736778+0000","last_undegraded":"2026-02-24T08:21:09.736778+0000","last_fullsized":"2026-02-24T08:21:09.736778+0000","mapping_epoch":27,"log_start":"29'1200","ondisk_log_start":"29'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92225536,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11258,"num_write_kb":90064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"35'11407","reported_seq":11430,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-24T08:21:09.736040+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:21:09.736040+0000","last_peered":"2026-02-24T08:21:09.736040+0000","last_clean":"2026-02-24T08:21:09.736040+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:09.736040+0000","last_undegraded":"2026-02-24T08:21:09.736040+0000","last_fullsized":"2026-02-24T08:21:09.736040+0000","mapping_epoch":27,"log_start":"29'1400","ondisk_log_start":"29'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93446144,"num_objects":1426,"num_object_clones":0,"num_object_copies":4278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1426,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11407,"num_write_kb":91256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":1486290944,"num_objects":22681,"num_object_clones":0,"num_object_copies":68043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181432,"num_write_kb":1451456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4457406464,"data_stored":4457406464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160532,"ondisk_log_size":160532,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247820,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1526748,"kb_used_data":1265160,"kb_used_omap":11,"kb_used_meta":261556,"kb_avail":732476452,"statfs":{"total":751619276800,"available":750055886848,"internally_reserved":0,"allocated":1295523840,"data_stored":1295305437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12039,"internal_metadata":267833593},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,0,4,8,27,15,2,20],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1207492,"kb_used_data":982000,"kb_used_omap":15,"kb_used_meta":225456,"kb_avail":732795708,"statfs":{"total":751619276800,"available":750382804992,"internally_reserved":0,"allocated":1005568000,"data_stored":1005349597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15947,"internal_metadata":230867381},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,4,5,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1314408,"kb_used_data":1088916,"kb_used_omap":18,"kb_used_meta":225453,"kb_avail":732688792,"statfs":{"total":751619276800,"available":750273323008,"internally_reserved":0,"allocated":1115049984,"data_stored":1114835133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18551,"internal_metadata":230864777},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,4,0,23,16,8,17],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1215748,"kb_used_data":990256,"kb_used_omap":20,"kb_used_meta":225451,"kb_avail":732787452,"statfs":{"total":751619276800,"available":750374350848,"internally_reserved":0,"allocated":1014022144,"data_stored":1013803741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":230862173},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1013669888,"data_stored":1013669888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1126596608,"data_stored":1126596608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1017544704,"data_stored":1017544704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1299595264,"data_stored":1299595264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:13.036 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_0 pgp_num 46 2026-02-24T08:21:13.181 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:13.299 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:13 trial105 ceph-mon[39442]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:13.299 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:13 trial105 ceph-mon[39442]: pgmap v36: 17 pgs: 17 active+clean; 1.4 GiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.90k op/s 2026-02-24T08:21:13.314 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:13.311+0000 7f34cefe3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:13.314 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:13.312+0000 7f34cefe3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:13.471 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:21:13.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:21:13.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 36 128 196374 196246 42.5842 28.8828 0.0675314 0.0234601 2026-02-24T08:21:14.169 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:14.312 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:14.338 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:14 trial105 ceph-mon[39442]: from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:14.338 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:14 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/793013821' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pgp_num", "val": "46"} : dispatch 2026-02-24T08:21:14.338 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:21:14.440 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:14.438+0000 7f145a397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:14.440 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:14.438+0000 7f145a397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:14.454 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:14.454 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:14.468 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:14.469 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:14.483 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:14.483 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:14.498 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:14.498 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:14.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 37 128 200020 199892 42.2031 28.4844 0.0126448 0.0236758 2026-02-24T08:21:15.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:15 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1147528620' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:15.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:15 trial105 ceph-mon[39442]: pgmap v37: 17 pgs: 17 active+clean; 1.4 GiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.04k op/s 2026-02-24T08:21:15.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 38 128 203697 203569 41.8484 28.7266 0.032382 0.0238705 2026-02-24T08:21:16.540 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:16.688 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:16.820 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:16.819+0000 7efcf5c4c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:16.821 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:16.819+0000 7efcf5c4c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:16.835 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:16.836 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:16.850 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:16.850 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:16.864 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:16.864 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:16.877 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:16.877 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:16.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 39 128 207294 207166 41.4958 28.1016 0.0852263 0.0240728 2026-02-24T08:21:17.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:21:17.959359+0000 min lat: 0.000730736 max lat: 0.19461 avg lat: 0.024263 2026-02-24T08:21:17.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:21:17.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 40 128 211041 210913 41.1902 29.2734 0.0342793 0.024263 2026-02-24T08:21:18.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:17 trial105 ceph-mon[39442]: pgmap v38: 17 pgs: 17 active+clean; 1.5 GiB data, 5.5 GiB used, 2.7 TiB / 2.7 TiB avail; 37 MiB/s wr, 4.70k op/s 2026-02-24T08:21:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1929309717' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:18.509 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:21:18.510 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:21:18.510 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T08:21:18.510 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:18.655 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:18.777 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:18.775+0000 7fce0fa26640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:18.778 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:18.776+0000 7fce0fa26640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:18.920 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:18.949 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:18.950 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:18.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 41 127 214620 214493 40.8677 27.9688 0.055397 0.0244496 2026-02-24T08:21:18.968 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-24T08:21:18.693301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1632961056,"num_objects":24911,"num_object_clones":0,"num_object_copies":74733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24911,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":199399,"num_write_kb":1596262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160663,"ondisk_log_size":160663,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5767380,"kb_used_data":4757052,"kb_used_omap":71,"kb_used_meta":1010168,"kb_avail":2930245420,"statfs":{"total":3006477107200,"available":3000571310080,"internally_reserved":0,"allocated":4871221248,"data_stored":4870288156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72900,"internal_metadata":1034412860},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,5,6,6,16,28,18,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":146079744,"num_objects":2228,"num_object_clones":0,"num_object_copies":6684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17832,"num_write_kb":142656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.674108"},"pg_stats":[{"pgid":"2.f","version":"37'12256","reported_seq":12286,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.680685+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:14.680685+0000","last_peered":"2026-02-24T08:21:14.680685+0000","last_clean":"2026-02-24T08:21:14.680685+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:14.680685+0000","last_undegraded":"2026-02-24T08:21:14.680685+0000","last_fullsized":"2026-02-24T08:21:14.680685+0000","mapping_epoch":27,"log_start":"29'2200","ondisk_log_start":"29'2200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100401152,"num_objects":1532,"num_object_clones":0,"num_object_copies":4596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12256,"num_write_kb":98048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'12446","reported_seq":12476,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.777010+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:21:14.777010+0000","last_peered":"2026-02-24T08:21:14.777010+0000","last_clean":"2026-02-24T08:21:14.777010+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:14.777010+0000","last_undegraded":"2026-02-24T08:21:14.777010+0000","last_fullsized":"2026-02-24T08:21:14.777010+0000","mapping_epoch":27,"log_start":"29'2400","ondisk_log_start":"29'2400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101957632,"num_objects":1556,"num_object_clones":0,"num_object_copies":4668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12446,"num_write_kb":99568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'12752","reported_seq":12782,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.687620+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:14.687620+0000","last_peered":"2026-02-24T08:21:14.687620+0000","last_clean":"2026-02-24T08:21:14.687620+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:14.687620+0000","last_undegraded":"2026-02-24T08:21:14.687620+0000","last_fullsized":"2026-02-24T08:21:14.687620+0000","mapping_epoch":27,"log_start":"29'2700","ondisk_log_start":"29'2700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104464384,"num_objects":1594,"num_object_clones":0,"num_object_copies":4782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12752,"num_write_kb":102016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'12240","reported_seq":12270,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.764142+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:21:14.764142+0000","last_peered":"2026-02-24T08:21:14.764142+0000","last_clean":"2026-02-24T08:21:14.764142+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:14.764142+0000","last_undegraded":"2026-02-24T08:21:14.764142+0000","last_fullsized":"2026-02-24T08:21:14.764142+0000","mapping_epoch":27,"log_start":"29'2200","ondisk_log_start":"29'2200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100270080,"num_objects":1530,"num_object_clones":0,"num_object_copies":4590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12240,"num_write_kb":97920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:11.029053+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:21:11.029053+0000","last_peered":"2026-02-24T08:21:11.029053+0000","last_clean":"2026-02-24T08:21:11.029053+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:11.029053+0000","last_undegraded":"2026-02-24T08:21:11.029053+0000","last_fullsized":"2026-02-24T08:21:11.029053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'12360","reported_seq":12388,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.756146+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:21:14.756146+0000","last_peered":"2026-02-24T08:21:14.756146+0000","last_clean":"2026-02-24T08:21:14.756146+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:14.756146+0000","last_undegraded":"2026-02-24T08:21:14.756146+0000","last_fullsized":"2026-02-24T08:21:14.756146+0000","mapping_epoch":27,"log_start":"29'2300","ondisk_log_start":"29'2300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101253120,"num_objects":1545,"num_object_clones":0,"num_object_copies":4635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12360,"num_write_kb":98880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'12314","reported_seq":12343,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.698851+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:21:14.698851+0000","last_peered":"2026-02-24T08:21:14.698851+0000","last_clean":"2026-02-24T08:21:14.698851+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:14.698851+0000","last_undegraded":"2026-02-24T08:21:14.698851+0000","last_fullsized":"2026-02-24T08:21:14.698851+0000","mapping_epoch":27,"log_start":"29'2300","ondisk_log_start":"29'2300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100876288,"num_objects":1540,"num_object_clones":0,"num_object_copies":4620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1540,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12314,"num_write_kb":98512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'12456","reported_seq":12485,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.776749+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:14.776749+0000","last_peered":"2026-02-24T08:21:14.776749+0000","last_clean":"2026-02-24T08:21:14.776749+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:14.776749+0000","last_undegraded":"2026-02-24T08:21:14.776749+0000","last_fullsized":"2026-02-24T08:21:14.776749+0000","mapping_epoch":27,"log_start":"29'2400","ondisk_log_start":"29'2400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102039552,"num_objects":1557,"num_object_clones":0,"num_object_copies":4671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12456,"num_write_kb":99648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'12904","reported_seq":12934,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.713502+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:21:14.713502+0000","last_peered":"2026-02-24T08:21:14.713502+0000","last_clean":"2026-02-24T08:21:14.713502+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:14.713502+0000","last_undegraded":"2026-02-24T08:21:14.713502+0000","last_fullsized":"2026-02-24T08:21:14.713502+0000","mapping_epoch":27,"log_start":"29'2900","ondisk_log_start":"29'2900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105709568,"num_objects":1613,"num_object_clones":0,"num_object_copies":4839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1613,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12904,"num_write_kb":103232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'12640","reported_seq":12670,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.777582+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:21:14.777582+0000","last_peered":"2026-02-24T08:21:14.777582+0000","last_clean":"2026-02-24T08:21:14.777582+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:14.777582+0000","last_undegraded":"2026-02-24T08:21:14.777582+0000","last_fullsized":"2026-02-24T08:21:14.777582+0000","mapping_epoch":27,"log_start":"29'2600","ondisk_log_start":"29'2600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103546880,"num_objects":1580,"num_object_clones":0,"num_object_copies":4740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12640,"num_write_kb":101120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'12040","reported_seq":12070,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.754824+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:21:14.754824+0000","last_peered":"2026-02-24T08:21:14.754824+0000","last_clean":"2026-02-24T08:21:14.754824+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:14.754824+0000","last_undegraded":"2026-02-24T08:21:14.754824+0000","last_fullsized":"2026-02-24T08:21:14.754824+0000","mapping_epoch":27,"log_start":"29'2000","ondisk_log_start":"29'2000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98631680,"num_objects":1505,"num_object_clones":0,"num_object_copies":4515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12040,"num_write_kb":96320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'12512","reported_seq":12542,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.736062+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:14.736062+0000","last_peered":"2026-02-24T08:21:14.736062+0000","last_clean":"2026-02-24T08:21:14.736062+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:14.736062+0000","last_undegraded":"2026-02-24T08:21:14.736062+0000","last_fullsized":"2026-02-24T08:21:14.736062+0000","mapping_epoch":27,"log_start":"29'2500","ondisk_log_start":"29'2500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102498304,"num_objects":1564,"num_object_clones":0,"num_object_copies":4692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12512,"num_write_kb":100096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'13032","reported_seq":13062,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.746111+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:21:14.746111+0000","last_peered":"2026-02-24T08:21:14.746111+0000","last_clean":"2026-02-24T08:21:14.746111+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:14.746111+0000","last_undegraded":"2026-02-24T08:21:14.746111+0000","last_fullsized":"2026-02-24T08:21:14.746111+0000","mapping_epoch":27,"log_start":"29'3000","ondisk_log_start":"29'3000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106758144,"num_objects":1629,"num_object_clones":0,"num_object_copies":4887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13032,"num_write_kb":104256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'11736","reported_seq":11766,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.744400+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:21:14.744400+0000","last_peered":"2026-02-24T08:21:14.744400+0000","last_clean":"2026-02-24T08:21:14.744400+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:14.744400+0000","last_undegraded":"2026-02-24T08:21:14.744400+0000","last_fullsized":"2026-02-24T08:21:14.744400+0000","mapping_epoch":27,"log_start":"29'1700","ondisk_log_start":"29'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96141312,"num_objects":1467,"num_object_clones":0,"num_object_copies":4401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1467,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11736,"num_write_kb":93888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'12504","reported_seq":12534,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.764172+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:21:14.764172+0000","last_peered":"2026-02-24T08:21:14.764172+0000","last_clean":"2026-02-24T08:21:14.764172+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:14.764172+0000","last_undegraded":"2026-02-24T08:21:14.764172+0000","last_fullsized":"2026-02-24T08:21:14.764172+0000","mapping_epoch":27,"log_start":"29'2500","ondisk_log_start":"29'2500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102432768,"num_objects":1563,"num_object_clones":0,"num_object_copies":4689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1563,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12504,"num_write_kb":100032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'12328","reported_seq":12358,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.771089+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:14.771089+0000","last_peered":"2026-02-24T08:21:14.771089+0000","last_clean":"2026-02-24T08:21:14.771089+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:14.771089+0000","last_undegraded":"2026-02-24T08:21:14.771089+0000","last_fullsized":"2026-02-24T08:21:14.771089+0000","mapping_epoch":27,"log_start":"29'2300","ondisk_log_start":"29'2300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100990976,"num_objects":1541,"num_object_clones":0,"num_object_copies":4623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1541,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12328,"num_write_kb":98624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'12744","reported_seq":12774,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:14.731008+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:21:14.731008+0000","last_peered":"2026-02-24T08:21:14.731008+0000","last_clean":"2026-02-24T08:21:14.731008+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:14.731008+0000","last_undegraded":"2026-02-24T08:21:14.731008+0000","last_fullsized":"2026-02-24T08:21:14.731008+0000","mapping_epoch":27,"log_start":"29'2700","ondisk_log_start":"29'2700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104398848,"num_objects":1593,"num_object_clones":0,"num_object_copies":4779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12744,"num_write_kb":101952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":1632370688,"num_objects":24909,"num_object_clones":0,"num_object_copies":74727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199264,"num_write_kb":1594112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4895145984,"data_stored":4895145984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160564,"ondisk_log_size":160564,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247821,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1670892,"kb_used_data":1391248,"kb_used_omap":13,"kb_used_meta":279602,"kb_avail":732332308,"statfs":{"total":751619276800,"available":749908283392,"internally_reserved":0,"allocated":1424637952,"data_stored":1424403791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13341,"internal_metadata":286313443},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444047,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1308860,"kb_used_data":1083304,"kb_used_omap":16,"kb_used_meta":225519,"kb_avail":732694340,"statfs":{"total":751619276800,"available":750279004160,"internally_reserved":0,"allocated":1109303296,"data_stored":1109069135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":230931615},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,1,0,0,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1455920,"kb_used_data":1194332,"kb_used_omap":19,"kb_used_meta":261548,"kb_avail":732547280,"statfs":{"total":751619276800,"available":750128414720,"internally_reserved":0,"allocated":1222995968,"data_stored":1222765359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":267825779},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,2,4,6,16,17,18,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1331708,"kb_used_data":1088168,"kb_used_omap":21,"kb_used_meta":243498,"kb_avail":732671492,"statfs":{"total":751619276800,"available":750255607808,"internally_reserved":0,"allocated":1114284032,"data_stored":1114049871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":249342023},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1114177536,"data_stored":1114177536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1232994304,"data_stored":1232994304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1121181696,"data_stored":1121181696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1426792448,"data_stored":1426792448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:18.970 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:21:18.971 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 56 2026-02-24T08:21:19.097 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:19.160 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:19.247 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:19.245+0000 7fc793ae7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:19.247 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:19.245+0000 7fc793ae7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:19.260 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:19.261 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:19.275 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:19.275 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:19.290 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:19.291 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:19.291 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:19.289+0000 7fa94fc43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:19.291 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:19.289+0000 7fa94fc43640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:19.306 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:19.307 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:19.453 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:21:19.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:21:19.747 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:21:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:21:19] "GET /metrics HTTP/1.1" 200 4206 "" "Prometheus/3.6.0" 2026-02-24T08:21:19.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:21:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:21:19.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:21:19.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 42 128 218262 218134 40.5719 28.4453 0.0101376 0.0246296 2026-02-24T08:21:20.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:19 trial105 ceph-mon[39442]: pgmap v39: 17 pgs: 17 active+clean; 1.5 GiB data, 5.5 GiB used, 2.7 TiB / 2.7 TiB avail; 16 MiB/s wr, 2.06k op/s 2026-02-24T08:21:20.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/893602981' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:20.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/247951912' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T08:21:20.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 43 128 222129 222001 40.3309 30.2109 0.0114425 0.0247813 2026-02-24T08:21:21.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:20 trial105 ceph-mon[39442]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:21.352 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:21.494 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:21.621 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:21.618+0000 7fa9f0722640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:21.621 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:21.619+0000 7fa9f0722640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:21.635 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:21.636 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:21.649 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:21.649 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:21.664 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:21.665 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:21.677 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:21.677 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:21.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:21 trial105 ceph-mon[39442]: pgmap v40: 17 pgs: 17 active+clean; 1.7 GiB data, 6.0 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.61k op/s 2026-02-24T08:21:21.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1040619984' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:21.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 44 128 225867 225739 40.0779 29.2031 0.0417091 0.0249383 2026-02-24T08:21:22.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 45 128 229520 229392 39.8215 28.5391 0.0278413 0.0250981 2026-02-24T08:21:23.728 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:23.864 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:23.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 46 128 233245 233117 39.5884 29.1016 0.0275419 0.025245 2026-02-24T08:21:24.082 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:23 trial105 ceph-mon[39442]: pgmap v41: 17 pgs: 17 active+clean; 1.7 GiB data, 6.0 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.09k op/s 2026-02-24T08:21:24.220 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:24.217+0000 7f19caca9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:24.220 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:24.217+0000 7f19caca9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:24.237 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:24.237 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:24.253 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:24.253 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:24.266 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:24.267 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:24.283 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:24.283 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:24.493 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:21:24.494 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:21:24.494 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:21:24.494 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:24.762 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:24.788 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1038273614' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:24.895 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:24.891+0000 7fbae28fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:24.895 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:24.892+0000 7fbae28fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:24.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 47 128 236155 236027 39.2297 22.7344 0.0631517 0.025474 2026-02-24T08:21:25.035 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:25.036 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:25.097 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2026-02-24T08:21:24.694042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1782407712,"num_objects":27192,"num_object_clones":0,"num_object_copies":81576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27192,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":217642,"num_write_kb":1742206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160806,"ondisk_log_size":160806,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6329244,"kb_used_data":5174604,"kb_used_omap":71,"kb_used_meta":1154488,"kb_avail":2929683556,"statfs":{"total":3006477107200,"available":2999995961344,"internally_reserved":0,"allocated":5298794496,"data_stored":5297861404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72900,"internal_metadata":1182196540},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,7,5,3,0,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":295526400,"num_objects":4509,"num_object_clones":0,"num_object_copies":13527,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4509,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36075,"num_write_kb":288600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001506"},"pg_stats":[{"pgid":"2.f","version":"37'13304","reported_seq":13333,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.727959+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:19.727959+0000","last_peered":"2026-02-24T08:21:19.727959+0000","last_clean":"2026-02-24T08:21:19.727959+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:19.727959+0000","last_undegraded":"2026-02-24T08:21:19.727959+0000","last_fullsized":"2026-02-24T08:21:19.727959+0000","mapping_epoch":27,"log_start":"29'3300","ondisk_log_start":"29'3300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108986368,"num_objects":1663,"num_object_clones":0,"num_object_copies":4989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1663,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13304,"num_write_kb":106432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'13687","reported_seq":13716,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.798106+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:21:19.798106+0000","last_peered":"2026-02-24T08:21:19.798106+0000","last_clean":"2026-02-24T08:21:19.798106+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:19.798106+0000","last_undegraded":"2026-02-24T08:21:19.798106+0000","last_fullsized":"2026-02-24T08:21:19.798106+0000","mapping_epoch":27,"log_start":"30'3600","ondisk_log_start":"30'3600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112123904,"num_objects":1711,"num_object_clones":0,"num_object_copies":5133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13687,"num_write_kb":109496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'14008","reported_seq":14031,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.795618+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:19.795618+0000","last_peered":"2026-02-24T08:21:19.795618+0000","last_clean":"2026-02-24T08:21:19.795618+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:19.795618+0000","last_undegraded":"2026-02-24T08:21:19.795618+0000","last_fullsized":"2026-02-24T08:21:19.795618+0000","mapping_epoch":27,"log_start":"30'4000","ondisk_log_start":"30'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114753536,"num_objects":1751,"num_object_clones":0,"num_object_copies":5253,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1751,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14008,"num_write_kb":112064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'13394","reported_seq":13424,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.793968+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:21:19.793968+0000","last_peered":"2026-02-24T08:21:19.793968+0000","last_clean":"2026-02-24T08:21:19.793968+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:19.793968+0000","last_undegraded":"2026-02-24T08:21:19.793968+0000","last_fullsized":"2026-02-24T08:21:19.793968+0000","mapping_epoch":27,"log_start":"29'3300","ondisk_log_start":"29'3300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109723648,"num_objects":1675,"num_object_clones":0,"num_object_copies":5025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1675,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13394,"num_write_kb":107152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:11.029053+0000","last_change":"2026-02-24T08:20:22.236303+0000","last_active":"2026-02-24T08:21:11.029053+0000","last_peered":"2026-02-24T08:21:11.029053+0000","last_clean":"2026-02-24T08:21:11.029053+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:11.029053+0000","last_undegraded":"2026-02-24T08:21:11.029053+0000","last_fullsized":"2026-02-24T08:21:11.029053+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:20:11.945878+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:23.754149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'13552","reported_seq":13582,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.651069+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:21:19.651069+0000","last_peered":"2026-02-24T08:21:19.651069+0000","last_clean":"2026-02-24T08:21:19.651069+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:19.651069+0000","last_undegraded":"2026-02-24T08:21:19.651069+0000","last_fullsized":"2026-02-24T08:21:19.651069+0000","mapping_epoch":27,"log_start":"29'3500","ondisk_log_start":"29'3500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111017984,"num_objects":1694,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13552,"num_write_kb":108416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'13410","reported_seq":13437,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.764302+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:21:19.764302+0000","last_peered":"2026-02-24T08:21:19.764302+0000","last_clean":"2026-02-24T08:21:19.764302+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:19.764302+0000","last_undegraded":"2026-02-24T08:21:19.764302+0000","last_fullsized":"2026-02-24T08:21:19.764302+0000","mapping_epoch":27,"log_start":"29'3400","ondisk_log_start":"29'3400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109854720,"num_objects":1677,"num_object_clones":0,"num_object_copies":5031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1677,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13410,"num_write_kb":107280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'13672","reported_seq":13700,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.795812+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:19.795812+0000","last_peered":"2026-02-24T08:21:19.795812+0000","last_clean":"2026-02-24T08:21:19.795812+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:19.795812+0000","last_undegraded":"2026-02-24T08:21:19.795812+0000","last_fullsized":"2026-02-24T08:21:19.795812+0000","mapping_epoch":27,"log_start":"30'3600","ondisk_log_start":"30'3600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112001024,"num_objects":1709,"num_object_clones":0,"num_object_copies":5127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13672,"num_write_kb":109376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'14032","reported_seq":14062,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.764076+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:21:19.764076+0000","last_peered":"2026-02-24T08:21:19.764076+0000","last_clean":"2026-02-24T08:21:19.764076+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:19.764076+0000","last_undegraded":"2026-02-24T08:21:19.764076+0000","last_fullsized":"2026-02-24T08:21:19.764076+0000","mapping_epoch":27,"log_start":"30'4000","ondisk_log_start":"30'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114950144,"num_objects":1754,"num_object_clones":0,"num_object_copies":5262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14032,"num_write_kb":112256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'13960","reported_seq":13990,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.738246+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:21:19.738246+0000","last_peered":"2026-02-24T08:21:19.738246+0000","last_clean":"2026-02-24T08:21:19.738246+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:19.738246+0000","last_undegraded":"2026-02-24T08:21:19.738246+0000","last_fullsized":"2026-02-24T08:21:19.738246+0000","mapping_epoch":27,"log_start":"30'3900","ondisk_log_start":"30'3900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114360320,"num_objects":1745,"num_object_clones":0,"num_object_copies":5235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13960,"num_write_kb":111680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'13048","reported_seq":13076,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.764843+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:21:19.764843+0000","last_peered":"2026-02-24T08:21:19.764843+0000","last_clean":"2026-02-24T08:21:19.764843+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:19.764843+0000","last_undegraded":"2026-02-24T08:21:19.764843+0000","last_fullsized":"2026-02-24T08:21:19.764843+0000","mapping_epoch":27,"log_start":"29'3000","ondisk_log_start":"29'3000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106889216,"num_objects":1631,"num_object_clones":0,"num_object_copies":4893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13048,"num_write_kb":104384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'13712","reported_seq":13742,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.788707+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:19.788707+0000","last_peered":"2026-02-24T08:21:19.788707+0000","last_clean":"2026-02-24T08:21:19.788707+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:19.788707+0000","last_undegraded":"2026-02-24T08:21:19.788707+0000","last_fullsized":"2026-02-24T08:21:19.788707+0000","mapping_epoch":27,"log_start":"29'3700","ondisk_log_start":"29'3700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112328704,"num_objects":1714,"num_object_clones":0,"num_object_copies":5142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1714,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13712,"num_write_kb":109696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'14000","reported_seq":14026,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.766472+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:21:19.766472+0000","last_peered":"2026-02-24T08:21:19.766472+0000","last_clean":"2026-02-24T08:21:19.766472+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:19.766472+0000","last_undegraded":"2026-02-24T08:21:19.766472+0000","last_fullsized":"2026-02-24T08:21:19.766472+0000","mapping_epoch":27,"log_start":"30'3900","ondisk_log_start":"30'3900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114688000,"num_objects":1750,"num_object_clones":0,"num_object_copies":5250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1750,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14000,"num_write_kb":112000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'12808","reported_seq":12838,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.749974+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:21:19.749974+0000","last_peered":"2026-02-24T08:21:19.749974+0000","last_clean":"2026-02-24T08:21:19.749974+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:19.749974+0000","last_undegraded":"2026-02-24T08:21:19.749974+0000","last_fullsized":"2026-02-24T08:21:19.749974+0000","mapping_epoch":27,"log_start":"29'2800","ondisk_log_start":"29'2800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104923136,"num_objects":1601,"num_object_clones":0,"num_object_copies":4803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12808,"num_write_kb":102464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'13704","reported_seq":13734,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.712800+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:21:19.712800+0000","last_peered":"2026-02-24T08:21:19.712800+0000","last_clean":"2026-02-24T08:21:19.712800+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:19.712800+0000","last_undegraded":"2026-02-24T08:21:19.712800+0000","last_fullsized":"2026-02-24T08:21:19.712800+0000","mapping_epoch":27,"log_start":"30'3700","ondisk_log_start":"30'3700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112263168,"num_objects":1713,"num_object_clones":0,"num_object_copies":5139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1713,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13704,"num_write_kb":109632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'13384","reported_seq":13414,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.795863+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:19.795863+0000","last_peered":"2026-02-24T08:21:19.795863+0000","last_clean":"2026-02-24T08:21:19.795863+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:19.795863+0000","last_undegraded":"2026-02-24T08:21:19.795863+0000","last_fullsized":"2026-02-24T08:21:19.795863+0000","mapping_epoch":27,"log_start":"29'3300","ondisk_log_start":"29'3300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109641728,"num_objects":1673,"num_object_clones":0,"num_object_copies":5019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13384,"num_write_kb":107072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'13832","reported_seq":13862,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:19.766427+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:21:19.766427+0000","last_peered":"2026-02-24T08:21:19.766427+0000","last_clean":"2026-02-24T08:21:19.766427+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:19.766427+0000","last_undegraded":"2026-02-24T08:21:19.766427+0000","last_fullsized":"2026-02-24T08:21:19.766427+0000","mapping_epoch":27,"log_start":"30'3800","ondisk_log_start":"30'3800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113311744,"num_objects":1729,"num_object_clones":0,"num_object_copies":5187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13832,"num_write_kb":110656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":1781817344,"num_objects":27190,"num_object_clones":0,"num_object_copies":81570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217507,"num_write_kb":1740056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5342830592,"data_stored":5342830592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160707,"ondisk_log_size":160707,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247822,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1868548,"kb_used_data":1516720,"kb_used_omap":13,"kb_used_meta":351794,"kb_avail":732134652,"statfs":{"total":751619276800,"available":749705883648,"internally_reserved":0,"allocated":1553121280,"data_stored":1552887119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13341,"internal_metadata":360238051},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444048,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1444812,"kb_used_data":1183224,"kb_used_omap":16,"kb_used_meta":261551,"kb_avail":732558388,"statfs":{"total":751619276800,"available":750139789312,"internally_reserved":0,"allocated":1211621376,"data_stored":1211387215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17249,"internal_metadata":267828383},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,4,4,2,0,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1583472,"kb_used_data":1303836,"kb_used_omap":19,"kb_used_meta":279596,"kb_avail":732419728,"statfs":{"total":751619276800,"available":749997801472,"internally_reserved":0,"allocated":1335128064,"data_stored":1334897455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":286306931},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1432412,"kb_used_data":1170824,"kb_used_omap":21,"kb_used_meta":261546,"kb_avail":732570788,"statfs":{"total":751619276800,"available":750152486912,"internally_reserved":0,"allocated":1198923776,"data_stored":1198689615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":267823175},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1217789952,"data_stored":1217789952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1347952640,"data_stored":1347952640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1222115328,"data_stored":1222115328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1554972672,"data_stored":1554972672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:25.099 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:21:25.099 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 21 2026-02-24T08:21:25.278 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:25.410 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:25.406+0000 7f9a558b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:25.410 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:25.407+0000 7f9a558b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:25.561 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:21:25.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:21:25.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:25 trial105 ceph-mon[39442]: pgmap v42: 17 pgs: 17 active+clean; 1.7 GiB data, 6.0 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 3.00k op/s 2026-02-24T08:21:25.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:25 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:21:25.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:25 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:21:25.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3724806940' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "21"} : dispatch 2026-02-24T08:21:25.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 48 128 239800 239672 39.0057 28.4766 0.020179 0.0256223 2026-02-24T08:21:26.760 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:26.907 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:26.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 49 128 243568 243440 38.8104 29.4375 0.0694394 0.0257544 2026-02-24T08:21:27.028 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:26 trial105 ceph-mon[39442]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:27.037 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:27.034+0000 7f7dc56a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:27.038 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:27.036+0000 7f7dc56a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:27.056 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:27.057 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:27.072 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:27.072 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:27.086 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:27.086 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:27.100 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:27.100 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:27.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 50 128 247282 247154 38.6144 29.0156 0.0219209 0.0258873 2026-02-24T08:21:28.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:27 trial105 ceph-mon[39442]: pgmap v43: 17 pgs: 17 active+clean; 1.8 GiB data, 6.5 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.50k op/s 2026-02-24T08:21:28.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1958741531' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:28.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 51 128 250965 250837 38.4214 28.7734 0.0644386 0.0260149 2026-02-24T08:21:29.147 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:29.172 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:28 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:21:29.172 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:28 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:21:29.291 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:29.419 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:29.416+0000 7fe6ba095640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:29.419 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:29.417+0000 7fe6ba095640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:29.435 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:29.435 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:29.451 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:29.451 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:29.468 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:29.468 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:29.486 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:29.486 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:29.688 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:21:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:21:29] "GET /metrics HTTP/1.1" 200 4210 "" "Prometheus/3.6.0" 2026-02-24T08:21:29.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:21:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:21:29.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:21:29.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 52 128 254551 254423 38.2213 28.0156 0.0277679 0.0261511 2026-02-24T08:21:30.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:29 trial105 ceph-mon[39442]: pgmap v44: 17 pgs: 17 active+clean; 1.8 GiB data, 6.5 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.02k op/s 2026-02-24T08:21:30.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:21:30.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4200969520' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:30.608 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:21:30.608 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:21:30.608 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2026-02-24T08:21:30.608 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:30.760 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:30.888 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:30.886+0000 7f0443e12640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:30.888 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:30.886+0000 7f0443e12640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:30.960 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 53 128 258225 258097 38.0416 28.7031 0.0660802 0.0262723 2026-02-24T08:21:31.027 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:31.027 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:31.069 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2026-02-24T08:21:30.694799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2080571936,"num_objects":31743,"num_object_clones":0,"num_object_copies":95229,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31743,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":254039,"num_write_kb":2033382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161003,"ondisk_log_size":161003,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7402604,"kb_used_data":6049436,"kb_used_omap":71,"kb_used_meta":1353016,"kb_avail":2928610196,"statfs":{"total":3006477107200,"available":2998896840704,"internally_reserved":0,"allocated":6194622464,"data_stored":6193689372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73551,"internal_metadata":1385488561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,7,12,5,12,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":447610880,"num_objects":6832,"num_object_clones":0,"num_object_copies":20496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54640,"num_write_kb":437120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001497"},"pg_stats":[{"pgid":"2.f","version":"37'15600","reported_seq":15630,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.732222+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:29.732222+0000","last_peered":"2026-02-24T08:21:29.732222+0000","last_clean":"2026-02-24T08:21:29.732222+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:29.732222+0000","last_undegraded":"2026-02-24T08:21:29.732222+0000","last_fullsized":"2026-02-24T08:21:29.732222+0000","mapping_epoch":27,"log_start":"33'5500","ondisk_log_start":"33'5500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127795200,"num_objects":1950,"num_object_clones":0,"num_object_copies":5850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15600,"num_write_kb":124800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'16056","reported_seq":16086,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.811158+0000","last_change":"2026-02-24T08:20:36.865600+0000","last_active":"2026-02-24T08:21:29.811158+0000","last_peered":"2026-02-24T08:21:29.811158+0000","last_clean":"2026-02-24T08:21:29.811158+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:29.811158+0000","last_undegraded":"2026-02-24T08:21:29.811158+0000","last_fullsized":"2026-02-24T08:21:29.811158+0000","mapping_epoch":27,"log_start":"33'6000","ondisk_log_start":"33'6000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.919964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131530752,"num_objects":2007,"num_object_clones":0,"num_object_copies":6021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2007,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16056,"num_write_kb":128448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'16275","reported_seq":16298,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.821907+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:29.821907+0000","last_peered":"2026-02-24T08:21:29.821907+0000","last_clean":"2026-02-24T08:21:29.821907+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:29.821907+0000","last_undegraded":"2026-02-24T08:21:29.821907+0000","last_fullsized":"2026-02-24T08:21:29.821907+0000","mapping_epoch":27,"log_start":"33'6200","ondisk_log_start":"33'6200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133324800,"num_objects":2035,"num_object_clones":0,"num_object_copies":6105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2035,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16275,"num_write_kb":130200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'15632","reported_seq":15662,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.822748+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:21:29.822748+0000","last_peered":"2026-02-24T08:21:29.822748+0000","last_clean":"2026-02-24T08:21:29.822748+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:29.822748+0000","last_undegraded":"2026-02-24T08:21:29.822748+0000","last_fullsized":"2026-02-24T08:21:29.822748+0000","mapping_epoch":27,"log_start":"33'5600","ondisk_log_start":"33'5600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128057344,"num_objects":1954,"num_object_clones":0,"num_object_copies":5862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15632,"num_write_kb":125056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:27.721605+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:21:27.721605+0000","last_peered":"2026-02-24T08:21:27.721605+0000","last_clean":"2026-02-24T08:21:27.721605+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:27.721605+0000","last_undegraded":"2026-02-24T08:21:27.721605+0000","last_fullsized":"2026-02-24T08:21:27.721605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'15672","reported_seq":15695,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.815050+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:21:29.815050+0000","last_peered":"2026-02-24T08:21:29.815050+0000","last_clean":"2026-02-24T08:21:29.815050+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:29.815050+0000","last_undegraded":"2026-02-24T08:21:29.815050+0000","last_fullsized":"2026-02-24T08:21:29.815050+0000","mapping_epoch":27,"log_start":"33'5600","ondisk_log_start":"33'5600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128385024,"num_objects":1959,"num_object_clones":0,"num_object_copies":5877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1959,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15672,"num_write_kb":125376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'15492","reported_seq":15516,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.806988+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:21:29.806988+0000","last_peered":"2026-02-24T08:21:29.806988+0000","last_clean":"2026-02-24T08:21:29.806988+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:29.806988+0000","last_undegraded":"2026-02-24T08:21:29.806988+0000","last_fullsized":"2026-02-24T08:21:29.806988+0000","mapping_epoch":27,"log_start":"33'5400","ondisk_log_start":"33'5400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:38.340134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126910464,"num_objects":1937,"num_object_clones":0,"num_object_copies":5811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15492,"num_write_kb":123936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'15848","reported_seq":15878,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.796971+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:29.796971+0000","last_peered":"2026-02-24T08:21:29.796971+0000","last_clean":"2026-02-24T08:21:29.796971+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:29.796971+0000","last_undegraded":"2026-02-24T08:21:29.796971+0000","last_fullsized":"2026-02-24T08:21:29.796971+0000","mapping_epoch":27,"log_start":"33'5800","ondisk_log_start":"33'5800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129826816,"num_objects":1981,"num_object_clones":0,"num_object_copies":5943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15848,"num_write_kb":126784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'16548","reported_seq":16578,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.810133+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:21:29.810133+0000","last_peered":"2026-02-24T08:21:29.810133+0000","last_clean":"2026-02-24T08:21:29.810133+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:29.810133+0000","last_undegraded":"2026-02-24T08:21:29.810133+0000","last_fullsized":"2026-02-24T08:21:29.810133+0000","mapping_epoch":27,"log_start":"33'6500","ondisk_log_start":"33'6500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135561216,"num_objects":2069,"num_object_clones":0,"num_object_copies":6207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16548,"num_write_kb":132384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'16074","reported_seq":16104,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.822373+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:21:29.822373+0000","last_peered":"2026-02-24T08:21:29.822373+0000","last_clean":"2026-02-24T08:21:29.822373+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:29.822373+0000","last_undegraded":"2026-02-24T08:21:29.822373+0000","last_fullsized":"2026-02-24T08:21:29.822373+0000","mapping_epoch":27,"log_start":"33'6000","ondisk_log_start":"33'6000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131678208,"num_objects":2010,"num_object_clones":0,"num_object_copies":6030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2010,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16074,"num_write_kb":128592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'15573","reported_seq":15603,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.807300+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:21:29.807300+0000","last_peered":"2026-02-24T08:21:29.807300+0000","last_clean":"2026-02-24T08:21:29.807300+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:29.807300+0000","last_undegraded":"2026-02-24T08:21:29.807300+0000","last_fullsized":"2026-02-24T08:21:29.807300+0000","mapping_epoch":27,"log_start":"33'5500","ondisk_log_start":"33'5500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127574016,"num_objects":1947,"num_object_clones":0,"num_object_copies":5841,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1947,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15573,"num_write_kb":124584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'15927","reported_seq":15956,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.825212+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:29.825212+0000","last_peered":"2026-02-24T08:21:29.825212+0000","last_clean":"2026-02-24T08:21:29.825212+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:29.825212+0000","last_undegraded":"2026-02-24T08:21:29.825212+0000","last_fullsized":"2026-02-24T08:21:29.825212+0000","mapping_epoch":27,"log_start":"33'5900","ondisk_log_start":"33'5900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130473984,"num_objects":1991,"num_object_clones":0,"num_object_copies":5973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1991,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15927,"num_write_kb":127416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'16512","reported_seq":16540,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.812443+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:21:29.812443+0000","last_peered":"2026-02-24T08:21:29.812443+0000","last_clean":"2026-02-24T08:21:29.812443+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:29.812443+0000","last_undegraded":"2026-02-24T08:21:29.812443+0000","last_fullsized":"2026-02-24T08:21:29.812443+0000","mapping_epoch":27,"log_start":"33'6500","ondisk_log_start":"33'6500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:37.833638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135266304,"num_objects":2064,"num_object_clones":0,"num_object_copies":6192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2064,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16512,"num_write_kb":132096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'15272","reported_seq":15302,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.750369+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:21:29.750369+0000","last_peered":"2026-02-24T08:21:29.750369+0000","last_clean":"2026-02-24T08:21:29.750369+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:29.750369+0000","last_undegraded":"2026-02-24T08:21:29.750369+0000","last_fullsized":"2026-02-24T08:21:29.750369+0000","mapping_epoch":27,"log_start":"33'5200","ondisk_log_start":"33'5200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125108224,"num_objects":1909,"num_object_clones":0,"num_object_copies":5727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15272,"num_write_kb":122176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'15903","reported_seq":15930,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.819970+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:21:29.819970+0000","last_peered":"2026-02-24T08:21:29.819970+0000","last_clean":"2026-02-24T08:21:29.819970+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:29.819970+0000","last_undegraded":"2026-02-24T08:21:29.819970+0000","last_fullsized":"2026-02-24T08:21:29.819970+0000","mapping_epoch":27,"log_start":"33'5900","ondisk_log_start":"33'5900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130277376,"num_objects":1988,"num_object_clones":0,"num_object_copies":5964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1988,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15903,"num_write_kb":127224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'15432","reported_seq":15459,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.820532+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:29.820532+0000","last_peered":"2026-02-24T08:21:29.820532+0000","last_clean":"2026-02-24T08:21:29.820532+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:29.820532+0000","last_undegraded":"2026-02-24T08:21:29.820532+0000","last_fullsized":"2026-02-24T08:21:29.820532+0000","mapping_epoch":27,"log_start":"33'5400","ondisk_log_start":"33'5400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126418944,"num_objects":1929,"num_object_clones":0,"num_object_copies":5787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15432,"num_write_kb":123456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'16088","reported_seq":16118,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:29.795030+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:21:29.795030+0000","last_peered":"2026-02-24T08:21:29.795030+0000","last_clean":"2026-02-24T08:21:29.795030+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:29.795030+0000","last_undegraded":"2026-02-24T08:21:29.795030+0000","last_fullsized":"2026-02-24T08:21:29.795030+0000","mapping_epoch":27,"log_start":"33'6000","ondisk_log_start":"33'6000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131792896,"num_objects":2011,"num_object_clones":0,"num_object_copies":6033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16088,"num_write_kb":128704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2079981568,"num_objects":31741,"num_object_clones":0,"num_object_copies":95223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31741,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253904,"num_write_kb":2031232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6236659712,"data_stored":6236659712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160904,"ondisk_log_size":160904,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247824,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2178044,"kb_used_data":1772072,"kb_used_omap":13,"kb_used_meta":405938,"kb_avail":731825156,"statfs":{"total":751619276800,"available":749388959744,"internally_reserved":0,"allocated":1814601728,"data_stored":1814367567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13341,"internal_metadata":415681507},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444050,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1687380,"kb_used_data":1389696,"kb_used_omap":17,"kb_used_meta":297646,"kb_avail":732315820,"statfs":{"total":751619276800,"available":749891399680,"internally_reserved":0,"allocated":1423048704,"data_stored":1422814543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":304790036},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1868656,"kb_used_data":1516828,"kb_used_omap":19,"kb_used_meta":351788,"kb_avail":732134544,"statfs":{"total":751619276800,"available":749705773056,"internally_reserved":0,"allocated":1553231872,"data_stored":1553001263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":360231539},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,6,9,5,12,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705686,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1668524,"kb_used_data":1370840,"kb_used_omap":21,"kb_used_meta":297642,"kb_avail":732334676,"statfs":{"total":751619276800,"available":749910708224,"internally_reserved":0,"allocated":1403740160,"data_stored":1403505999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":304785479},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1422123008,"data_stored":1422123008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1567924224,"data_stored":1567924224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1429848064,"data_stored":1429848064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1816764416,"data_stored":1816764416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:31.071 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_0 pgp_num 56 2026-02-24T08:21:31.214 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:31.340 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:31.336+0000 7fd6cccde640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:31.340 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:31.337+0000 7fd6cccde640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:31.486 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:21:31.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:21:31.530 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:31.682 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:31.811 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:31.808+0000 7f14aa450640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:31.811 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:31.808+0000 7f14aa450640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:31.827 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:31.827 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:31.842 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:31.842 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:31.856 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:31.857 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:31.869 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:31.870 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:31.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 54 128 261591 261463 37.8241 26.2969 0.0545678 0.0264209 2026-02-24T08:21:32.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:31 trial105 ceph-mon[39442]: pgmap v45: 17 pgs: 17 active+clean; 1.9 GiB data, 7.1 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.55k op/s 2026-02-24T08:21:32.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:31 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2130601547' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pgp_num", "val": "56"} : dispatch 2026-02-24T08:21:32.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 55 128 265395 265267 37.6767 29.7188 0.0684512 0.0265283 2026-02-24T08:21:33.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:32 trial105 ceph-mon[39442]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:33.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:32 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/783442868' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:33.911 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:33.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 56 128 269214 269086 37.5367 29.8359 0.0194967 0.0266287 2026-02-24T08:21:34.061 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:34.087 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:33 trial105 ceph-mon[39442]: pgmap v46: 17 pgs: 17 active+clean; 1.9 GiB data, 7.1 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.03k op/s 2026-02-24T08:21:34.185 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:34.181+0000 7f5cbf05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:34.185 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:34.182+0000 7f5cbf05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:34.201 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:34.201 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:34.215 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:34.216 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:34.232 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:34.232 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:34.246 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:34.246 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:34.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 57 128 272842 272714 37.3753 28.3438 0.0301938 0.0267452 2026-02-24T08:21:35.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/625866285' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:35.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:34 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:21:35.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 58 128 276608 276480 37.2382 29.4219 0.0146673 0.0268397 2026-02-24T08:21:36.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:35 trial105 ceph-mon[39442]: pgmap v47: 17 pgs: 17 active+clean; 1.9 GiB data, 7.1 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.03k op/s 2026-02-24T08:21:36.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:21:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:21:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:21:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:21:36.290 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:36.438 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:36.530 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:21:36.531 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:21:36.531 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:21:36.531 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:21:36.564 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:36.562+0000 7f9e4824b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:36.564 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:36.562+0000 7f9e4824b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:36.580 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:36.580 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:36.595 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:36.595 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:36.607 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:36.607 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:36.621 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:36.621 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:36.683 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:36.803 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:36.801+0000 7f13966f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:36.803 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:36.801+0000 7f13966f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:36.824 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:21:36.824 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:21:36.824 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:21:36.824 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:21:36.824 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:21:36.824 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:21:36.824 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:21:36.824 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:21:36.825 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:21:36.825 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:21:36.825 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:21:36.825 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:21:36.836 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:36 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1599764401' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:36.863 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:21:36.864 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:21:36.865 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:21:36.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 59 128 280230 280102 37.0866 28.2969 0.0143757 0.0269525 2026-02-24T08:21:37.055 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:37.181 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:37.179+0000 7f1dcfe76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:37.181 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:37.179+0000 7f1dcfe76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:37.202 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:21:37.202 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:21:37.203 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:21:37.237 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:21:37.238 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:21:37.238 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:21:37.390 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:37.521 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:37.519+0000 7ff943810640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:37.522 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:37.520+0000 7ff943810640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:37.542 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:21:37.542 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:21:37.543 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:21:37.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:21:37.579 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:21:37.579 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:21:37.718 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:37.843 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:37.841+0000 7f46b2b4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:37.843 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:37.841+0000 7f46b2b4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:37.865 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:21:37.865 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:21:37.866 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:21:37.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:21:37.907 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:21:37.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:21:37.960892+0000 min lat: 0.000730736 max lat: 0.19461 avg lat: 0.0270702 2026-02-24T08:21:37.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:21:37.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 60 128 283743 283615 36.9259 27.4453 0.0141697 0.0270702 2026-02-24T08:21:38.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:37 trial105 ceph-mon[39442]: pgmap v48: 17 pgs: 17 active+clean; 2.1 GiB data, 7.6 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.56k op/s 2026-02-24T08:21:38.669 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:38.815 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:38.932 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:38.930+0000 7f0d3b385640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:38.932 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:38.930+0000 7f0d3b385640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:38.948 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:38.948 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:38.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 61 128 287436 287308 36.7935 28.8516 0.0717366 0.0271645 2026-02-24T08:21:38.963 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:38.963 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:38.977 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:38.977 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:38.992 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:38.992 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:39.840 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:21:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:21:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:21:39.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:39 trial105 ceph-mon[39442]: pgmap v49: 17 pgs: 17 active+clean; 2.1 GiB data, 7.6 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.06k op/s 2026-02-24T08:21:39.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:39 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2933990850' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:39.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:39 trial105 ceph-mon[39442]: 2.e scrub starts 2026-02-24T08:21:39.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:21:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:21:39] "GET /metrics HTTP/1.1" 200 4210 "" "Prometheus/3.6.0" 2026-02-24T08:21:39.961 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 62 128 290982 290854 36.6468 27.7031 0.0153284 0.0272745 2026-02-24T08:21:40.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 63 128 294571 294443 36.5101 28.0391 0.0176473 0.0273762 2026-02-24T08:21:41.034 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:41.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:40 trial105 ceph-mon[39442]: 2.e scrub ok 2026-02-24T08:21:41.183 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:41.309 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:41.307+0000 7f513a0f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:41.309 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:41.308+0000 7f513a0f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:41.329 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:41.329 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:41.342 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:41.342 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:41.358 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:41.358 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:41.371 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:41.371 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:41.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 64 128 298243 298115 36.3879 28.6875 0.0374173 0.0274702 2026-02-24T08:21:42.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:41 trial105 ceph-mon[39442]: pgmap v50: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.2 GiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.58k op/s 2026-02-24T08:21:42.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:41 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/687134032' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:42.908 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:21:42.908 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:21:42.908 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T08:21:42.908 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:42.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 65 128 301718 301590 36.2457 27.1484 0.0608946 0.0275772 2026-02-24T08:21:43.059 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:43.086 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:42 trial105 ceph-mon[39442]: 2.5 scrub starts 2026-02-24T08:21:43.086 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:42 trial105 ceph-mon[39442]: 2.9 scrub starts 2026-02-24T08:21:43.086 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:42 trial105 ceph-mon[39442]: 2.5 scrub ok 2026-02-24T08:21:43.191 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:43.188+0000 7fbe03675640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:43.191 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:43.188+0000 7fbe03675640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:43.338 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:43.339 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:43.385 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2026-02-24T08:21:42.696421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2380046880,"num_objects":36311,"num_object_clones":0,"num_object_copies":108933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36311,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":290596,"num_write_kb":2325838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160860,"ondisk_log_size":160860,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8509308,"kb_used_data":6939556,"kb_used_omap":71,"kb_used_meta":1569592,"kb_avail":2927503492,"statfs":{"total":3006477107200,"available":2997763575808,"internally_reserved":0,"allocated":7106105344,"data_stored":7105172252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73551,"internal_metadata":1607262385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,5,7,11,10,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":299474944,"num_objects":4568,"num_object_clones":0,"num_object_copies":13704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36557,"num_write_kb":292456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001622"},"pg_stats":[{"pgid":"2.f","version":"37'17816","reported_seq":17846,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.718769+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:39.718769+0000","last_peered":"2026-02-24T08:21:39.718769+0000","last_clean":"2026-02-24T08:21:39.718769+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:39.718769+0000","last_undegraded":"2026-02-24T08:21:39.718769+0000","last_fullsized":"2026-02-24T08:21:39.718769+0000","mapping_epoch":27,"log_start":"33'7800","ondisk_log_start":"33'7800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145948672,"num_objects":2227,"num_object_clones":0,"num_object_copies":6681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2227,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17816,"num_write_kb":142528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'18274","reported_seq":18317,"reported_epoch":37,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:21:39.838887+0000","last_change":"2026-02-24T08:21:38.926261+0000","last_active":"2026-02-24T08:21:39.838887+0000","last_peered":"2026-02-24T08:21:39.838887+0000","last_clean":"2026-02-24T08:21:39.838887+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:39.838887+0000","last_undegraded":"2026-02-24T08:21:39.838887+0000","last_fullsized":"2026-02-24T08:21:39.838887+0000","mapping_epoch":27,"log_start":"33'8200","ondisk_log_start":"33'8200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":1000,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149700608,"num_objects":2285,"num_object_clones":0,"num_object_copies":6855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18274,"num_write_kb":146192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'18448","reported_seq":18478,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.842892+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:39.842892+0000","last_peered":"2026-02-24T08:21:39.842892+0000","last_clean":"2026-02-24T08:21:39.842892+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:39.842892+0000","last_undegraded":"2026-02-24T08:21:39.842892+0000","last_fullsized":"2026-02-24T08:21:39.842892+0000","mapping_epoch":27,"log_start":"33'8400","ondisk_log_start":"33'8400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151126016,"num_objects":2306,"num_object_clones":0,"num_object_copies":6918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18448,"num_write_kb":147584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'17752","reported_seq":17782,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.840639+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:21:39.840639+0000","last_peered":"2026-02-24T08:21:39.840639+0000","last_clean":"2026-02-24T08:21:39.840639+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:39.840639+0000","last_undegraded":"2026-02-24T08:21:39.840639+0000","last_fullsized":"2026-02-24T08:21:39.840639+0000","mapping_epoch":27,"log_start":"33'7700","ondisk_log_start":"33'7700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145424384,"num_objects":2219,"num_object_clones":0,"num_object_copies":6657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17752,"num_write_kb":142016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:27.721605+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:21:27.721605+0000","last_peered":"2026-02-24T08:21:27.721605+0000","last_clean":"2026-02-24T08:21:27.721605+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:27.721605+0000","last_undegraded":"2026-02-24T08:21:27.721605+0000","last_fullsized":"2026-02-24T08:21:27.721605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'18096","reported_seq":18126,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.841644+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:21:39.841644+0000","last_peered":"2026-02-24T08:21:39.841644+0000","last_clean":"2026-02-24T08:21:39.841644+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:39.841644+0000","last_undegraded":"2026-02-24T08:21:39.841644+0000","last_fullsized":"2026-02-24T08:21:39.841644+0000","mapping_epoch":27,"log_start":"33'8000","ondisk_log_start":"33'8000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:42.729437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148242432,"num_objects":2262,"num_object_clones":0,"num_object_copies":6786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18096,"num_write_kb":144768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'17776","reported_seq":17806,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.839579+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:21:39.839579+0000","last_peered":"2026-02-24T08:21:39.839579+0000","last_clean":"2026-02-24T08:21:39.839579+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:39.839579+0000","last_undegraded":"2026-02-24T08:21:39.839579+0000","last_fullsized":"2026-02-24T08:21:39.839579+0000","mapping_epoch":27,"log_start":"33'7700","ondisk_log_start":"33'7700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145620992,"num_objects":2222,"num_object_clones":0,"num_object_copies":6666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17776,"num_write_kb":142208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'18152","reported_seq":18182,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.841845+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:39.841845+0000","last_peered":"2026-02-24T08:21:39.841845+0000","last_clean":"2026-02-24T08:21:39.841845+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:39.841845+0000","last_undegraded":"2026-02-24T08:21:39.841845+0000","last_fullsized":"2026-02-24T08:21:39.841845+0000","mapping_epoch":27,"log_start":"33'8100","ondisk_log_start":"33'8100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148701184,"num_objects":2269,"num_object_clones":0,"num_object_copies":6807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2269,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18152,"num_write_kb":145216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'18848","reported_seq":18878,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.836637+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:21:39.836637+0000","last_peered":"2026-02-24T08:21:39.836637+0000","last_clean":"2026-02-24T08:21:39.836637+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:39.836637+0000","last_undegraded":"2026-02-24T08:21:39.836637+0000","last_fullsized":"2026-02-24T08:21:39.836637+0000","mapping_epoch":27,"log_start":"33'8800","ondisk_log_start":"33'8800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.120263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154402816,"num_objects":2356,"num_object_clones":0,"num_object_copies":7068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18848,"num_write_kb":150784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'18435","reported_seq":18464,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.852375+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:21:39.852375+0000","last_peered":"2026-02-24T08:21:39.852375+0000","last_clean":"2026-02-24T08:21:39.852375+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:39.852375+0000","last_undegraded":"2026-02-24T08:21:39.852375+0000","last_fullsized":"2026-02-24T08:21:39.852375+0000","mapping_epoch":27,"log_start":"33'8400","ondisk_log_start":"33'8400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151019520,"num_objects":2305,"num_object_clones":0,"num_object_copies":6915,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18435,"num_write_kb":147480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'17920","reported_seq":17950,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.811725+0000","last_change":"2026-02-24T08:20:36.862351+0000","last_active":"2026-02-24T08:21:39.811725+0000","last_peered":"2026-02-24T08:21:39.811725+0000","last_clean":"2026-02-24T08:21:39.811725+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:39.811725+0000","last_undegraded":"2026-02-24T08:21:39.811725+0000","last_fullsized":"2026-02-24T08:21:39.811725+0000","mapping_epoch":27,"log_start":"33'7900","ondisk_log_start":"33'7900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":2240,"num_object_clones":0,"num_object_copies":6720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17920,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'18360","reported_seq":18389,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.857787+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:39.857787+0000","last_peered":"2026-02-24T08:21:39.857787+0000","last_clean":"2026-02-24T08:21:39.857787+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:39.857787+0000","last_undegraded":"2026-02-24T08:21:39.857787+0000","last_fullsized":"2026-02-24T08:21:39.857787+0000","mapping_epoch":27,"log_start":"33'8300","ondisk_log_start":"33'8300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150405120,"num_objects":2295,"num_object_clones":0,"num_object_copies":6885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2295,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18360,"num_write_kb":146880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'18792","reported_seq":18822,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.811013+0000","last_change":"2026-02-24T08:20:36.864838+0000","last_active":"2026-02-24T08:21:39.811013+0000","last_peered":"2026-02-24T08:21:39.811013+0000","last_clean":"2026-02-24T08:21:39.811013+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:39.811013+0000","last_undegraded":"2026-02-24T08:21:39.811013+0000","last_fullsized":"2026-02-24T08:21:39.811013+0000","mapping_epoch":27,"log_start":"33'8700","ondisk_log_start":"33'8700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153944064,"num_objects":2349,"num_object_clones":0,"num_object_copies":7047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18792,"num_write_kb":150336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'17608","reported_seq":17638,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.711456+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:21:39.711456+0000","last_peered":"2026-02-24T08:21:39.711456+0000","last_clean":"2026-02-24T08:21:39.711456+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:39.711456+0000","last_undegraded":"2026-02-24T08:21:39.711456+0000","last_fullsized":"2026-02-24T08:21:39.711456+0000","mapping_epoch":27,"log_start":"33'7600","ondisk_log_start":"33'7600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144244736,"num_objects":2201,"num_object_clones":0,"num_object_copies":6603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17608,"num_write_kb":140864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'18464","reported_seq":18491,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.848971+0000","last_change":"2026-02-24T08:20:36.864999+0000","last_active":"2026-02-24T08:21:39.848971+0000","last_peered":"2026-02-24T08:21:39.848971+0000","last_clean":"2026-02-24T08:21:39.848971+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:39.848971+0000","last_undegraded":"2026-02-24T08:21:39.848971+0000","last_fullsized":"2026-02-24T08:21:39.848971+0000","mapping_epoch":27,"log_start":"33'8400","ondisk_log_start":"33'8400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:41.093831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151257088,"num_objects":2308,"num_object_clones":0,"num_object_copies":6924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2308,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18464,"num_write_kb":147712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'17616","reported_seq":17639,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.846504+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:39.846504+0000","last_peered":"2026-02-24T08:21:39.846504+0000","last_clean":"2026-02-24T08:21:39.846504+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:39.846504+0000","last_undegraded":"2026-02-24T08:21:39.846504+0000","last_fullsized":"2026-02-24T08:21:39.846504+0000","mapping_epoch":27,"log_start":"33'7600","ondisk_log_start":"33'7600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144310272,"num_objects":2202,"num_object_clones":0,"num_object_copies":6606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17616,"num_write_kb":140928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'18104","reported_seq":18134,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:39.800606+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:21:39.800606+0000","last_peered":"2026-02-24T08:21:39.800606+0000","last_clean":"2026-02-24T08:21:39.800606+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:39.800606+0000","last_undegraded":"2026-02-24T08:21:39.800606+0000","last_fullsized":"2026-02-24T08:21:39.800606+0000","mapping_epoch":27,"log_start":"33'8100","ondisk_log_start":"33'8100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148307968,"num_objects":2263,"num_object_clones":0,"num_object_copies":6789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18104,"num_write_kb":144832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2379456512,"num_objects":36309,"num_object_clones":0,"num_object_copies":108927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290461,"num_write_kb":2323688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7134748672,"data_stored":7134748672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160761,"ondisk_log_size":160761,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247826,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2468764,"kb_used_data":2026696,"kb_used_omap":13,"kb_used_meta":442034,"kb_avail":731534436,"statfs":{"total":751619276800,"available":749091262464,"internally_reserved":0,"allocated":2075336704,"data_stored":2075102543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13341,"internal_metadata":452643811},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444052,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1962108,"kb_used_data":1592232,"kb_used_omap":17,"kb_used_meta":369838,"kb_avail":732041092,"statfs":{"total":751619276800,"available":749610078208,"internally_reserved":0,"allocated":1630445568,"data_stored":1630211407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":378714644},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,5,7,11,10,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2120280,"kb_used_data":1732356,"kb_used_omap":19,"kb_used_meta":387884,"kb_avail":731882920,"statfs":{"total":751619276800,"available":749448110080,"internally_reserved":0,"allocated":1773932544,"data_stored":1773701935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":397193843},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705688,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1958156,"kb_used_data":1588272,"kb_used_omap":21,"kb_used_meta":369834,"kb_avail":732045044,"statfs":{"total":751619276800,"available":749614125056,"internally_reserved":0,"allocated":1626390528,"data_stored":1626156367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":378710087},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1626267648,"data_stored":1626267648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1794269184,"data_stored":1794269184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1635483648,"data_stored":1635483648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2078728192,"data_stored":2078728192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:43.387 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:21:43.387 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 66 2026-02-24T08:21:43.421 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:43.540 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:43.583 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:43.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:43.662+0000 7fb7fdd6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:43.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:43.663+0000 7fb7fdd6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:43.693 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:43.691+0000 7f55346aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:43.693 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:43.691+0000 7f55346aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:43.710 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:43.710 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:43.723 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:43.724 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:43.737 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:43.738 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:43.751 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:43.751 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:43.815 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:21:43.856 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:43 trial105 ceph-mon[39442]: 2.7 scrub starts 2026-02-24T08:21:43.857 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:43 trial105 ceph-mon[39442]: pgmap v51: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.2 GiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.05k op/s 2026-02-24T08:21:43.857 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:43 trial105 ceph-mon[39442]: 2.7 scrub ok 2026-02-24T08:21:43.857 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4017479549' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:43.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:21:43.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 66 128 305040 304912 36.0897 25.9531 0.029686 0.0276971 2026-02-24T08:21:44.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 67 128 308702 308574 35.9781 28.6094 0.0360291 0.0277818 2026-02-24T08:21:45.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:44 trial105 ceph-mon[39442]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:44 trial105 ceph-mon[39442]: 2.9 scrub ok 2026-02-24T08:21:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2881428418' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T08:21:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:21:45.798 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:45.931 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:45.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 68 128 312269 312141 35.8587 27.8672 0.0722203 0.0278766 2026-02-24T08:21:46.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:45 trial105 ceph-mon[39442]: pgmap v52: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.2 GiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.05k op/s 2026-02-24T08:21:46.411 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:46.354+0000 7fce10e05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:46.411 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:46.355+0000 7fce10e05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:46.411 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:46.411 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:46.412 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:46.412 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:46.412 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:46.412 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:46.417 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:46.417 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:46.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 69 128 314912 314784 35.6383 20.6484 0.0133376 0.0280445 2026-02-24T08:21:47.026 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:46 trial105 ceph-mon[39442]: 2.0 scrub starts 2026-02-24T08:21:47.027 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:46 trial105 ceph-mon[39442]: 2.0 scrub ok 2026-02-24T08:21:47.027 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/34590527' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:47.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 70 128 318408 318280 35.5193 27.3125 0.0277131 0.028136 2026-02-24T08:21:48.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:47 trial105 ceph-mon[39442]: 2.2 scrub starts 2026-02-24T08:21:48.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:47 trial105 ceph-mon[39442]: pgmap v53: 17 pgs: 17 active+clean; 2.4 GiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.53k op/s 2026-02-24T08:21:48.860 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:21:48.860 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:21:48.860 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:21:48.860 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:48.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 71 127 321929 321802 35.4066 27.5156 0.013753 0.0282276 2026-02-24T08:21:49.004 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:49.053 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:49.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:48 trial105 ceph-mon[39442]: 2.3 scrub starts 2026-02-24T08:21:49.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:48 trial105 ceph-mon[39442]: 2.2 scrub ok 2026-02-24T08:21:49.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:48 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:21:49.054 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:48 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:21:49.130 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:49.125+0000 7f0ebe8d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:49.130 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:49.126+0000 7f0ebe8d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:49.207 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:49.271 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:49.272 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:49.320 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2026-02-24T08:21:48.697166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2525504032,"num_objects":38532,"num_object_clones":0,"num_object_copies":115596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38532,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":308352,"num_write_kb":2467886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161016,"ondisk_log_size":161016,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8964036,"kb_used_data":7358196,"kb_used_omap":71,"kb_used_meta":1605688,"kb_avail":2927048764,"statfs":{"total":3006477107200,"available":2997297934336,"internally_reserved":0,"allocated":7534792704,"data_stored":7533859612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73551,"internal_metadata":1644224689},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,8,9,15,12,24,10],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":294666240,"num_objects":4498,"num_object_clones":0,"num_object_copies":13494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35970,"num_write_kb":287760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001562"},"pg_stats":[{"pgid":"2.f","version":"37'18888","reported_seq":18918,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.749508+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:44.749508+0000","last_peered":"2026-02-24T08:21:44.749508+0000","last_clean":"2026-02-24T08:21:44.749508+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:44.749508+0000","last_undegraded":"2026-02-24T08:21:44.749508+0000","last_fullsized":"2026-02-24T08:21:44.749508+0000","mapping_epoch":27,"log_start":"33'8800","ondisk_log_start":"33'8800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154730496,"num_objects":2361,"num_object_clones":0,"num_object_copies":7083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18888,"num_write_kb":151104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'19296","reported_seq":19359,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.859156+0000","last_change":"2026-02-24T08:21:40.186143+0000","last_active":"2026-02-24T08:21:44.859156+0000","last_peered":"2026-02-24T08:21:44.859156+0000","last_clean":"2026-02-24T08:21:44.859156+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:44.859156+0000","last_undegraded":"2026-02-24T08:21:44.859156+0000","last_fullsized":"2026-02-24T08:21:44.859156+0000","mapping_epoch":27,"log_start":"33'9200","ondisk_log_start":"33'9200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18352","last_scrub_stamp":"2026-02-24T08:21:40.186089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:40.186089+0000","objects_scrubbed":2283,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:43.505159+0000","scrub_duration":1258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158072832,"num_objects":2412,"num_object_clones":0,"num_object_copies":7236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19296,"num_write_kb":154368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'19608","reported_seq":19638,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.876662+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:44.876662+0000","last_peered":"2026-02-24T08:21:44.876662+0000","last_clean":"2026-02-24T08:21:44.876662+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:44.876662+0000","last_undegraded":"2026-02-24T08:21:44.876662+0000","last_fullsized":"2026-02-24T08:21:44.876662+0000","mapping_epoch":27,"log_start":"33'9600","ondisk_log_start":"33'9600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160628736,"num_objects":2451,"num_object_clones":0,"num_object_copies":7353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19608,"num_write_kb":156864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'18944","reported_seq":18974,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.871345+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:21:44.871345+0000","last_peered":"2026-02-24T08:21:44.871345+0000","last_clean":"2026-02-24T08:21:44.871345+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:44.871345+0000","last_undegraded":"2026-02-24T08:21:44.871345+0000","last_fullsized":"2026-02-24T08:21:44.871345+0000","mapping_epoch":27,"log_start":"33'8900","ondisk_log_start":"33'8900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":2368,"num_object_clones":0,"num_object_copies":7104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18944,"num_write_kb":151552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:27.721605+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:21:27.721605+0000","last_peered":"2026-02-24T08:21:27.721605+0000","last_clean":"2026-02-24T08:21:27.721605+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:27.721605+0000","last_undegraded":"2026-02-24T08:21:27.721605+0000","last_fullsized":"2026-02-24T08:21:27.721605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'19224","reported_seq":19254,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.821979+0000","last_change":"2026-02-24T08:20:36.865182+0000","last_active":"2026-02-24T08:21:44.821979+0000","last_peered":"2026-02-24T08:21:44.821979+0000","last_clean":"2026-02-24T08:21:44.821979+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:44.821979+0000","last_undegraded":"2026-02-24T08:21:44.821979+0000","last_fullsized":"2026-02-24T08:21:44.821979+0000","mapping_epoch":27,"log_start":"33'9200","ondisk_log_start":"33'9200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157483008,"num_objects":2403,"num_object_clones":0,"num_object_copies":7209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19224,"num_write_kb":153792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'18856","reported_seq":18886,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.848973+0000","last_change":"2026-02-24T08:20:36.865185+0000","last_active":"2026-02-24T08:21:44.848973+0000","last_peered":"2026-02-24T08:21:44.848973+0000","last_clean":"2026-02-24T08:21:44.848973+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:44.848973+0000","last_undegraded":"2026-02-24T08:21:44.848973+0000","last_fullsized":"2026-02-24T08:21:44.848973+0000","mapping_epoch":27,"log_start":"33'8800","ondisk_log_start":"33'8800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154468352,"num_objects":2357,"num_object_clones":0,"num_object_copies":7071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18856,"num_write_kb":150848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'19184","reported_seq":19214,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.839435+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:44.839435+0000","last_peered":"2026-02-24T08:21:44.839435+0000","last_clean":"2026-02-24T08:21:44.839435+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:44.839435+0000","last_undegraded":"2026-02-24T08:21:44.839435+0000","last_fullsized":"2026-02-24T08:21:44.839435+0000","mapping_epoch":27,"log_start":"33'9100","ondisk_log_start":"33'9100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157155328,"num_objects":2398,"num_object_clones":0,"num_object_copies":7194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19184,"num_write_kb":153472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'19953","reported_seq":19980,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.846514+0000","last_change":"2026-02-24T08:20:36.865033+0000","last_active":"2026-02-24T08:21:44.846514+0000","last_peered":"2026-02-24T08:21:44.846514+0000","last_clean":"2026-02-24T08:21:44.846514+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:44.846514+0000","last_undegraded":"2026-02-24T08:21:44.846514+0000","last_fullsized":"2026-02-24T08:21:44.846514+0000","mapping_epoch":27,"log_start":"33'9900","ondisk_log_start":"33'9900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163454976,"num_objects":2495,"num_object_clones":0,"num_object_copies":7485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2495,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19953,"num_write_kb":159624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'19472","reported_seq":19502,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.846496+0000","last_change":"2026-02-24T08:20:36.864764+0000","last_active":"2026-02-24T08:21:44.846496+0000","last_peered":"2026-02-24T08:21:44.846496+0000","last_clean":"2026-02-24T08:21:44.846496+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:44.846496+0000","last_undegraded":"2026-02-24T08:21:44.846496+0000","last_fullsized":"2026-02-24T08:21:44.846496+0000","mapping_epoch":27,"log_start":"33'9400","ondisk_log_start":"33'9400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:47.476948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159514624,"num_objects":2434,"num_object_clones":0,"num_object_copies":7302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19472,"num_write_kb":155776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'19229","reported_seq":19283,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.848226+0000","last_change":"2026-02-24T08:21:42.314595+0000","last_active":"2026-02-24T08:21:44.848226+0000","last_peered":"2026-02-24T08:21:44.848226+0000","last_clean":"2026-02-24T08:21:44.848226+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:44.848226+0000","last_undegraded":"2026-02-24T08:21:44.848226+0000","last_fullsized":"2026-02-24T08:21:44.848226+0000","mapping_epoch":27,"log_start":"33'9200","ondisk_log_start":"33'9200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18560","last_scrub_stamp":"2026-02-24T08:21:42.314562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.314562+0000","objects_scrubbed":2308,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:07.041335+0000","scrub_duration":557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157523968,"num_objects":2404,"num_object_clones":0,"num_object_copies":7212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19229,"num_write_kb":153832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'19416","reported_seq":19446,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.769802+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:44.769802+0000","last_peered":"2026-02-24T08:21:44.769802+0000","last_clean":"2026-02-24T08:21:44.769802+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:44.769802+0000","last_undegraded":"2026-02-24T08:21:44.769802+0000","last_fullsized":"2026-02-24T08:21:44.769802+0000","mapping_epoch":27,"log_start":"33'9400","ondisk_log_start":"33'9400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159055872,"num_objects":2427,"num_object_clones":0,"num_object_copies":7281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19416,"num_write_kb":155328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'19786","reported_seq":19848,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.842117+0000","last_change":"2026-02-24T08:21:42.956407+0000","last_active":"2026-02-24T08:21:44.842117+0000","last_peered":"2026-02-24T08:21:44.842117+0000","last_clean":"2026-02-24T08:21:44.842117+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:44.842117+0000","last_undegraded":"2026-02-24T08:21:44.842117+0000","last_fullsized":"2026-02-24T08:21:44.842117+0000","mapping_epoch":27,"log_start":"33'9700","ondisk_log_start":"33'9700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:42.956364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.956364+0000","objects_scrubbed":2416,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:45.767859+0000","scrub_duration":407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162086912,"num_objects":2474,"num_object_clones":0,"num_object_copies":7422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2474,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19786,"num_write_kb":158288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'18768","reported_seq":18798,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.805777+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:21:44.805777+0000","last_peered":"2026-02-24T08:21:44.805777+0000","last_clean":"2026-02-24T08:21:44.805777+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:44.805777+0000","last_undegraded":"2026-02-24T08:21:44.805777+0000","last_fullsized":"2026-02-24T08:21:44.805777+0000","mapping_epoch":27,"log_start":"33'8700","ondisk_log_start":"33'8700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153747456,"num_objects":2346,"num_object_clones":0,"num_object_copies":7038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18768,"num_write_kb":150144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'19647","reported_seq":19707,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.867468+0000","last_change":"2026-02-24T08:21:43.625296+0000","last_active":"2026-02-24T08:21:44.867468+0000","last_peered":"2026-02-24T08:21:44.867468+0000","last_clean":"2026-02-24T08:21:44.867468+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:44.867468+0000","last_undegraded":"2026-02-24T08:21:44.867468+0000","last_fullsized":"2026-02-24T08:21:44.867468+0000","mapping_epoch":27,"log_start":"33'9600","ondisk_log_start":"33'9600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:43.625255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:43.625255+0000","objects_scrubbed":2406,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:52.790484+0000","scrub_duration":1684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160948224,"num_objects":2456,"num_object_clones":0,"num_object_copies":7368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19647,"num_write_kb":157176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'18890","reported_seq":18916,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.864141+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:44.864141+0000","last_peered":"2026-02-24T08:21:44.864141+0000","last_clean":"2026-02-24T08:21:44.864141+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:44.864141+0000","last_undegraded":"2026-02-24T08:21:44.864141+0000","last_fullsized":"2026-02-24T08:21:44.864141+0000","mapping_epoch":27,"log_start":"33'8800","ondisk_log_start":"33'8800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154746880,"num_objects":2362,"num_object_clones":0,"num_object_copies":7086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2362,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18890,"num_write_kb":151120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'19056","reported_seq":19086,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:44.837885+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:21:44.837885+0000","last_peered":"2026-02-24T08:21:44.837885+0000","last_clean":"2026-02-24T08:21:44.837885+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:44.837885+0000","last_undegraded":"2026-02-24T08:21:44.837885+0000","last_fullsized":"2026-02-24T08:21:44.837885+0000","mapping_epoch":27,"log_start":"33'9000","ondisk_log_start":"33'9000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156106752,"num_objects":2382,"num_object_clones":0,"num_object_copies":7146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19056,"num_write_kb":152448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2524913664,"num_objects":38530,"num_object_clones":0,"num_object_copies":115590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308217,"num_write_kb":2465736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7570800640,"data_stored":7570800640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160917,"ondisk_log_size":160917,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247827,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2608300,"kb_used_data":2148184,"kb_used_omap":13,"kb_used_meta":460082,"kb_avail":731394900,"statfs":{"total":751619276800,"available":748948377600,"internally_reserved":0,"allocated":2199740416,"data_stored":2199506255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13341,"internal_metadata":471124963},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444053,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2058092,"kb_used_data":1688216,"kb_used_omap":17,"kb_used_meta":369838,"kb_avail":731945108,"statfs":{"total":751619276800,"available":749511790592,"internally_reserved":0,"allocated":1728733184,"data_stored":1728499023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":378714644},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2243832,"kb_used_data":1837860,"kb_used_omap":19,"kb_used_meta":405932,"kb_avail":731759368,"statfs":{"total":751619276800,"available":749321592832,"internally_reserved":0,"allocated":1881968640,"data_stored":1881738031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":415674995},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,5,8,15,12,24,10],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705689,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2053812,"kb_used_data":1683936,"kb_used_omap":21,"kb_used_meta":369834,"kb_avail":731949388,"statfs":{"total":751619276800,"available":749516173312,"internally_reserved":0,"allocated":1724350464,"data_stored":1724116303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":378710087},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1725816832,"data_stored":1725816832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1903083520,"data_stored":1903083520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1734615040,"data_stored":1734615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2207285248,"data_stored":2207285248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:49.322 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:21:49.323 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 31 2026-02-24T08:21:49.327 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:49.325+0000 7fcd85602640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:49.327 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:49.325+0000 7fcd85602640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:49.340 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:49.341 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:49.354 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:49.355 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:49.369 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:49.369 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:49.380 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:49.380 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:49.473 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:49.590 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:21:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:21:49] "GET /metrics HTTP/1.1" 200 4227 "" "Prometheus/3.6.0" 2026-02-24T08:21:49.595 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:49.594+0000 7fbe430e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:49.595 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:49.594+0000 7fbe430e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:49.744 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:21:49.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:21:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:21:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:21:49.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:21:49.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:49 trial105 ceph-mon[39442]: pgmap v54: 17 pgs: 17 active+clean; 2.4 GiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 3.00k op/s 2026-02-24T08:21:49.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:49 trial105 ceph-mon[39442]: 2.3 scrub ok 2026-02-24T08:21:49.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:49 trial105 ceph-mon[39442]: 2.4 scrub starts 2026-02-24T08:21:49.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:49 trial105 ceph-mon[39442]: 2.4 scrub ok 2026-02-24T08:21:49.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1521747366' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:49.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/199895267' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "31"} : dispatch 2026-02-24T08:21:49.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 72 128 325370 325242 35.288 26.875 0.0143923 0.0283281 2026-02-24T08:21:50.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 73 128 328988 328860 35.1918 28.2656 0.0368878 0.0284031 2026-02-24T08:21:51.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:50 trial105 ceph-mon[39442]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:51.430 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:51.577 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:51.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:51.701+0000 7f0b9e666640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:51.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:51.702+0000 7f0b9e666640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:51.720 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:51.721 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:51.737 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:51.737 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:51.751 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:51.751 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:51.765 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:51.765 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:51.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 74 128 332571 332443 35.0945 27.9922 0.0241745 0.028481 2026-02-24T08:21:52.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:51 trial105 ceph-mon[39442]: pgmap v55: 17 pgs: 17 active+clean; 2.5 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.39k op/s 2026-02-24T08:21:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3454015155' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:52.962 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 75 128 336228 336100 35.0075 28.5703 0.0117369 0.0285537 2026-02-24T08:21:53.811 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:53.960 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:53.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 76 128 339854 339726 34.9196 28.3281 0.0177936 0.0286244 2026-02-24T08:21:54.076 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:53 trial105 ceph-mon[39442]: pgmap v56: 17 pgs: 17 active+clean; 2.5 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.87k op/s 2026-02-24T08:21:54.080 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:54.078+0000 7fec51013640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:54.080 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:54.078+0000 7fec51013640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:54.094 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:54.095 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:54.110 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:54.110 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:54.124 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:54.124 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:54.137 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:54.137 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:54.787 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:21:54.787 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:21:54.788 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:21:54.788 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:21:54.934 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:54.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 77 128 343349 343221 34.8206 27.3047 0.0134868 0.0287064 2026-02-24T08:21:55.052 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:54 trial105 ceph-mon[39442]: 2.8 scrub starts 2026-02-24T08:21:55.053 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2176298387' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:55.062 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:55.059+0000 7f1af0d35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:55.062 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:55.059+0000 7f1af0d35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:55.208 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:21:55.209 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:21:55.263 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2026-02-24T08:21:54.697893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2662425120,"num_objects":40621,"num_object_clones":0,"num_object_copies":121863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40621,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":325066,"num_write_kb":2601598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161030,"ondisk_log_size":161030,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9508012,"kb_used_data":7775708,"kb_used_omap":72,"kb_used_meta":1732151,"kb_avail":2926504788,"statfs":{"total":3006477107200,"available":2996740902912,"internally_reserved":0,"allocated":7962324992,"data_stored":7961391900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74202,"internal_metadata":1773723174},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,14,17,23,21,9,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282378240,"num_objects":4310,"num_object_clones":0,"num_object_copies":12930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34470,"num_write_kb":275760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001471"},"pg_stats":[{"pgid":"2.f","version":"37'19952","reported_seq":19982,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.713315+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:49.713315+0000","last_peered":"2026-02-24T08:21:49.713315+0000","last_clean":"2026-02-24T08:21:49.713315+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:49.713315+0000","last_undegraded":"2026-02-24T08:21:49.713315+0000","last_fullsized":"2026-02-24T08:21:49.713315+0000","mapping_epoch":27,"log_start":"33'9900","ondisk_log_start":"33'9900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163446784,"num_objects":2494,"num_object_clones":0,"num_object_copies":7482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2494,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19952,"num_write_kb":159616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'20152","reported_seq":20215,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.874707+0000","last_change":"2026-02-24T08:21:40.186143+0000","last_active":"2026-02-24T08:21:49.874707+0000","last_peered":"2026-02-24T08:21:49.874707+0000","last_clean":"2026-02-24T08:21:49.874707+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:49.874707+0000","last_undegraded":"2026-02-24T08:21:49.874707+0000","last_fullsized":"2026-02-24T08:21:49.874707+0000","mapping_epoch":27,"log_start":"33'10100","ondisk_log_start":"33'10100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18352","last_scrub_stamp":"2026-02-24T08:21:40.186089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:40.186089+0000","objects_scrubbed":2283,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:43.505159+0000","scrub_duration":1258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165085184,"num_objects":2519,"num_object_clones":0,"num_object_copies":7557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20152,"num_write_kb":161216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'20640","reported_seq":20670,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.880781+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:49.880781+0000","last_peered":"2026-02-24T08:21:49.880781+0000","last_clean":"2026-02-24T08:21:49.880781+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:49.880781+0000","last_undegraded":"2026-02-24T08:21:49.880781+0000","last_fullsized":"2026-02-24T08:21:49.880781+0000","mapping_epoch":27,"log_start":"33'10600","ondisk_log_start":"33'10600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169082880,"num_objects":2580,"num_object_clones":0,"num_object_copies":7740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2580,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20640,"num_write_kb":165120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'19984","reported_seq":20014,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.869670+0000","last_change":"2026-02-24T08:20:36.865508+0000","last_active":"2026-02-24T08:21:49.869670+0000","last_peered":"2026-02-24T08:21:49.869670+0000","last_clean":"2026-02-24T08:21:49.869670+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:49.869670+0000","last_undegraded":"2026-02-24T08:21:49.869670+0000","last_fullsized":"2026-02-24T08:21:49.869670+0000","mapping_epoch":27,"log_start":"33'9900","ondisk_log_start":"33'9900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:53.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163708928,"num_objects":2498,"num_object_clones":0,"num_object_copies":7494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19984,"num_write_kb":159872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:27.721605+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:21:27.721605+0000","last_peered":"2026-02-24T08:21:27.721605+0000","last_clean":"2026-02-24T08:21:27.721605+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:27.721605+0000","last_undegraded":"2026-02-24T08:21:27.721605+0000","last_fullsized":"2026-02-24T08:21:27.721605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'20200","reported_seq":20263,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.844089+0000","last_change":"2026-02-24T08:21:48.819991+0000","last_active":"2026-02-24T08:21:49.844089+0000","last_peered":"2026-02-24T08:21:49.844089+0000","last_clean":"2026-02-24T08:21:49.844089+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:49.844089+0000","last_undegraded":"2026-02-24T08:21:49.844089+0000","last_fullsized":"2026-02-24T08:21:49.844089+0000","mapping_epoch":27,"log_start":"33'10100","ondisk_log_start":"33'10100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20032","last_scrub_stamp":"2026-02-24T08:21:48.819949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:48.819949+0000","objects_scrubbed":2492,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.299009+0000","scrub_duration":1176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165478400,"num_objects":2525,"num_object_clones":0,"num_object_copies":7575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20200,"num_write_kb":161600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'19971","reported_seq":20023,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.858353+0000","last_change":"2026-02-24T08:21:46.276112+0000","last_active":"2026-02-24T08:21:49.858353+0000","last_peered":"2026-02-24T08:21:49.858353+0000","last_clean":"2026-02-24T08:21:49.858353+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:49.858353+0000","last_undegraded":"2026-02-24T08:21:49.858353+0000","last_fullsized":"2026-02-24T08:21:49.858353+0000","mapping_epoch":27,"log_start":"33'9900","ondisk_log_start":"33'9900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19224","last_scrub_stamp":"2026-02-24T08:21:46.275979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:46.275979+0000","objects_scrubbed":2389,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:13.488831+0000","scrub_duration":744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163602432,"num_objects":2497,"num_object_clones":0,"num_object_copies":7491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19971,"num_write_kb":159768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'20055","reported_seq":20084,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.888439+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:49.888439+0000","last_peered":"2026-02-24T08:21:49.888439+0000","last_clean":"2026-02-24T08:21:49.888439+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:49.888439+0000","last_undegraded":"2026-02-24T08:21:49.888439+0000","last_fullsized":"2026-02-24T08:21:49.888439+0000","mapping_epoch":27,"log_start":"33'10000","ondisk_log_start":"33'10000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164290560,"num_objects":2507,"num_object_clones":0,"num_object_copies":7521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20055,"num_write_kb":160440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'21150","reported_seq":21211,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.842509+0000","last_change":"2026-02-24T08:21:47.926225+0000","last_active":"2026-02-24T08:21:49.842509+0000","last_peered":"2026-02-24T08:21:49.842509+0000","last_clean":"2026-02-24T08:21:49.842509+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:49.842509+0000","last_undegraded":"2026-02-24T08:21:49.842509+0000","last_fullsized":"2026-02-24T08:21:49.842509+0000","mapping_epoch":27,"log_start":"33'11100","ondisk_log_start":"33'11100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20632","last_scrub_stamp":"2026-02-24T08:21:47.926183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:47.926183+0000","objects_scrubbed":2561,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:08.888599+0000","scrub_duration":1419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173260800,"num_objects":2644,"num_object_clones":0,"num_object_copies":7932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21150,"num_write_kb":169200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'20452","reported_seq":20506,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.885117+0000","last_change":"2026-02-24T08:21:49.267866+0000","last_active":"2026-02-24T08:21:49.885117+0000","last_peered":"2026-02-24T08:21:49.885117+0000","last_clean":"2026-02-24T08:21:49.885117+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:49.885117+0000","last_undegraded":"2026-02-24T08:21:49.885117+0000","last_fullsized":"2026-02-24T08:21:49.885117+0000","mapping_epoch":27,"log_start":"33'10400","ondisk_log_start":"33'10400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20304","last_scrub_stamp":"2026-02-24T08:21:49.267806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:49.267806+0000","objects_scrubbed":2538,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.447822+0000","scrub_duration":392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167542784,"num_objects":2557,"num_object_clones":0,"num_object_copies":7671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20452,"num_write_kb":163616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'20440","reported_seq":20501,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.785950+0000","last_change":"2026-02-24T08:21:42.314595+0000","last_active":"2026-02-24T08:21:49.785950+0000","last_peered":"2026-02-24T08:21:49.785950+0000","last_clean":"2026-02-24T08:21:49.785950+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:49.785950+0000","last_undegraded":"2026-02-24T08:21:49.785950+0000","last_fullsized":"2026-02-24T08:21:49.785950+0000","mapping_epoch":27,"log_start":"33'10400","ondisk_log_start":"33'10400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18560","last_scrub_stamp":"2026-02-24T08:21:42.314562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.314562+0000","objects_scrubbed":2308,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:07.041335+0000","scrub_duration":557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167444480,"num_objects":2555,"num_object_clones":0,"num_object_copies":7665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20440,"num_write_kb":163520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'20572","reported_seq":20593,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.890524+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:49.890524+0000","last_peered":"2026-02-24T08:21:49.890524+0000","last_clean":"2026-02-24T08:21:49.890524+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:49.890524+0000","last_undegraded":"2026-02-24T08:21:49.890524+0000","last_fullsized":"2026-02-24T08:21:49.890524+0000","mapping_epoch":27,"log_start":"33'10500","ondisk_log_start":"33'10500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:58.592575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168525824,"num_objects":2572,"num_object_clones":0,"num_object_copies":7716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20572,"num_write_kb":164576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'20952","reported_seq":21014,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.825072+0000","last_change":"2026-02-24T08:21:42.956407+0000","last_active":"2026-02-24T08:21:49.825072+0000","last_peered":"2026-02-24T08:21:49.825072+0000","last_clean":"2026-02-24T08:21:49.825072+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:49.825072+0000","last_undegraded":"2026-02-24T08:21:49.825072+0000","last_fullsized":"2026-02-24T08:21:49.825072+0000","mapping_epoch":27,"log_start":"33'10900","ondisk_log_start":"33'10900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:42.956364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.956364+0000","objects_scrubbed":2416,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:45.767859+0000","scrub_duration":407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171638784,"num_objects":2619,"num_object_clones":0,"num_object_copies":7857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20952,"num_write_kb":167616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'19768","reported_seq":19798,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.801022+0000","last_change":"2026-02-24T08:20:36.862063+0000","last_active":"2026-02-24T08:21:49.801022+0000","last_peered":"2026-02-24T08:21:49.801022+0000","last_clean":"2026-02-24T08:21:49.801022+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:49.801022+0000","last_undegraded":"2026-02-24T08:21:49.801022+0000","last_fullsized":"2026-02-24T08:21:49.801022+0000","mapping_epoch":27,"log_start":"33'9700","ondisk_log_start":"33'9700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161939456,"num_objects":2471,"num_object_clones":0,"num_object_copies":7413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19768,"num_write_kb":158144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'20616","reported_seq":20679,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.867707+0000","last_change":"2026-02-24T08:21:43.625296+0000","last_active":"2026-02-24T08:21:49.867707+0000","last_peered":"2026-02-24T08:21:49.867707+0000","last_clean":"2026-02-24T08:21:49.867707+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:49.867707+0000","last_undegraded":"2026-02-24T08:21:49.867707+0000","last_fullsized":"2026-02-24T08:21:49.867707+0000","mapping_epoch":27,"log_start":"33'10600","ondisk_log_start":"33'10600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:43.625255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:43.625255+0000","objects_scrubbed":2406,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:52.790484+0000","scrub_duration":1684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168886272,"num_objects":2577,"num_object_clones":0,"num_object_copies":7731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2577,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20616,"num_write_kb":164928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'20040","reported_seq":20070,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.860474+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:49.860474+0000","last_peered":"2026-02-24T08:21:49.860474+0000","last_clean":"2026-02-24T08:21:49.860474+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:49.860474+0000","last_undegraded":"2026-02-24T08:21:49.860474+0000","last_fullsized":"2026-02-24T08:21:49.860474+0000","mapping_epoch":27,"log_start":"33'10000","ondisk_log_start":"33'10000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164167680,"num_objects":2505,"num_object_clones":0,"num_object_copies":7515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20040,"num_write_kb":160320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'19987","reported_seq":20015,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:49.835382+0000","last_change":"2026-02-24T08:20:36.862447+0000","last_active":"2026-02-24T08:21:49.835382+0000","last_peered":"2026-02-24T08:21:49.835382+0000","last_clean":"2026-02-24T08:21:49.835382+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:49.835382+0000","last_undegraded":"2026-02-24T08:21:49.835382+0000","last_fullsized":"2026-02-24T08:21:49.835382+0000","mapping_epoch":27,"log_start":"33'9900","ondisk_log_start":"33'9900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:55.286300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163733504,"num_objects":2499,"num_object_clones":0,"num_object_copies":7497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19987,"num_write_kb":159896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2661834752,"num_objects":40619,"num_object_clones":0,"num_object_copies":121857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324931,"num_write_kb":2599448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7981514752,"data_stored":7981514752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160931,"ondisk_log_size":160931,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247828,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2798276,"kb_used_data":2265840,"kb_used_omap":13,"kb_used_meta":532402,"kb_avail":731204924,"statfs":{"total":751619276800,"available":748753842176,"internally_reserved":0,"allocated":2320220160,"data_stored":2319985999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13992,"internal_metadata":545179992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,13,5,0,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444054,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2169212,"kb_used_data":1781288,"kb_used_omap":17,"kb_used_meta":387886,"kb_avail":731833988,"statfs":{"total":751619276800,"available":749398003712,"internally_reserved":0,"allocated":1824038912,"data_stored":1823804751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":397195796},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,2,2,1,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2382000,"kb_used_data":1957980,"kb_used_omap":19,"kb_used_meta":423980,"kb_avail":731621200,"statfs":{"total":751619276800,"available":749180108800,"internally_reserved":0,"allocated":2004971520,"data_stored":2004740911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":434156147},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,7,1,13,18,0,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2158524,"kb_used_data":1770600,"kb_used_omap":21,"kb_used_meta":387882,"kb_avail":731844676,"statfs":{"total":751619276800,"available":749408948224,"internally_reserved":0,"allocated":1813094400,"data_stored":1812860239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":397191239},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,1,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1816494080,"data_stored":1816494080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2005557248,"data_stored":2005557248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1830354944,"data_stored":1830354944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2329108480,"data_stored":2329108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:21:55.263 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:21:55.264 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 41 2026-02-24T08:21:55.405 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:55.534 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:55.532+0000 7f3fd2830640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:55.538 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:55.536+0000 7f3fd2830640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:55.692 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:21:55.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:21:55.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 78 128 346809 346681 34.7207 27.0312 0.0223854 0.0287926 2026-02-24T08:21:56.180 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:21:56.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:55 trial105 ceph-mon[39442]: pgmap v57: 17 pgs: 17 active+clean; 2.5 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.87k op/s 2026-02-24T08:21:56.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:55 trial105 ceph-mon[39442]: 2.8 scrub ok 2026-02-24T08:21:56.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:55 trial105 ceph-mon[39442]: 2.c scrub starts 2026-02-24T08:21:56.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4099454707' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "41"} : dispatch 2026-02-24T08:21:56.325 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:56.453 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:56.451+0000 7f88fbcc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:56.454 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:56.452+0000 7f88fbcc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:56.467 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:56.468 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:56.481 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:56.481 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:56.495 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:56.495 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:56.509 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:56.509 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:56.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 79 128 350397 350269 34.636 28.0312 0.0188185 0.0288634 2026-02-24T08:21:57.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:56 trial105 ceph-mon[39442]: from='client.14476 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:21:57.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/263192577' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:57.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:21:57.962442+0000 min lat: 0.000730736 max lat: 0.19461 avg lat: 0.0289308 2026-02-24T08:21:57.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:21:57.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 80 128 353977 353849 34.5527 27.9688 0.0422226 0.0289308 2026-02-24T08:21:58.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:57 trial105 ceph-mon[39442]: 2.c scrub ok 2026-02-24T08:21:58.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:57 trial105 ceph-mon[39442]: pgmap v58: 17 pgs: 17 active+clean; 2.6 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.38k op/s 2026-02-24T08:21:58.553 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:21:58.702 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:21:58.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 81 128 357276 357148 34.4443 25.7734 0.107423 0.02902 2026-02-24T08:21:59.046 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:59.043+0000 7f6881ed9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:59.046 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:21:59.043+0000 7f6881ed9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:21:59.060 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:21:59.060 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:21:59.073 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:21:59.073 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:21:59.087 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:21:59.087 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:21:59.101 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:21:59.101 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:21:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:21:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:21:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:21:59.938 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:21:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:21:59] "GET /metrics HTTP/1.1" 200 4206 "" "Prometheus/3.6.0" 2026-02-24T08:21:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:59 trial105 ceph-mon[39442]: 2.b scrub starts 2026-02-24T08:21:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:59 trial105 ceph-mon[39442]: pgmap v59: 17 pgs: 17 active+clean; 2.6 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.90k op/s 2026-02-24T08:21:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:21:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2534600795' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:21:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:21:59 trial105 ceph-mon[39442]: 2.b scrub ok 2026-02-24T08:21:59.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 82 128 360668 360540 34.3474 26.5 0.0223883 0.0291042 2026-02-24T08:22:00.737 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:00.737 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:00.737 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:22:00.737 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:22:00.883 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:00.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 83 128 364304 364176 34.2758 28.4062 0.0118789 0.0291644 2026-02-24T08:22:01.009 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:01.007+0000 7fa5ae548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:01.010 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:01.008+0000 7fa5ae548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:01.143 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:01.167 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:22:01.167 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:22:01.237 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2026-02-24T08:22:00.698672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2952438304,"num_objects":45045,"num_object_clones":0,"num_object_copies":135135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45045,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":360468,"num_write_kb":2884814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160932,"ondisk_log_size":160932,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10538436,"kb_used_data":8625652,"kb_used_omap":72,"kb_used_meta":1912631,"kb_avail":2925474364,"statfs":{"total":3006477107200,"available":2995685748736,"internally_reserved":0,"allocated":8832667648,"data_stored":8831734556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74202,"internal_metadata":1958534694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,3,8,16,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":426934272,"num_objects":6513,"num_object_clones":0,"num_object_copies":19539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52116,"num_write_kb":416928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001505"},"pg_stats":[{"pgid":"2.f","version":"37'22120","reported_seq":22150,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.725837+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:21:59.725837+0000","last_peered":"2026-02-24T08:21:59.725837+0000","last_clean":"2026-02-24T08:21:59.725837+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:21:59.725837+0000","last_undegraded":"2026-02-24T08:21:59.725837+0000","last_fullsized":"2026-02-24T08:21:59.725837+0000","mapping_epoch":27,"log_start":"37'12100","ondisk_log_start":"37'12100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181207040,"num_objects":2765,"num_object_clones":0,"num_object_copies":8295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22120,"num_write_kb":176960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'22224","reported_seq":22287,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.902583+0000","last_change":"2026-02-24T08:21:40.186143+0000","last_active":"2026-02-24T08:21:59.902583+0000","last_peered":"2026-02-24T08:21:59.902583+0000","last_clean":"2026-02-24T08:21:59.902583+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:21:59.902583+0000","last_undegraded":"2026-02-24T08:21:59.902583+0000","last_fullsized":"2026-02-24T08:21:59.902583+0000","mapping_epoch":27,"log_start":"37'12200","ondisk_log_start":"37'12200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18352","last_scrub_stamp":"2026-02-24T08:21:40.186089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:40.186089+0000","objects_scrubbed":2283,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:43.505159+0000","scrub_duration":1258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182059008,"num_objects":2778,"num_object_clones":0,"num_object_copies":8334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2778,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22224,"num_write_kb":177792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'22896","reported_seq":22926,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.924667+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:21:59.924667+0000","last_peered":"2026-02-24T08:21:59.924667+0000","last_clean":"2026-02-24T08:21:59.924667+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:21:59.924667+0000","last_undegraded":"2026-02-24T08:21:59.924667+0000","last_fullsized":"2026-02-24T08:21:59.924667+0000","mapping_epoch":27,"log_start":"37'12800","ondisk_log_start":"37'12800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187564032,"num_objects":2862,"num_object_clones":0,"num_object_copies":8586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22896,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'22232","reported_seq":22297,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.852243+0000","last_change":"2026-02-24T08:21:56.590599+0000","last_active":"2026-02-24T08:21:59.852243+0000","last_peered":"2026-02-24T08:21:59.852243+0000","last_clean":"2026-02-24T08:21:59.852243+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:21:59.852243+0000","last_undegraded":"2026-02-24T08:21:59.852243+0000","last_fullsized":"2026-02-24T08:21:59.852243+0000","mapping_epoch":27,"log_start":"37'12200","ondisk_log_start":"37'12200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21520","last_scrub_stamp":"2026-02-24T08:21:56.590561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:56.590561+0000","objects_scrubbed":2664,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:21.899136+0000","scrub_duration":1633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182124544,"num_objects":2779,"num_object_clones":0,"num_object_copies":8337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22232,"num_write_kb":177856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:27.721605+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:21:27.721605+0000","last_peered":"2026-02-24T08:21:27.721605+0000","last_clean":"2026-02-24T08:21:27.721605+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:27.721605+0000","last_undegraded":"2026-02-24T08:21:27.721605+0000","last_fullsized":"2026-02-24T08:21:27.721605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'22469","reported_seq":22531,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.889827+0000","last_change":"2026-02-24T08:21:48.819991+0000","last_active":"2026-02-24T08:21:59.889827+0000","last_peered":"2026-02-24T08:21:59.889827+0000","last_clean":"2026-02-24T08:21:59.889827+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:21:59.889827+0000","last_undegraded":"2026-02-24T08:21:59.889827+0000","last_fullsized":"2026-02-24T08:21:59.889827+0000","mapping_epoch":27,"log_start":"37'12400","ondisk_log_start":"37'12400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20032","last_scrub_stamp":"2026-02-24T08:21:48.819949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:48.819949+0000","objects_scrubbed":2492,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.299009+0000","scrub_duration":1176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184066048,"num_objects":2809,"num_object_clones":0,"num_object_copies":8427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2809,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22469,"num_write_kb":179752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'22168","reported_seq":22229,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.875104+0000","last_change":"2026-02-24T08:21:46.276112+0000","last_active":"2026-02-24T08:21:59.875104+0000","last_peered":"2026-02-24T08:21:59.875104+0000","last_clean":"2026-02-24T08:21:59.875104+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:21:59.875104+0000","last_undegraded":"2026-02-24T08:21:59.875104+0000","last_fullsized":"2026-02-24T08:21:59.875104+0000","mapping_epoch":27,"log_start":"37'12100","ondisk_log_start":"37'12100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19224","last_scrub_stamp":"2026-02-24T08:21:46.275979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:46.275979+0000","objects_scrubbed":2389,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:13.488831+0000","scrub_duration":744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181600256,"num_objects":2771,"num_object_clones":0,"num_object_copies":8313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2771,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22168,"num_write_kb":177344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'22280","reported_seq":22307,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.926143+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:21:59.926143+0000","last_peered":"2026-02-24T08:21:59.926143+0000","last_clean":"2026-02-24T08:21:59.926143+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:21:59.926143+0000","last_undegraded":"2026-02-24T08:21:59.926143+0000","last_fullsized":"2026-02-24T08:21:59.926143+0000","mapping_epoch":27,"log_start":"37'12200","ondisk_log_start":"37'12200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.757829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182517760,"num_objects":2785,"num_object_clones":0,"num_object_copies":8355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22280,"num_write_kb":178240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'23256","reported_seq":23315,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.883295+0000","last_change":"2026-02-24T08:21:47.926225+0000","last_active":"2026-02-24T08:21:59.883295+0000","last_peered":"2026-02-24T08:21:59.883295+0000","last_clean":"2026-02-24T08:21:59.883295+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:21:59.883295+0000","last_undegraded":"2026-02-24T08:21:59.883295+0000","last_fullsized":"2026-02-24T08:21:59.883295+0000","mapping_epoch":27,"log_start":"37'13200","ondisk_log_start":"37'13200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20632","last_scrub_stamp":"2026-02-24T08:21:47.926183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:47.926183+0000","objects_scrubbed":2561,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:08.888599+0000","scrub_duration":1419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190513152,"num_objects":2907,"num_object_clones":0,"num_object_copies":8721,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23256,"num_write_kb":186048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'22844","reported_seq":22906,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.934251+0000","last_change":"2026-02-24T08:21:49.267866+0000","last_active":"2026-02-24T08:21:59.934251+0000","last_peered":"2026-02-24T08:21:59.934251+0000","last_clean":"2026-02-24T08:21:59.934251+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:21:59.934251+0000","last_undegraded":"2026-02-24T08:21:59.934251+0000","last_fullsized":"2026-02-24T08:21:59.934251+0000","mapping_epoch":27,"log_start":"37'12800","ondisk_log_start":"37'12800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20304","last_scrub_stamp":"2026-02-24T08:21:49.267806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:49.267806+0000","objects_scrubbed":2538,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.447822+0000","scrub_duration":392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187138048,"num_objects":2856,"num_object_clones":0,"num_object_copies":8568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22844,"num_write_kb":182752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'22576","reported_seq":22637,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.841387+0000","last_change":"2026-02-24T08:21:42.314595+0000","last_active":"2026-02-24T08:21:59.841387+0000","last_peered":"2026-02-24T08:21:59.841387+0000","last_clean":"2026-02-24T08:21:59.841387+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:21:59.841387+0000","last_undegraded":"2026-02-24T08:21:59.841387+0000","last_fullsized":"2026-02-24T08:21:59.841387+0000","mapping_epoch":27,"log_start":"37'12500","ondisk_log_start":"37'12500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18560","last_scrub_stamp":"2026-02-24T08:21:42.314562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.314562+0000","objects_scrubbed":2308,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:07.041335+0000","scrub_duration":557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184942592,"num_objects":2822,"num_object_clones":0,"num_object_copies":8466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2822,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22576,"num_write_kb":180608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'22912","reported_seq":22942,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.909585+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:21:59.909585+0000","last_peered":"2026-02-24T08:21:59.909585+0000","last_clean":"2026-02-24T08:21:59.909585+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:21:59.909585+0000","last_undegraded":"2026-02-24T08:21:59.909585+0000","last_fullsized":"2026-02-24T08:21:59.909585+0000","mapping_epoch":27,"log_start":"37'12900","ondisk_log_start":"37'12900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187695104,"num_objects":2864,"num_object_clones":0,"num_object_copies":8592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2864,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22912,"num_write_kb":183296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'23126","reported_seq":23187,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.888503+0000","last_change":"2026-02-24T08:21:42.956407+0000","last_active":"2026-02-24T08:21:59.888503+0000","last_peered":"2026-02-24T08:21:59.888503+0000","last_clean":"2026-02-24T08:21:59.888503+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:21:59.888503+0000","last_undegraded":"2026-02-24T08:21:59.888503+0000","last_fullsized":"2026-02-24T08:21:59.888503+0000","mapping_epoch":27,"log_start":"37'13100","ondisk_log_start":"37'13100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:42.956364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.956364+0000","objects_scrubbed":2416,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:45.767859+0000","scrub_duration":407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189448192,"num_objects":2891,"num_object_clones":0,"num_object_copies":8673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23126,"num_write_kb":185008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'21790","reported_seq":21852,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.884439+0000","last_change":"2026-02-24T08:21:54.792497+0000","last_active":"2026-02-24T08:21:59.884439+0000","last_peered":"2026-02-24T08:21:59.884439+0000","last_clean":"2026-02-24T08:21:59.884439+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:21:59.884439+0000","last_undegraded":"2026-02-24T08:21:59.884439+0000","last_fullsized":"2026-02-24T08:21:59.884439+0000","mapping_epoch":27,"log_start":"37'11700","ondisk_log_start":"37'11700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20840","last_scrub_stamp":"2026-02-24T08:21:54.792423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:54.792423+0000","objects_scrubbed":2591,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:17.044925+0000","scrub_duration":927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178503680,"num_objects":2724,"num_object_clones":0,"num_object_copies":8172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21790,"num_write_kb":174320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'22912","reported_seq":22975,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.896254+0000","last_change":"2026-02-24T08:21:43.625296+0000","last_active":"2026-02-24T08:21:59.896254+0000","last_peered":"2026-02-24T08:21:59.896254+0000","last_clean":"2026-02-24T08:21:59.896254+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:21:59.896254+0000","last_undegraded":"2026-02-24T08:21:59.896254+0000","last_fullsized":"2026-02-24T08:21:59.896254+0000","mapping_epoch":27,"log_start":"37'12900","ondisk_log_start":"37'12900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:43.625255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:43.625255+0000","objects_scrubbed":2406,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:52.790484+0000","scrub_duration":1684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187695104,"num_objects":2864,"num_object_clones":0,"num_object_copies":8592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2864,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22912,"num_write_kb":183296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'22392","reported_seq":22422,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.913860+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:21:59.913860+0000","last_peered":"2026-02-24T08:21:59.913860+0000","last_clean":"2026-02-24T08:21:59.913860+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:21:59.913860+0000","last_undegraded":"2026-02-24T08:21:59.913860+0000","last_fullsized":"2026-02-24T08:21:59.913860+0000","mapping_epoch":27,"log_start":"37'12300","ondisk_log_start":"37'12300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:02.088391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183435264,"num_objects":2799,"num_object_clones":0,"num_object_copies":8397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2799,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22392,"num_write_kb":179136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'22136","reported_seq":22201,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:59.833704+0000","last_change":"2026-02-24T08:21:59.185489+0000","last_active":"2026-02-24T08:21:59.833704+0000","last_peered":"2026-02-24T08:21:59.833704+0000","last_clean":"2026-02-24T08:21:59.833704+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:21:59.833704+0000","last_undegraded":"2026-02-24T08:21:59.833704+0000","last_fullsized":"2026-02-24T08:21:59.833704+0000","mapping_epoch":27,"log_start":"37'12100","ondisk_log_start":"37'12100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22024","last_scrub_stamp":"2026-02-24T08:21:59.185449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:59.185449+0000","objects_scrubbed":2749,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:05.198861+0000","scrub_duration":615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181338112,"num_objects":2767,"num_object_clones":0,"num_object_copies":8301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2767,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22136,"num_write_kb":177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2951847936,"num_objects":45043,"num_object_clones":0,"num_object_copies":135129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360333,"num_write_kb":2882664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8851005440,"data_stored":8851005440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160833,"ondisk_log_size":160833,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247830,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3084412,"kb_used_data":2515880,"kb_used_omap":13,"kb_used_meta":568498,"kb_avail":730918788,"statfs":{"total":751619276800,"available":748460838912,"internally_reserved":0,"allocated":2576261120,"data_stored":2576026959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13992,"internal_metadata":582142296},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444056,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2398292,"kb_used_data":1974272,"kb_used_omap":17,"kb_used_meta":423982,"kb_avail":731604908,"statfs":{"total":751619276800,"available":749163425792,"internally_reserved":0,"allocated":2021654528,"data_stored":2021420367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":434158100},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,3,5,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2669368,"kb_used_data":2173156,"kb_used_omap":19,"kb_used_meta":496172,"kb_avail":731333832,"statfs":{"total":751619276800,"available":748885843968,"internally_reserved":0,"allocated":2225311744,"data_stored":2225081135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":508080755},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2386364,"kb_used_data":1962344,"kb_used_omap":21,"kb_used_meta":423978,"kb_avail":731616836,"statfs":{"total":751619276800,"available":749175640064,"internally_reserved":0,"allocated":2009440256,"data_stored":2009206095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":434153543},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,0,3,6,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2013954048,"data_stored":2013954048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2226315264,"data_stored":2226315264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2028183552,"data_stored":2028183552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2582552576,"data_stored":2582552576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:22:01.238 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 41 2026-02-24T08:22:01.296 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:01.421 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:01.419+0000 7fb390d6b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:01.421 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:01.419+0000 7fb390d6b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:01.424 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:01.438 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:01.438 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:01.452 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:01.452 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:01.465 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:01.466 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:01.481 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:01.481 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:01.554 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:01.552+0000 7febff2b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:01.554 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:01.553+0000 7febff2b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:01.699 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:22:01.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:22:01.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 84 128 367489 367361 34.1639 24.8828 0.0326654 0.02926 2026-02-24T08:22:02.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:01 trial105 ceph-mon[39442]: pgmap v60: 17 pgs: 17 active+clean; 2.7 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.34k op/s 2026-02-24T08:22:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3805319432' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/232948000' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "41"} : dispatch 2026-02-24T08:22:02.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 85 128 371100 370972 34.0938 28.2109 0.0144959 0.0293182 2026-02-24T08:22:03.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:02 trial105 ceph-mon[39442]: from='client.14484 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:22:03.536 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:03.685 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:03.821 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:03.818+0000 7f1ebd177640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:03.821 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:03.818+0000 7f1ebd177640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:03.821 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:03 trial105 ceph-mon[39442]: pgmap v61: 17 pgs: 17 active+clean; 2.7 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.95k op/s 2026-02-24T08:22:03.838 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:03.838 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:03.852 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:03.852 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:03.866 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:03.866 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:03.880 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:03.880 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:03.963 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 86 128 374684 374556 34.023 28 0.0399738 0.0293831 2026-02-24T08:22:04.964 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 87 127 378341 378214 33.9604 28.5781 0.00986395 0.0294371 2026-02-24T08:22:05.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:04 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1797544936' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:05.927 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:05.964 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 88 128 381790 381662 33.8805 26.9375 0.0497348 0.0295058 2026-02-24T08:22:06.071 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:06.096 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:05 trial105 ceph-mon[39442]: pgmap v62: 17 pgs: 17 active+clean; 2.7 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.95k op/s 2026-02-24T08:22:06.200 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:06.197+0000 7f9510dda640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:06.200 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:06.197+0000 7f9510dda640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:06.215 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:06.215 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:06.229 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:06.230 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:06.246 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:06.246 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:06.260 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:06.260 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:06.737 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:06.737 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:06.737 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:22:06.875 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:06.964 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 89 127 385235 385108 33.8023 26.9219 0.0164922 0.0295705 2026-02-24T08:22:06.998 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:06.994+0000 7f1f94df5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:06.998 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:06.995+0000 7f1f94df5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:07.147 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:22:07.147 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:22:07.148 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:06 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2662302414' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:07.192 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2026-02-24T08:22:06.699455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3097887264,"num_objects":47266,"num_object_clones":0,"num_object_copies":141798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47266,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":378223,"num_write_kb":3026854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160987,"ondisk_log_size":160987,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11053324,"kb_used_data":9050300,"kb_used_omap":72,"kb_used_meta":2002871,"kb_avail":2924959476,"statfs":{"total":3006477107200,"available":2995158503424,"internally_reserved":0,"allocated":9267507200,"data_stored":9266574108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74202,"internal_metadata":2050940454},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,6,17,18,29,54,19],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":435462144,"num_objects":6645,"num_object_clones":0,"num_object_copies":19935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53157,"num_write_kb":425256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001562"},"pg_stats":[{"pgid":"2.f","version":"37'23019","reported_seq":23049,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.787337+0000","last_change":"2026-02-24T08:20:36.862231+0000","last_active":"2026-02-24T08:22:04.787337+0000","last_peered":"2026-02-24T08:22:04.787337+0000","last_clean":"2026-02-24T08:22:04.787337+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:22:04.787337+0000","last_undegraded":"2026-02-24T08:22:04.787337+0000","last_fullsized":"2026-02-24T08:22:04.787337+0000","mapping_epoch":27,"log_start":"37'13000","ondisk_log_start":"37'13000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188571648,"num_objects":2878,"num_object_clones":0,"num_object_copies":8634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23019,"num_write_kb":184152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'23276","reported_seq":23337,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.952152+0000","last_change":"2026-02-24T08:21:40.186143+0000","last_active":"2026-02-24T08:22:04.952152+0000","last_peered":"2026-02-24T08:22:04.952152+0000","last_clean":"2026-02-24T08:22:04.952152+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:22:04.952152+0000","last_undegraded":"2026-02-24T08:22:04.952152+0000","last_fullsized":"2026-02-24T08:22:04.952152+0000","mapping_epoch":27,"log_start":"37'13200","ondisk_log_start":"37'13200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18352","last_scrub_stamp":"2026-02-24T08:21:40.186089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:40.186089+0000","objects_scrubbed":2283,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:43.505159+0000","scrub_duration":1258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190676992,"num_objects":2910,"num_object_clones":0,"num_object_copies":8730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2910,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23276,"num_write_kb":186208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'23921","reported_seq":23950,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.942806+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:22:04.942806+0000","last_peered":"2026-02-24T08:22:04.942806+0000","last_clean":"2026-02-24T08:22:04.942806+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:22:04.942806+0000","last_undegraded":"2026-02-24T08:22:04.942806+0000","last_fullsized":"2026-02-24T08:22:04.942806+0000","mapping_epoch":27,"log_start":"37'13900","ondisk_log_start":"37'13900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:05.288011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195960832,"num_objects":2991,"num_object_clones":0,"num_object_copies":8973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2991,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23921,"num_write_kb":191368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'23232","reported_seq":23297,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.929607+0000","last_change":"2026-02-24T08:21:56.590599+0000","last_active":"2026-02-24T08:22:04.929607+0000","last_peered":"2026-02-24T08:22:04.929607+0000","last_clean":"2026-02-24T08:22:04.929607+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:22:04.929607+0000","last_undegraded":"2026-02-24T08:22:04.929607+0000","last_fullsized":"2026-02-24T08:22:04.929607+0000","mapping_epoch":27,"log_start":"37'13200","ondisk_log_start":"37'13200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21520","last_scrub_stamp":"2026-02-24T08:21:56.590561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:56.590561+0000","objects_scrubbed":2664,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:21.899136+0000","scrub_duration":1633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190316544,"num_objects":2904,"num_object_clones":0,"num_object_copies":8712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23232,"num_write_kb":185856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:27.721605+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:21:27.721605+0000","last_peered":"2026-02-24T08:21:27.721605+0000","last_clean":"2026-02-24T08:21:27.721605+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:27.721605+0000","last_undegraded":"2026-02-24T08:21:27.721605+0000","last_fullsized":"2026-02-24T08:21:27.721605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'23512","reported_seq":23575,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.876876+0000","last_change":"2026-02-24T08:21:48.819991+0000","last_active":"2026-02-24T08:22:04.876876+0000","last_peered":"2026-02-24T08:22:04.876876+0000","last_clean":"2026-02-24T08:22:04.876876+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:22:04.876876+0000","last_undegraded":"2026-02-24T08:22:04.876876+0000","last_fullsized":"2026-02-24T08:22:04.876876+0000","mapping_epoch":27,"log_start":"37'13500","ondisk_log_start":"37'13500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20032","last_scrub_stamp":"2026-02-24T08:21:48.819949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:48.819949+0000","objects_scrubbed":2492,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.299009+0000","scrub_duration":1176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192610304,"num_objects":2939,"num_object_clones":0,"num_object_copies":8817,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2939,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23512,"num_write_kb":188096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'23344","reported_seq":23403,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.916226+0000","last_change":"2026-02-24T08:21:46.276112+0000","last_active":"2026-02-24T08:22:04.916226+0000","last_peered":"2026-02-24T08:22:04.916226+0000","last_clean":"2026-02-24T08:22:04.916226+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:22:04.916226+0000","last_undegraded":"2026-02-24T08:22:04.916226+0000","last_fullsized":"2026-02-24T08:22:04.916226+0000","mapping_epoch":27,"log_start":"37'13300","ondisk_log_start":"37'13300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19224","last_scrub_stamp":"2026-02-24T08:21:46.275979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:46.275979+0000","objects_scrubbed":2389,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:13.488831+0000","scrub_duration":744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191234048,"num_objects":2918,"num_object_clones":0,"num_object_copies":8754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23344,"num_write_kb":186752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'23376","reported_seq":23406,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.950166+0000","last_change":"2026-02-24T08:20:36.865140+0000","last_active":"2026-02-24T08:22:04.950166+0000","last_peered":"2026-02-24T08:22:04.950166+0000","last_clean":"2026-02-24T08:22:04.950166+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:22:04.950166+0000","last_undegraded":"2026-02-24T08:22:04.950166+0000","last_fullsized":"2026-02-24T08:22:04.950166+0000","mapping_epoch":27,"log_start":"37'13300","ondisk_log_start":"37'13300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191496192,"num_objects":2922,"num_object_clones":0,"num_object_copies":8766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2922,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23376,"num_write_kb":187008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'24220","reported_seq":24282,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.897372+0000","last_change":"2026-02-24T08:21:47.926225+0000","last_active":"2026-02-24T08:22:04.897372+0000","last_peered":"2026-02-24T08:22:04.897372+0000","last_clean":"2026-02-24T08:22:04.897372+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:22:04.897372+0000","last_undegraded":"2026-02-24T08:22:04.897372+0000","last_fullsized":"2026-02-24T08:22:04.897372+0000","mapping_epoch":27,"log_start":"37'14200","ondisk_log_start":"37'14200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20632","last_scrub_stamp":"2026-02-24T08:21:47.926183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:47.926183+0000","objects_scrubbed":2561,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:08.888599+0000","scrub_duration":1419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198410240,"num_objects":3028,"num_object_clones":0,"num_object_copies":9084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24220,"num_write_kb":193760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'24056","reported_seq":24119,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.903401+0000","last_change":"2026-02-24T08:21:49.267866+0000","last_active":"2026-02-24T08:22:04.903401+0000","last_peered":"2026-02-24T08:22:04.903401+0000","last_clean":"2026-02-24T08:22:04.903401+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:22:04.903401+0000","last_undegraded":"2026-02-24T08:22:04.903401+0000","last_fullsized":"2026-02-24T08:22:04.903401+0000","mapping_epoch":27,"log_start":"37'14000","ondisk_log_start":"37'14000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20304","last_scrub_stamp":"2026-02-24T08:21:49.267806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:49.267806+0000","objects_scrubbed":2538,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.447822+0000","scrub_duration":392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197066752,"num_objects":3007,"num_object_clones":0,"num_object_copies":9021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3007,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24056,"num_write_kb":192448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'23696","reported_seq":23756,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.906474+0000","last_change":"2026-02-24T08:21:42.314595+0000","last_active":"2026-02-24T08:22:04.906474+0000","last_peered":"2026-02-24T08:22:04.906474+0000","last_clean":"2026-02-24T08:22:04.906474+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:22:04.906474+0000","last_undegraded":"2026-02-24T08:22:04.906474+0000","last_fullsized":"2026-02-24T08:22:04.906474+0000","mapping_epoch":27,"log_start":"37'13600","ondisk_log_start":"37'13600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18560","last_scrub_stamp":"2026-02-24T08:21:42.314562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.314562+0000","objects_scrubbed":2308,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:07.041335+0000","scrub_duration":557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194117632,"num_objects":2962,"num_object_clones":0,"num_object_copies":8886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23696,"num_write_kb":189568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'24056","reported_seq":24086,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.940947+0000","last_change":"2026-02-24T08:20:36.865055+0000","last_active":"2026-02-24T08:22:04.940947+0000","last_peered":"2026-02-24T08:22:04.940947+0000","last_clean":"2026-02-24T08:22:04.940947+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:22:04.940947+0000","last_undegraded":"2026-02-24T08:22:04.940947+0000","last_fullsized":"2026-02-24T08:22:04.940947+0000","mapping_epoch":27,"log_start":"37'14000","ondisk_log_start":"37'14000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197066752,"num_objects":3007,"num_object_clones":0,"num_object_copies":9021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3007,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24056,"num_write_kb":192448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'24192","reported_seq":24254,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.843758+0000","last_change":"2026-02-24T08:21:42.956407+0000","last_active":"2026-02-24T08:22:04.843758+0000","last_peered":"2026-02-24T08:22:04.843758+0000","last_clean":"2026-02-24T08:22:04.843758+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:22:04.843758+0000","last_undegraded":"2026-02-24T08:22:04.843758+0000","last_fullsized":"2026-02-24T08:22:04.843758+0000","mapping_epoch":27,"log_start":"37'14100","ondisk_log_start":"37'14100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:42.956364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.956364+0000","objects_scrubbed":2416,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:45.767859+0000","scrub_duration":407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198180864,"num_objects":3024,"num_object_clones":0,"num_object_copies":9072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24192,"num_write_kb":193536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'22984","reported_seq":23048,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.891163+0000","last_change":"2026-02-24T08:21:54.792497+0000","last_active":"2026-02-24T08:22:04.891163+0000","last_peered":"2026-02-24T08:22:04.891163+0000","last_clean":"2026-02-24T08:22:04.891163+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:22:04.891163+0000","last_undegraded":"2026-02-24T08:22:04.891163+0000","last_fullsized":"2026-02-24T08:22:04.891163+0000","mapping_epoch":27,"log_start":"37'12900","ondisk_log_start":"37'12900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20840","last_scrub_stamp":"2026-02-24T08:21:54.792423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:54.792423+0000","objects_scrubbed":2591,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:17.044925+0000","scrub_duration":927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188284928,"num_objects":2873,"num_object_clones":0,"num_object_copies":8619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2873,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22984,"num_write_kb":183872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'24192","reported_seq":24255,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.943964+0000","last_change":"2026-02-24T08:21:43.625296+0000","last_active":"2026-02-24T08:22:04.943964+0000","last_peered":"2026-02-24T08:22:04.943964+0000","last_clean":"2026-02-24T08:22:04.943964+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:22:04.943964+0000","last_undegraded":"2026-02-24T08:22:04.943964+0000","last_fullsized":"2026-02-24T08:22:04.943964+0000","mapping_epoch":27,"log_start":"37'14100","ondisk_log_start":"37'14100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:43.625255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:43.625255+0000","objects_scrubbed":2406,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:52.790484+0000","scrub_duration":1684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198180864,"num_objects":3024,"num_object_clones":0,"num_object_copies":9072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24192,"num_write_kb":193536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'23668","reported_seq":23695,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.924848+0000","last_change":"2026-02-24T08:20:36.865194+0000","last_active":"2026-02-24T08:22:04.924848+0000","last_peered":"2026-02-24T08:22:04.924848+0000","last_clean":"2026-02-24T08:22:04.924848+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:22:04.924848+0000","last_undegraded":"2026-02-24T08:22:04.924848+0000","last_fullsized":"2026-02-24T08:22:04.924848+0000","mapping_epoch":27,"log_start":"37'13600","ondisk_log_start":"37'13600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193888256,"num_objects":2959,"num_object_clones":0,"num_object_copies":8877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2959,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23668,"num_write_kb":189344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'23344","reported_seq":23404,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:04.916944+0000","last_change":"2026-02-24T08:21:59.185489+0000","last_active":"2026-02-24T08:22:04.916944+0000","last_peered":"2026-02-24T08:22:04.916944+0000","last_clean":"2026-02-24T08:22:04.916944+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:22:04.916944+0000","last_undegraded":"2026-02-24T08:22:04.916944+0000","last_fullsized":"2026-02-24T08:22:04.916944+0000","mapping_epoch":27,"log_start":"37'13300","ondisk_log_start":"37'13300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22024","last_scrub_stamp":"2026-02-24T08:21:59.185449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:59.185449+0000","objects_scrubbed":2749,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:05.198861+0000","scrub_duration":615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191234048,"num_objects":2918,"num_object_clones":0,"num_object_copies":8754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23344,"num_write_kb":186752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":3097296896,"num_objects":47264,"num_object_clones":0,"num_object_copies":141792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378088,"num_write_kb":3024704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9286524928,"data_stored":9286524928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160888,"ondisk_log_size":160888,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247831,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3224876,"kb_used_data":2638296,"kb_used_omap":13,"kb_used_meta":586546,"kb_avail":730778324,"statfs":{"total":751619276800,"available":748317003776,"internally_reserved":0,"allocated":2701615104,"data_stored":2701380943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13992,"internal_metadata":600623448},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,9,6,11,21,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444057,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2514284,"kb_used_data":2072216,"kb_used_omap":17,"kb_used_meta":442030,"kb_avail":731488916,"statfs":{"total":751619276800,"available":749044649984,"internally_reserved":0,"allocated":2121949184,"data_stored":2121715023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":452639252},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2812944,"kb_used_data":2280636,"kb_used_omap":19,"kb_used_meta":532268,"kb_avail":731190256,"statfs":{"total":751619276800,"available":748738822144,"internally_reserved":0,"allocated":2335371264,"data_stored":2335140655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":545043059},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,4,8,12,18,33,17],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2501220,"kb_used_data":2059152,"kb_used_omap":21,"kb_used_meta":442026,"kb_avail":731501980,"statfs":{"total":751619276800,"available":749058027520,"internally_reserved":0,"allocated":2108571648,"data_stored":2108337487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":452634695},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2114011136,"data_stored":2114011136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2335342592,"data_stored":2335342592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2127708160,"data_stored":2127708160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2709463040,"data_stored":2709463040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:22:07.964 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 90 111 388669 388558 33.7262 26.9531 0.0671631 0.0296394 2026-02-24T08:22:08.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:07 trial105 ceph-mon[39442]: pgmap v63: 17 pgs: 17 active+clean; 2.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.43k op/s 2026-02-24T08:22:08.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:07 trial105 ceph-mon[39442]: 2.6 scrub starts 2026-02-24T08:22:08.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:07 trial105 ceph-mon[39442]: 2.f scrub starts 2026-02-24T08:22:08.307 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:08.423 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:08.522 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:08.519+0000 7f33659f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:08.523 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:08.520+0000 7f33659f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:08.535 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:08.535 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:08.545 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:08.546 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:08.556 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:08.556 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:08.567 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:08.567 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:08.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:08 trial105 ceph-mon[39442]: from='client.14494 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:22:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:08 trial105 ceph-mon[39442]: 2.6 scrub ok 2026-02-24T08:22:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:08 trial105 ceph-mon[39442]: 2.a scrub starts 2026-02-24T08:22:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:08 trial105 ceph-mon[39442]: 2.f scrub ok 2026-02-24T08:22:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:08 trial105 ceph-mon[39442]: 2.a scrub ok 2026-02-24T08:22:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4071922138' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:08.964 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total time run: 90.0539 2026-02-24T08:22:08.964 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total writes made: 388669 2026-02-24T08:22:08.964 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Write size: 8192 2026-02-24T08:22:08.964 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object size: 65536 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Bandwidth (MB/sec): 33.7185 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Bandwidth: 11.7563 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max bandwidth (MB/sec): 70.5781 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min bandwidth (MB/sec): 20.6484 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average IOPS: 4315 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev IOPS: 1504.81 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max IOPS: 9034 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min IOPS: 2643 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average Latency(s): 0.0296466 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Latency(s): 0.0217602 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max latency(s): 0.19461 2026-02-24T08:22:08.965 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min latency(s): 0.000730736 2026-02-24T08:22:08.972 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:22:09.807 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:22:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:22:09] "GET /metrics HTTP/1.1" 200 4206 "" "Prometheus/3.6.0" 2026-02-24T08:22:09.841 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:22:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:22:09.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:22:10.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:09 trial105 ceph-mon[39442]: pgmap v64: 17 pgs: 17 active+clean; 2.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.92k op/s 2026-02-24T08:22:10.604 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:10.750 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:10.932 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:10 trial105 ceph-mon[39442]: 2.1 scrub starts 2026-02-24T08:22:11.103 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:11.099+0000 7f6a463a5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:11.103 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:11.101+0000 7f6a463a5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:11.119 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:11.119 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:11.140 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:11.141 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:11.155 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:11.155 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:11.171 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:11.171 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:12.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:11 trial105 ceph-mon[39442]: pgmap v65: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 30 MiB/s wr, 4.11k op/s 2026-02-24T08:22:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:11 trial105 ceph-mon[39442]: 2.d scrub starts 2026-02-24T08:22:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1004806350' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:12.195 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:12.195 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:12.195 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_0 2026-02-24T08:22:12.196 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:22:12.343 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:12.487 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:12.483+0000 7fe405109640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:12.487 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:12.484+0000 7fe405109640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:12.642 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:22:12.642 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:22:12.688 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2026-02-24T08:22:10.700062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2944377400,"num_objects":44922,"num_object_clones":0,"num_object_copies":134766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44922,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":392470,"num_write_kb":3111503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161034,"ondisk_log_size":161034,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10939216,"kb_used_data":8845504,"kb_used_omap":72,"kb_used_meta":2093111,"kb_avail":2925073584,"statfs":{"total":3006477107200,"available":2995275350016,"internally_reserved":0,"allocated":9057796096,"data_stored":9056850788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74202,"internal_metadata":2143346214},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":133808152,"num_objects":2040,"num_object_clones":0,"num_object_copies":6120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2040,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":49320,"num_write_kb":365233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001639"},"pg_stats":[{"pgid":"2.f","version":"37'23835","reported_seq":23899,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.807699+0000","last_change":"2026-02-24T08:22:08.011103+0000","last_active":"2026-02-24T08:22:09.807699+0000","last_peered":"2026-02-24T08:22:09.807699+0000","last_clean":"2026-02-24T08:22:09.807699+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:22:09.807699+0000","last_undegraded":"2026-02-24T08:22:09.807699+0000","last_fullsized":"2026-02-24T08:22:09.807699+0000","mapping_epoch":27,"log_start":"37'13800","ondisk_log_start":"37'13800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'23648","last_scrub_stamp":"2026-02-24T08:22:08.011059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:22:08.011059+0000","objects_scrubbed":2953,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:16.163912+0000","scrub_duration":589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181469184,"num_objects":2769,"num_object_clones":0,"num_object_copies":8307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23835,"num_write_kb":189184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'24167","reported_seq":24230,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.965061+0000","last_change":"2026-02-24T08:21:40.186143+0000","last_active":"2026-02-24T08:22:09.965061+0000","last_peered":"2026-02-24T08:22:09.965061+0000","last_clean":"2026-02-24T08:22:09.965061+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:22:09.965061+0000","last_undegraded":"2026-02-24T08:22:09.965061+0000","last_fullsized":"2026-02-24T08:22:09.965061+0000","mapping_epoch":27,"log_start":"37'14100","ondisk_log_start":"37'14100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18352","last_scrub_stamp":"2026-02-24T08:21:40.186089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:40.186089+0000","objects_scrubbed":2283,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:43.505159+0000","scrub_duration":1258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":8283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24167,"num_write_kb":191488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'24665","reported_seq":24696,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.982703+0000","last_change":"2026-02-24T08:20:36.865074+0000","last_active":"2026-02-24T08:22:09.982703+0000","last_peered":"2026-02-24T08:22:09.982703+0000","last_clean":"2026-02-24T08:22:09.982703+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:22:09.982703+0000","last_undegraded":"2026-02-24T08:22:09.982703+0000","last_fullsized":"2026-02-24T08:22:09.982703+0000","mapping_epoch":27,"log_start":"37'14600","ondisk_log_start":"37'14600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183762968,"num_objects":2805,"num_object_clones":0,"num_object_copies":8415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2805,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24665,"num_write_kb":195329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'24259","reported_seq":24324,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.955571+0000","last_change":"2026-02-24T08:21:56.590599+0000","last_active":"2026-02-24T08:22:09.955571+0000","last_peered":"2026-02-24T08:22:09.955571+0000","last_clean":"2026-02-24T08:22:09.955571+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:22:09.955571+0000","last_undegraded":"2026-02-24T08:22:09.955571+0000","last_fullsized":"2026-02-24T08:22:09.955571+0000","mapping_epoch":27,"log_start":"37'14200","ondisk_log_start":"37'14200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21520","last_scrub_stamp":"2026-02-24T08:21:56.590561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:56.590561+0000","objects_scrubbed":2664,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:21.899136+0000","scrub_duration":1633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183762944,"num_objects":2804,"num_object_clones":0,"num_object_copies":8412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2804,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24259,"num_write_kb":192448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:27.721605+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:21:27.721605+0000","last_peered":"2026-02-24T08:21:27.721605+0000","last_clean":"2026-02-24T08:21:27.721605+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:27.721605+0000","last_undegraded":"2026-02-24T08:21:27.721605+0000","last_fullsized":"2026-02-24T08:21:27.721605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'24446","reported_seq":24509,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.933683+0000","last_change":"2026-02-24T08:21:48.819991+0000","last_active":"2026-02-24T08:22:09.933683+0000","last_peered":"2026-02-24T08:22:09.933683+0000","last_clean":"2026-02-24T08:22:09.933683+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:22:09.933683+0000","last_undegraded":"2026-02-24T08:22:09.933683+0000","last_fullsized":"2026-02-24T08:22:09.933683+0000","mapping_epoch":27,"log_start":"37'14400","ondisk_log_start":"37'14400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20032","last_scrub_stamp":"2026-02-24T08:21:48.819949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:48.819949+0000","objects_scrubbed":2492,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.299009+0000","scrub_duration":1176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184483840,"num_objects":2815,"num_object_clones":0,"num_object_copies":8445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24446,"num_write_kb":193856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'24251","reported_seq":24312,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.931680+0000","last_change":"2026-02-24T08:21:46.276112+0000","last_active":"2026-02-24T08:22:09.931680+0000","last_peered":"2026-02-24T08:22:09.931680+0000","last_clean":"2026-02-24T08:22:09.931680+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:22:09.931680+0000","last_undegraded":"2026-02-24T08:22:09.931680+0000","last_fullsized":"2026-02-24T08:22:09.931680+0000","mapping_epoch":27,"log_start":"37'14200","ondisk_log_start":"37'14200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19224","last_scrub_stamp":"2026-02-24T08:21:46.275979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:46.275979+0000","objects_scrubbed":2389,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:13.488831+0000","scrub_duration":744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184287232,"num_objects":2812,"num_object_clones":0,"num_object_copies":8436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24251,"num_write_kb":192448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'24316","reported_seq":24342,"reported_epoch":37,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:22:09.976781+0000","last_change":"2026-02-24T08:22:09.877386+0000","last_active":"2026-02-24T08:22:09.976781+0000","last_peered":"2026-02-24T08:22:09.976781+0000","last_clean":"2026-02-24T08:22:09.976781+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:22:09.976781+0000","last_undegraded":"2026-02-24T08:22:09.976781+0000","last_fullsized":"2026-02-24T08:22:09.976781+0000","mapping_epoch":27,"log_start":"37'14300","ondisk_log_start":"37'14300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:20:35.854055+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"Reserving. Waiting 1s for OSD.3 (2/2)","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182386688,"num_objects":2783,"num_object_clones":0,"num_object_copies":8349,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24316,"num_write_kb":192704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'25158","reported_seq":25222,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.931075+0000","last_change":"2026-02-24T08:21:47.926225+0000","last_active":"2026-02-24T08:22:09.931075+0000","last_peered":"2026-02-24T08:22:09.931075+0000","last_clean":"2026-02-24T08:22:09.931075+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:22:09.931075+0000","last_undegraded":"2026-02-24T08:22:09.931075+0000","last_fullsized":"2026-02-24T08:22:09.931075+0000","mapping_epoch":27,"log_start":"37'15100","ondisk_log_start":"37'15100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20632","last_scrub_stamp":"2026-02-24T08:21:47.926183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:47.926183+0000","objects_scrubbed":2561,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:08.888599+0000","scrub_duration":1419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188547072,"num_objects":2877,"num_object_clones":0,"num_object_copies":8631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'24842","reported_seq":24904,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.967827+0000","last_change":"2026-02-24T08:21:49.267866+0000","last_active":"2026-02-24T08:22:09.967827+0000","last_peered":"2026-02-24T08:22:09.967827+0000","last_clean":"2026-02-24T08:22:09.967827+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:22:09.967827+0000","last_undegraded":"2026-02-24T08:22:09.967827+0000","last_fullsized":"2026-02-24T08:22:09.967827+0000","mapping_epoch":27,"log_start":"37'14800","ondisk_log_start":"37'14800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20304","last_scrub_stamp":"2026-02-24T08:21:49.267806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:49.267806+0000","objects_scrubbed":2538,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.447822+0000","scrub_duration":392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184483840,"num_objects":2815,"num_object_clones":0,"num_object_copies":8445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24842,"num_write_kb":196672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'24629","reported_seq":24690,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.951091+0000","last_change":"2026-02-24T08:21:42.314595+0000","last_active":"2026-02-24T08:22:09.951091+0000","last_peered":"2026-02-24T08:22:09.951091+0000","last_clean":"2026-02-24T08:22:09.951091+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:22:09.951091+0000","last_undegraded":"2026-02-24T08:22:09.951091+0000","last_fullsized":"2026-02-24T08:22:09.951091+0000","mapping_epoch":27,"log_start":"37'14600","ondisk_log_start":"37'14600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18560","last_scrub_stamp":"2026-02-24T08:21:42.314562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.314562+0000","objects_scrubbed":2308,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:07.041335+0000","scrub_duration":557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183697408,"num_objects":2803,"num_object_clones":0,"num_object_copies":8409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2803,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24629,"num_write_kb":195072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'24966","reported_seq":25035,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.986258+0000","last_change":"2026-02-24T08:22:07.820756+0000","last_active":"2026-02-24T08:22:09.986258+0000","last_peered":"2026-02-24T08:22:09.986258+0000","last_clean":"2026-02-24T08:22:09.986258+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:22:09.986258+0000","last_undegraded":"2026-02-24T08:22:09.986258+0000","last_fullsized":"2026-02-24T08:22:09.986258+0000","mapping_epoch":27,"log_start":"37'14900","ondisk_log_start":"37'14900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24696","last_scrub_stamp":"2026-02-24T08:22:07.820675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:22:07.820675+0000","objects_scrubbed":3080,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:22.325541+0000","scrub_duration":880,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186384384,"num_objects":2844,"num_object_clones":0,"num_object_copies":8532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2844,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24966,"num_write_kb":197760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'25194","reported_seq":25255,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.952844+0000","last_change":"2026-02-24T08:21:42.956407+0000","last_active":"2026-02-24T08:22:09.952844+0000","last_peered":"2026-02-24T08:22:09.952844+0000","last_clean":"2026-02-24T08:22:09.952844+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:22:09.952844+0000","last_undegraded":"2026-02-24T08:22:09.952844+0000","last_fullsized":"2026-02-24T08:22:09.952844+0000","mapping_epoch":27,"log_start":"37'15100","ondisk_log_start":"37'15100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:42.956364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.956364+0000","objects_scrubbed":2416,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:45.767859+0000","scrub_duration":407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189136896,"num_objects":2886,"num_object_clones":0,"num_object_copies":8658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2886,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25194,"num_write_kb":199680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'23886","reported_seq":23948,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.941260+0000","last_change":"2026-02-24T08:21:54.792497+0000","last_active":"2026-02-24T08:22:09.941260+0000","last_peered":"2026-02-24T08:22:09.941260+0000","last_clean":"2026-02-24T08:22:09.941260+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:22:09.941260+0000","last_undegraded":"2026-02-24T08:22:09.941260+0000","last_fullsized":"2026-02-24T08:22:09.941260+0000","mapping_epoch":27,"log_start":"37'13800","ondisk_log_start":"37'13800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20840","last_scrub_stamp":"2026-02-24T08:21:54.792423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:54.792423+0000","objects_scrubbed":2591,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:17.044925+0000","scrub_duration":927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178716672,"num_objects":2727,"num_object_clones":0,"num_object_copies":8181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23886,"num_write_kb":189248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'24991","reported_seq":25047,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.966920+0000","last_change":"2026-02-24T08:21:43.625296+0000","last_active":"2026-02-24T08:22:09.966920+0000","last_peered":"2026-02-24T08:22:09.966920+0000","last_clean":"2026-02-24T08:22:09.966920+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:22:09.966920+0000","last_undegraded":"2026-02-24T08:22:09.966920+0000","last_fullsized":"2026-02-24T08:22:09.966920+0000","mapping_epoch":27,"log_start":"37'14900","ondisk_log_start":"37'14900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:43.625255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:43.625255+0000","objects_scrubbed":2406,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:52.790484+0000","scrub_duration":1684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186884096,"num_objects":2852,"num_object_clones":0,"num_object_copies":8556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2852,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24991,"num_write_kb":197992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'24553","reported_seq":24615,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.973447+0000","last_change":"2026-02-24T08:22:08.118212+0000","last_active":"2026-02-24T08:22:09.973447+0000","last_peered":"2026-02-24T08:22:09.973447+0000","last_clean":"2026-02-24T08:22:09.973447+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:22:09.973447+0000","last_undegraded":"2026-02-24T08:22:09.973447+0000","last_fullsized":"2026-02-24T08:22:09.973447+0000","mapping_epoch":27,"log_start":"37'14500","ondisk_log_start":"37'14500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24320","last_scrub_stamp":"2026-02-24T08:22:08.118165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:22:08.118165+0000","objects_scrubbed":3040,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:19.397777+0000","scrub_duration":218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183959552,"num_objects":2807,"num_object_clones":0,"num_object_copies":8421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2807,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24553,"num_write_kb":194560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'24177","reported_seq":24241,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:09.942527+0000","last_change":"2026-02-24T08:21:59.185489+0000","last_active":"2026-02-24T08:22:09.942527+0000","last_peered":"2026-02-24T08:22:09.942527+0000","last_clean":"2026-02-24T08:22:09.942527+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:22:09.942527+0000","last_undegraded":"2026-02-24T08:22:09.942527+0000","last_fullsized":"2026-02-24T08:22:09.942527+0000","mapping_epoch":27,"log_start":"37'14100","ondisk_log_start":"37'14100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22024","last_scrub_stamp":"2026-02-24T08:21:59.185449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:59.185449+0000","objects_scrubbed":2749,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:05.198861+0000","scrub_duration":615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180879360,"num_objects":2760,"num_object_clones":0,"num_object_copies":8280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2760,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24177,"num_write_kb":191552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":2943787032,"num_objects":44920,"num_object_clones":0,"num_object_copies":134760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44920,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":392335,"num_write_kb":3109353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8875413504,"data_stored":8875401288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160935,"ondisk_log_size":160935,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247832,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3167648,"kb_used_data":2563020,"kb_used_omap":13,"kb_used_meta":604594,"kb_avail":730835552,"statfs":{"total":751619276800,"available":748375605248,"internally_reserved":0,"allocated":2624532480,"data_stored":2624294247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13992,"internal_metadata":619104600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444058,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2540660,"kb_used_data":2062048,"kb_used_omap":17,"kb_used_meta":478126,"kb_avail":731462540,"statfs":{"total":751619276800,"available":749017640960,"internally_reserved":0,"allocated":2111537152,"data_stored":2111302991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":489601556},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2733788,"kb_used_data":2183432,"kb_used_omap":19,"kb_used_meta":550316,"kb_avail":731269412,"statfs":{"total":751619276800,"available":748819877888,"internally_reserved":0,"allocated":2235834368,"data_stored":2235599687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":563524211},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2497120,"kb_used_data":2037004,"kb_used_omap":21,"kb_used_meta":460074,"kb_avail":731506080,"statfs":{"total":751619276800,"available":749062225920,"internally_reserved":0,"allocated":2085892096,"data_stored":2085653863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22457,"internal_metadata":471115847},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2037493760,"data_stored":2037489688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2215620608,"data_stored":2215616536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2043871232,"data_stored":2043871232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2578427904,"data_stored":2578423832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:22:12.690 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:22:12.690 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_0 pg_num 76 2026-02-24T08:22:12.851 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:12.982 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:12.979+0000 7fdb100ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:12.982 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:12.979+0000 7fdb100ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:13.143 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:22:13.217 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:13.460 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:13.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:22:13.591 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:13.587+0000 7f6a1e93c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:13.593 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:13.590+0000 7f6a1e93c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:13.614 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:13.615 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:13.633 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:13.633 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:13.649 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:13.649 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:13.663 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:13.663 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:13 trial105 ceph-mon[39442]: from='client.14500 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:22:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:13 trial105 ceph-mon[39442]: pgmap v66: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 18 MiB/s wr, 2.67k op/s 2026-02-24T08:22:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:13 trial105 ceph-mon[39442]: 2.d scrub ok 2026-02-24T08:22:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2975282905' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_0", "var": "pg_num", "val": "76"} : dispatch 2026-02-24T08:22:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2093418010' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:15.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:22:15.712 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:15.858 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:15.989 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:15.986+0000 7fac74a26640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:15.989 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:15.987+0000 7fac74a26640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:15.989 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:15 trial105 ceph-mon[39442]: pgmap v67: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 18 MiB/s wr, 2.67k op/s 2026-02-24T08:22:15.990 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:15 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:22:15.990 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:15 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:22:16.007 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:16.007 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:16.021 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:16.021 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:16.038 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:16.039 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:16.058 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:16.058 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:17.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3762273454' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:18.106 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:18.132 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:17 trial105 ceph-mon[39442]: pgmap v68: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.7 GiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 18 MiB/s wr, 4.15k op/s 2026-02-24T08:22:18.258 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:18.398 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:18.396+0000 7fb7d70b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:18.399 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:18.397+0000 7fb7d70b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:18.418 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:18.418 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:18.434 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:18.434 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:18.448 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:18.449 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:18.464 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:18.465 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:18.465 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:18.465 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:18.465 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:22:18.465 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:22:18.619 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:18.759 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:18.757+0000 7fc249ec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:18.759 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:18.757+0000 7fc249ec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:22:18.784 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:22:18.785 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:22:18.785 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:22:18.829 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:22:18.830 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:22:18.830 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:22:18.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:18 trial105 ceph-mon[39442]: 2.1 scrub ok 2026-02-24T08:22:18.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1551366301' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:18.984 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:19.114 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:19.112+0000 7fe128203640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:19.114 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:19.113+0000 7fe128203640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:19.138 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:22:19.138 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:22:19.138 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:22:19.138 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:22:19.138 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:22:19.138 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:22:19.138 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:22:19.138 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:22:19.138 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:22:19.139 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:22:19.139 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:22:19.139 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:22:19.181 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:22:19.182 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:22:19.183 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:22:19.335 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:19.493 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:19.491+0000 7ff6dd29b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:19.493 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:19.491+0000 7ff6dd29b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:19.521 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:22:19.521 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:22:19.521 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:22:19.522 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:22:19.522 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:22:19.522 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:22:19.522 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:22:19.522 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:22:19.522 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:22:19.522 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:22:19.522 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:22:19.522 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:22:19.554 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:22:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:22:19] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-24T08:22:19.555 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:22:19.555 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:22:19.556 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:22:19.704 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:19.826 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:19.824+0000 7f85183ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:19.826 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:19.824+0000 7f85183ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:19.848 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:22:19.848 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:22:19.848 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:22:19.848 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:22:19.848 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:22:19.848 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:22:19.848 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:22:19.848 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:22:19.848 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:22:19.849 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:22:19.849 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:22:19.849 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:22:19.886 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:22:19.886 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:22:19.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:22:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:22:19.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:22:20.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:19 trial105 ceph-mon[39442]: pgmap v69: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 1.7 GiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 6.9 MiB/s wr, 2.67k op/s 2026-02-24T08:22:20.525 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:20.680 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:20.809 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:20.807+0000 7fe7e7bab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:20.809 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:20.807+0000 7fe7e7bab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:20.828 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:20.828 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:20.849 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:20.849 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:20.865 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:20.865 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:20.880 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:20.881 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:21.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:20 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2621282001' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:22.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:21 trial105 ceph-mon[39442]: pgmap v70: 17 pgs: 17 active+clean; 575 MiB data, 4.0 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 6.9 MiB/s wr, 4.16k op/s 2026-02-24T08:22:22.501 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Removed 48584 objects 2026-02-24T08:22:22.501 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Clean up completed and total clean up time :13.5283 2026-02-24T08:22:22.930 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:23.049 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:23.146 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:23.143+0000 7f5cc4bad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:23.146 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:23.144+0000 7f5cc4bad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:23.159 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:23.159 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:23.170 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:23.170 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:23.182 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:23.182 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:23.193 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:23.193 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:24.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:23 trial105 ceph-mon[39442]: pgmap v71: 17 pgs: 17 active+clean; 575 MiB data, 4.0 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.98k op/s 2026-02-24T08:22:24.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1393723205' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:24.887 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:24.887 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:24.887 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:22:24.887 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:22:25.003 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:25.104 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:25.101+0000 7ff6f8c77640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:25.104 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:25.102+0000 7ff6f8c77640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:25.211 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:22:25.212 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:22:25.227 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:25.246 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2026-02-24T08:22:24.702061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602776120,"num_objects":9192,"num_object_clones":0,"num_object_copies":27576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9192,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":428200,"num_write_kb":3111503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160964,"ondisk_log_size":160964,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4161616,"kb_used_data":1960000,"kb_used_omap":73,"kb_used_meta":2201398,"kb_avail":2931851184,"statfs":{"total":3006477107200,"available":3002215612416,"internally_reserved":0,"allocated":2007040000,"data_stored":2006094692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74853,"internal_metadata":2254232475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,4,6,6,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2341601280,"num_objects":-35730,"num_object_clones":0,"num_object_copies":-107190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-35730,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35730,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001724"},"pg_stats":[{"pgid":"2.f","version":"37'26028","reported_seq":26094,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:19.841453+0000","last_change":"2026-02-24T08:22:08.011103+0000","last_active":"2026-02-24T08:22:19.841453+0000","last_peered":"2026-02-24T08:22:19.841453+0000","last_clean":"2026-02-24T08:22:19.841453+0000","last_became_active":"2026-02-24T08:20:36.862013+0000","last_became_peered":"2026-02-24T08:20:36.862013+0000","last_unstale":"2026-02-24T08:22:19.841453+0000","last_undegraded":"2026-02-24T08:22:19.841453+0000","last_fullsized":"2026-02-24T08:22:19.841453+0000","mapping_epoch":27,"log_start":"37'16000","ondisk_log_start":"37'16000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'23648","last_scrub_stamp":"2026-02-24T08:22:08.011059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:22:08.011059+0000","objects_scrubbed":2953,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:16.163912+0000","scrub_duration":589,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26028,"num_write_kb":189184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"37'26405","reported_seq":26467,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.032224+0000","last_change":"2026-02-24T08:21:40.186143+0000","last_active":"2026-02-24T08:22:20.032224+0000","last_peered":"2026-02-24T08:22:20.032224+0000","last_clean":"2026-02-24T08:22:20.032224+0000","last_became_active":"2026-02-24T08:20:36.865120+0000","last_became_peered":"2026-02-24T08:20:36.865120+0000","last_unstale":"2026-02-24T08:22:20.032224+0000","last_undegraded":"2026-02-24T08:22:20.032224+0000","last_fullsized":"2026-02-24T08:22:20.032224+0000","mapping_epoch":27,"log_start":"37'16400","ondisk_log_start":"37'16400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18352","last_scrub_stamp":"2026-02-24T08:21:40.186089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:40.186089+0000","objects_scrubbed":2283,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:43.505159+0000","scrub_duration":1258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34275328,"num_objects":523,"num_object_clones":0,"num_object_copies":1569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":523,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26405,"num_write_kb":191488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"37'26926","reported_seq":26991,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.027884+0000","last_change":"2026-02-24T08:22:12.896387+0000","last_active":"2026-02-24T08:22:20.027884+0000","last_peered":"2026-02-24T08:22:20.027884+0000","last_clean":"2026-02-24T08:22:20.027884+0000","last_became_active":"2026-02-24T08:20:36.864581+0000","last_became_peered":"2026-02-24T08:20:36.864581+0000","last_unstale":"2026-02-24T08:22:20.027884+0000","last_undegraded":"2026-02-24T08:22:20.027884+0000","last_fullsized":"2026-02-24T08:22:20.027884+0000","mapping_epoch":27,"log_start":"37'16900","ondisk_log_start":"37'16900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'25328","last_scrub_stamp":"2026-02-24T08:22:12.896330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:22:12.896330+0000","objects_scrubbed":2370,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:27.356418+0000","scrub_duration":2058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586072,"num_objects":544,"num_object_clones":0,"num_object_copies":1632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":544,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":26926,"num_write_kb":195329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"37'26486","reported_seq":26550,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.034457+0000","last_change":"2026-02-24T08:21:56.590599+0000","last_active":"2026-02-24T08:22:20.034457+0000","last_peered":"2026-02-24T08:22:20.034457+0000","last_clean":"2026-02-24T08:22:20.034457+0000","last_became_active":"2026-02-24T08:20:36.865063+0000","last_became_peered":"2026-02-24T08:20:36.865063+0000","last_unstale":"2026-02-24T08:22:20.034457+0000","last_undegraded":"2026-02-24T08:22:20.034457+0000","last_fullsized":"2026-02-24T08:22:20.034457+0000","mapping_epoch":27,"log_start":"37'16400","ondisk_log_start":"37'16400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21520","last_scrub_stamp":"2026-02-24T08:21:56.590561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:56.590561+0000","objects_scrubbed":2664,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:21.899136+0000","scrub_duration":1633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37814272,"num_objects":577,"num_object_clones":0,"num_object_copies":1731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":577,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26486,"num_write_kb":192448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:21:27.721605+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:21:27.721605+0000","last_peered":"2026-02-24T08:21:27.721605+0000","last_clean":"2026-02-24T08:21:27.721605+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:21:27.721605+0000","last_undegraded":"2026-02-24T08:21:27.721605+0000","last_fullsized":"2026-02-24T08:21:27.721605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"37'26683","reported_seq":26743,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:19.987779+0000","last_change":"2026-02-24T08:21:48.819991+0000","last_active":"2026-02-24T08:22:19.987779+0000","last_peered":"2026-02-24T08:22:19.987779+0000","last_clean":"2026-02-24T08:22:19.987779+0000","last_became_active":"2026-02-24T08:20:36.864772+0000","last_became_peered":"2026-02-24T08:20:36.864772+0000","last_unstale":"2026-02-24T08:22:19.987779+0000","last_undegraded":"2026-02-24T08:22:19.987779+0000","last_fullsized":"2026-02-24T08:22:19.987779+0000","mapping_epoch":27,"log_start":"37'16600","ondisk_log_start":"37'16600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20032","last_scrub_stamp":"2026-02-24T08:21:48.819949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:48.819949+0000","objects_scrubbed":2492,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.299009+0000","scrub_duration":1176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879808,"num_objects":578,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26683,"num_write_kb":193856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'26477","reported_seq":26532,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.005281+0000","last_change":"2026-02-24T08:21:46.276112+0000","last_active":"2026-02-24T08:22:20.005281+0000","last_peered":"2026-02-24T08:22:20.005281+0000","last_clean":"2026-02-24T08:22:20.005281+0000","last_became_active":"2026-02-24T08:20:36.864806+0000","last_became_peered":"2026-02-24T08:20:36.864806+0000","last_unstale":"2026-02-24T08:22:20.005281+0000","last_undegraded":"2026-02-24T08:22:20.005281+0000","last_fullsized":"2026-02-24T08:22:20.005281+0000","mapping_epoch":27,"log_start":"37'16400","ondisk_log_start":"37'16400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19224","last_scrub_stamp":"2026-02-24T08:21:46.275979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:46.275979+0000","objects_scrubbed":2389,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:13.488831+0000","scrub_duration":744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38404096,"num_objects":586,"num_object_clones":0,"num_object_copies":1758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26477,"num_write_kb":192448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"37'26539","reported_seq":26601,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.034539+0000","last_change":"2026-02-24T08:22:18.331760+0000","last_active":"2026-02-24T08:22:20.034539+0000","last_peered":"2026-02-24T08:22:20.034539+0000","last_clean":"2026-02-24T08:22:20.034539+0000","last_became_active":"2026-02-24T08:20:36.864568+0000","last_became_peered":"2026-02-24T08:20:36.864568+0000","last_unstale":"2026-02-24T08:22:20.034539+0000","last_undegraded":"2026-02-24T08:22:20.034539+0000","last_fullsized":"2026-02-24T08:22:20.034539+0000","mapping_epoch":27,"log_start":"37'16500","ondisk_log_start":"37'16500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'26209","last_scrub_stamp":"2026-02-24T08:22:18.331650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:22:18.331650+0000","objects_scrubbed":1899,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:34.321137+0000","scrub_duration":8385,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26539,"num_write_kb":192704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'27453","reported_seq":27517,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:19.927496+0000","last_change":"2026-02-24T08:21:47.926225+0000","last_active":"2026-02-24T08:22:19.927496+0000","last_peered":"2026-02-24T08:22:19.927496+0000","last_clean":"2026-02-24T08:22:19.927496+0000","last_became_active":"2026-02-24T08:20:36.864670+0000","last_became_peered":"2026-02-24T08:20:36.864670+0000","last_unstale":"2026-02-24T08:22:19.927496+0000","last_undegraded":"2026-02-24T08:22:19.927496+0000","last_fullsized":"2026-02-24T08:22:19.927496+0000","mapping_epoch":27,"log_start":"37'17400","ondisk_log_start":"37'17400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20632","last_scrub_stamp":"2026-02-24T08:21:47.926183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:47.926183+0000","objects_scrubbed":2561,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:08.888599+0000","scrub_duration":1419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38141952,"num_objects":582,"num_object_clones":0,"num_object_copies":1746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":582,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27453,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"37'27082","reported_seq":27145,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.034461+0000","last_change":"2026-02-24T08:21:49.267866+0000","last_active":"2026-02-24T08:22:20.034461+0000","last_peered":"2026-02-24T08:22:20.034461+0000","last_clean":"2026-02-24T08:22:20.034461+0000","last_became_active":"2026-02-24T08:20:36.864342+0000","last_became_peered":"2026-02-24T08:20:36.864342+0000","last_unstale":"2026-02-24T08:22:20.034461+0000","last_undegraded":"2026-02-24T08:22:20.034461+0000","last_fullsized":"2026-02-24T08:22:20.034461+0000","mapping_epoch":27,"log_start":"37'17000","ondisk_log_start":"37'17000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20304","last_scrub_stamp":"2026-02-24T08:21:49.267806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:49.267806+0000","objects_scrubbed":2538,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:51.447822+0000","scrub_duration":392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37683200,"num_objects":575,"num_object_clones":0,"num_object_copies":1725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27082,"num_write_kb":196672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'26857","reported_seq":26918,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.007822+0000","last_change":"2026-02-24T08:21:42.314595+0000","last_active":"2026-02-24T08:22:20.007822+0000","last_peered":"2026-02-24T08:22:20.007822+0000","last_clean":"2026-02-24T08:22:20.007822+0000","last_became_active":"2026-02-24T08:20:36.862094+0000","last_became_peered":"2026-02-24T08:20:36.862094+0000","last_unstale":"2026-02-24T08:22:20.007822+0000","last_undegraded":"2026-02-24T08:22:20.007822+0000","last_fullsized":"2026-02-24T08:22:20.007822+0000","mapping_epoch":27,"log_start":"37'16800","ondisk_log_start":"37'16800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18560","last_scrub_stamp":"2026-02-24T08:21:42.314562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.314562+0000","objects_scrubbed":2308,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:07.041335+0000","scrub_duration":557,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37683200,"num_objects":575,"num_object_clones":0,"num_object_copies":1725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":575,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26857,"num_write_kb":195072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"37'27210","reported_seq":27279,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.024506+0000","last_change":"2026-02-24T08:22:07.820756+0000","last_active":"2026-02-24T08:22:20.024506+0000","last_peered":"2026-02-24T08:22:20.024506+0000","last_clean":"2026-02-24T08:22:20.024506+0000","last_became_active":"2026-02-24T08:20:36.864463+0000","last_became_peered":"2026-02-24T08:20:36.864463+0000","last_unstale":"2026-02-24T08:22:20.024506+0000","last_undegraded":"2026-02-24T08:22:20.024506+0000","last_fullsized":"2026-02-24T08:22:20.024506+0000","mapping_epoch":27,"log_start":"37'17200","ondisk_log_start":"37'17200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24696","last_scrub_stamp":"2026-02-24T08:22:07.820675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:22:07.820675+0000","objects_scrubbed":3080,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:22.325541+0000","scrub_duration":880,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39321600,"num_objects":600,"num_object_clones":0,"num_object_copies":1800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":600,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27210,"num_write_kb":197760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"37'27482","reported_seq":27544,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.002899+0000","last_change":"2026-02-24T08:21:42.956407+0000","last_active":"2026-02-24T08:22:20.002899+0000","last_peered":"2026-02-24T08:22:20.002899+0000","last_clean":"2026-02-24T08:22:20.002899+0000","last_became_active":"2026-02-24T08:20:36.864509+0000","last_became_peered":"2026-02-24T08:20:36.864509+0000","last_unstale":"2026-02-24T08:22:20.002899+0000","last_undegraded":"2026-02-24T08:22:20.002899+0000","last_fullsized":"2026-02-24T08:22:20.002899+0000","mapping_epoch":27,"log_start":"37'17400","ondisk_log_start":"37'17400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:42.956364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:42.956364+0000","objects_scrubbed":2416,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:45.767859+0000","scrub_duration":407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39190528,"num_objects":598,"num_object_clones":0,"num_object_copies":1794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27482,"num_write_kb":199680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"37'26051","reported_seq":26115,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.005189+0000","last_change":"2026-02-24T08:21:54.792497+0000","last_active":"2026-02-24T08:22:20.005189+0000","last_peered":"2026-02-24T08:22:20.005189+0000","last_clean":"2026-02-24T08:22:20.005189+0000","last_became_active":"2026-02-24T08:20:36.861858+0000","last_became_peered":"2026-02-24T08:20:36.861858+0000","last_unstale":"2026-02-24T08:22:20.005189+0000","last_undegraded":"2026-02-24T08:22:20.005189+0000","last_fullsized":"2026-02-24T08:22:20.005189+0000","mapping_epoch":27,"log_start":"37'16000","ondisk_log_start":"37'16000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20840","last_scrub_stamp":"2026-02-24T08:21:54.792423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:54.792423+0000","objects_scrubbed":2591,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:17.044925+0000","scrub_duration":927,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36831232,"num_objects":562,"num_object_clones":0,"num_object_copies":1686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26051,"num_write_kb":189248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"37'27257","reported_seq":27314,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.028793+0000","last_change":"2026-02-24T08:21:43.625296+0000","last_active":"2026-02-24T08:22:20.028793+0000","last_peered":"2026-02-24T08:22:20.028793+0000","last_clean":"2026-02-24T08:22:20.028793+0000","last_became_active":"2026-02-24T08:20:36.864483+0000","last_became_peered":"2026-02-24T08:20:36.864483+0000","last_unstale":"2026-02-24T08:22:20.028793+0000","last_undegraded":"2026-02-24T08:22:20.028793+0000","last_fullsized":"2026-02-24T08:22:20.028793+0000","mapping_epoch":27,"log_start":"37'17200","ondisk_log_start":"37'17200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'19368","last_scrub_stamp":"2026-02-24T08:21:43.625255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:43.625255+0000","objects_scrubbed":2406,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:52.790484+0000","scrub_duration":1684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38379520,"num_objects":586,"num_object_clones":0,"num_object_copies":1758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27257,"num_write_kb":197992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"37'26745","reported_seq":26813,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:19.999512+0000","last_change":"2026-02-24T08:22:08.118212+0000","last_active":"2026-02-24T08:22:19.999512+0000","last_peered":"2026-02-24T08:22:19.999512+0000","last_clean":"2026-02-24T08:22:19.999512+0000","last_became_active":"2026-02-24T08:20:36.864630+0000","last_became_peered":"2026-02-24T08:20:36.864630+0000","last_unstale":"2026-02-24T08:22:19.999512+0000","last_undegraded":"2026-02-24T08:22:19.999512+0000","last_fullsized":"2026-02-24T08:22:19.999512+0000","mapping_epoch":27,"log_start":"37'16700","ondisk_log_start":"37'16700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24320","last_scrub_stamp":"2026-02-24T08:22:08.118165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:22:08.118165+0000","objects_scrubbed":3040,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:19.397777+0000","scrub_duration":218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40304640,"num_objects":615,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26745,"num_write_kb":194560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"37'26384","reported_seq":26447,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T08:22:20.004072+0000","last_change":"2026-02-24T08:21:59.185489+0000","last_active":"2026-02-24T08:22:20.004072+0000","last_peered":"2026-02-24T08:22:20.004072+0000","last_clean":"2026-02-24T08:22:20.004072+0000","last_became_active":"2026-02-24T08:20:36.862200+0000","last_became_peered":"2026-02-24T08:20:36.862200+0000","last_unstale":"2026-02-24T08:22:20.004072+0000","last_undegraded":"2026-02-24T08:22:20.004072+0000","last_fullsized":"2026-02-24T08:22:20.004072+0000","mapping_epoch":27,"log_start":"37'16300","ondisk_log_start":"37'16300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22024","last_scrub_stamp":"2026-02-24T08:21:59.185449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:35.854055+0000","last_clean_scrub_stamp":"2026-02-24T08:21:59.185449+0000","objects_scrubbed":2749,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:05.198861+0000","scrub_duration":615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":553,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26384,"num_write_kb":191552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":602185752,"num_objects":9190,"num_object_clones":0,"num_object_copies":27570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9190,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":428065,"num_write_kb":3109353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1859391488,"data_stored":1859379272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160865,"ondisk_log_size":160865,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247834,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1193376,"kb_used_data":552588,"kb_used_omap":13,"kb_used_meta":640690,"kb_avail":732809824,"statfs":{"total":751619276800,"available":750397259776,"internally_reserved":0,"allocated":565850112,"data_stored":565611879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13992,"internal_metadata":656066904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444060,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":988724,"kb_used_data":474464,"kb_used_omap":17,"kb_used_meta":514222,"kb_avail":733014476,"statfs":{"total":751619276800,"available":750606823424,"internally_reserved":0,"allocated":485851136,"data_stored":485616975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17900,"internal_metadata":526563860},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1040924,"kb_used_data":472520,"kb_used_omap":19,"kb_used_meta":568364,"kb_avail":732962276,"statfs":{"total":751619276800,"available":750553370624,"internally_reserved":0,"allocated":483860480,"data_stored":483625799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19853,"internal_metadata":582005363},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":938592,"kb_used_data":460428,"kb_used_omap":22,"kb_used_meta":478121,"kb_avail":733064608,"statfs":{"total":751619276800,"available":750658158592,"internally_reserved":0,"allocated":471478272,"data_stored":471240039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23108,"internal_metadata":489596348},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,4,6,6,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":440709120,"data_stored":440705048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":450342912,"data_stored":450338840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":440008704,"data_stored":440008704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":528330752,"data_stored":528326680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:22:25.248 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:22:25.248 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 51 2026-02-24T08:22:25.342 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:25.402 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:25.449 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:25.446+0000 7fd8b8c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:25.449 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:25.447+0000 7fd8b8c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:25.461 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:25.462 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:25.471 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:25.472 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:25.483 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:25.483 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:25.493 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:25.493 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:25.517 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:25.515+0000 7f84908b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:25.517 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:25.515+0000 7f84908b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:25.627 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:22:25.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:22:26.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:25 trial105 ceph-mon[39442]: pgmap v72: 17 pgs: 17 active+clean; 575 MiB data, 4.0 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.98k op/s 2026-02-24T08:22:26.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1956271907' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:26.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3453866600' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "51"} : dispatch 2026-02-24T08:22:27.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:26 trial105 ceph-mon[39442]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:22:27.530 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:27.652 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:27.730 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-24T08:22:27.730 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-24T08:22:27.756 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:27.754+0000 7f370b0df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:27.756 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:27.754+0000 7f370b0df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:27.768 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:27.769 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:27.778 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:27.779 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:27.789 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:27.790 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:27.800 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:27.800 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:27.851 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:27.955 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:27.953+0000 7fe80bbe2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:27.955 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:27.953+0000 7fe80bbe2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:28.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:27 trial105 ceph-mon[39442]: pgmap v73: 17 pgs: 17 active+clean; 577 KiB data, 2.1 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 3.74k op/s 2026-02-24T08:22:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2675211627' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:28.831 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_0' removed 2026-02-24T08:22:28.884 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T08:22:28.885 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T08:22:28.885 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_1 2026-02-24T08:22:28.885 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool create unique_pool_1 16 2026-02-24T08:22:29.041 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:29.090 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3878975026' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:22:29.148 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:29.146+0000 7f01b81e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:29.148 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:29.146+0000 7f01b81e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:29.832 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_1' created 2026-02-24T08:22:29.833 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:22:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:22:29] "GET /metrics HTTP/1.1" 200 3900 "" "Prometheus/3.6.0" 2026-02-24T08:22:29.836 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:29.876 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2026-02-24T08:22:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:22:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:22:29.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:22:29.954 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:30.031 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:30.060 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:30.057+0000 7fb2e1622640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:30.060 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:30.058+0000 7fb2e1622640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:30.072 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:30.072 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:30.083 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:29 trial105 ceph-mon[39442]: pgmap v74: 17 pgs: 17 active+clean; 577 KiB data, 2.1 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.26k op/s 2026-02-24T08:22:30.083 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3878975026' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:22:30.083 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:29 trial105 ceph-mon[39442]: osdmap e38: 4 total, 4 up, 4 in 2026-02-24T08:22:30.083 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:22:30.083 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3684166569' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16} : dispatch 2026-02-24T08:22:30.084 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:30.084 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:30.096 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:30.096 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:30.106 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:30.106 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:30.147 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:30.145+0000 7f8a2bc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:30.147 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:30.145+0000 7f8a2bc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:30.676 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:30.676 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:30.840 INFO:teuthology.orchestra.run.trial105.stderr:enabled application 'rados' on pool 'unique_pool_1' 2026-02-24T08:22:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3684166569' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_1", "pg_num": 16}]': finished 2026-02-24T08:22:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:30 trial105 ceph-mon[39442]: osdmap e39: 4 total, 4 up, 4 in 2026-02-24T08:22:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/503799636' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2598810770' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:22:31.880 DEBUG:teuthology.orchestra.run.trial105:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_1 bench 90 write' 2026-02-24T08:22:31.880 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T08:22:31.881 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:22:31.883 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T08:22:31.883 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T08:22:31.929 INFO:tasks.radosbench.radosbench.0.trial105.stdout:hints = 1 2026-02-24T08:22:31.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T08:22:31.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object prefix: benchmark_data_trial105_91644 2026-02-24T08:22:31.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:22:31.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 0 0 0 0 0 0 - 0 2026-02-24T08:22:32.017 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:32.134 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:31 trial105 ceph-mon[39442]: pgmap v77: 17 pgs: 14 creating+peering, 1 active+clean, 2 unknown; 577 KiB data, 2.2 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:22:32.135 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:31 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2598810770' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_1", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:22:32.135 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:31 trial105 ceph-mon[39442]: osdmap e40: 4 total, 4 up, 4 in 2026-02-24T08:22:32.143 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:32.141+0000 7f62262ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:32.143 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:32.144 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:32.141+0000 7f62262ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:32.299 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:32.305 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:22:32.305 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:22:32.360 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2026-02-24T08:22:31.839564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":45,"acting":45,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":2276948,"kb_used_data":3204,"kb_used_omap":76,"kb_used_meta":2273587,"kb_avail":2933735852,"statfs":{"total":3006477107200,"available":3004145512448,"internally_reserved":0,"allocated":3280896,"data_stored":2301238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78759,"internal_metadata":2328153177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-437255,"num_write_kb":-3109353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.137285"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.837236+0000","last_change":"2026-02-24T08:22:29.837236+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.837236+0000","last_undegraded":"2026-02-24T08:22:29.837236+0000","last_fullsized":"2026-02-24T08:22:29.837236+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.837367+0000","last_change":"2026-02-24T08:22:29.837367+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.837367+0000","last_undegraded":"2026-02-24T08:22:29.837367+0000","last_fullsized":"2026-02-24T08:22:29.837367+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.835586+0000","last_change":"2026-02-24T08:22:29.835586+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.835586+0000","last_undegraded":"2026-02-24T08:22:29.835586+0000","last_fullsized":"2026-02-24T08:22:29.835586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.835742+0000","last_change":"2026-02-24T08:22:29.835742+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.835742+0000","last_undegraded":"2026-02-24T08:22:29.835742+0000","last_fullsized":"2026-02-24T08:22:29.835742+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.836340+0000","last_change":"2026-02-24T08:22:29.836340+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.836340+0000","last_undegraded":"2026-02-24T08:22:29.836340+0000","last_fullsized":"2026-02-24T08:22:29.836340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.835591+0000","last_change":"2026-02-24T08:22:29.835591+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.835591+0000","last_undegraded":"2026-02-24T08:22:29.835591+0000","last_fullsized":"2026-02-24T08:22:29.835591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.835636+0000","last_change":"2026-02-24T08:22:29.835636+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.835636+0000","last_undegraded":"2026-02-24T08:22:29.835636+0000","last_fullsized":"2026-02-24T08:22:29.835636+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.836260+0000","last_change":"2026-02-24T08:22:29.836260+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.836260+0000","last_undegraded":"2026-02-24T08:22:29.836260+0000","last_fullsized":"2026-02-24T08:22:29.836260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.835466+0000","last_change":"2026-02-24T08:22:29.835466+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.835466+0000","last_undegraded":"2026-02-24T08:22:29.835466+0000","last_fullsized":"2026-02-24T08:22:29.835466+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:22:29.830158+0000","last_change":"2026-02-24T08:22:29.830158+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.830158+0000","last_undegraded":"2026-02-24T08:22:29.830158+0000","last_fullsized":"2026-02-24T08:22:29.830158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.837406+0000","last_change":"2026-02-24T08:22:29.837406+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.837406+0000","last_undegraded":"2026-02-24T08:22:29.837406+0000","last_fullsized":"2026-02-24T08:22:29.837406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.835473+0000","last_change":"2026-02-24T08:22:29.835473+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.835473+0000","last_undegraded":"2026-02-24T08:22:29.835473+0000","last_fullsized":"2026-02-24T08:22:29.835473+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.837313+0000","last_change":"2026-02-24T08:22:29.837313+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.837313+0000","last_undegraded":"2026-02-24T08:22:29.837313+0000","last_fullsized":"2026-02-24T08:22:29.837313+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:22:29.830158+0000","last_change":"2026-02-24T08:22:29.830158+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.830158+0000","last_undegraded":"2026-02-24T08:22:29.830158+0000","last_fullsized":"2026-02-24T08:22:29.830158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.835603+0000","last_change":"2026-02-24T08:22:29.835603+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.835603+0000","last_undegraded":"2026-02-24T08:22:29.835603+0000","last_fullsized":"2026-02-24T08:22:29.835603+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2026-02-24T08:22:29.835607+0000","last_change":"2026-02-24T08:22:29.835607+0000","last_active":"2026-02-24T08:22:29.830158+0000","last_peered":"2026-02-24T08:22:29.830158+0000","last_clean":"2026-02-24T08:22:29.830158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:22:29.835607+0000","last_undegraded":"2026-02-24T08:22:29.835607+0000","last_fullsized":"2026-02-24T08:22:29.835607+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":80,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-24T08:22:29.832757+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:22:29.832757+0000","last_peered":"2026-02-24T08:22:29.832757+0000","last_clean":"2026-02-24T08:22:29.832757+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:22:29.832757+0000","last_undegraded":"2026-02-24T08:22:29.832757+0000","last_fullsized":"2026-02-24T08:22:29.832757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247836,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":659724,"kb_used_data":952,"kb_used_omap":14,"kb_used_meta":658737,"kb_avail":733343476,"statfs":{"total":751619276800,"available":750943719424,"internally_reserved":0,"allocated":974848,"data_stored":725283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15294,"internal_metadata":674546754},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444062,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":533248,"kb_used_data":940,"kb_used_omap":18,"kb_used_meta":532269,"kb_avail":733469952,"statfs":{"total":751619276800,"available":751073230848,"internally_reserved":0,"allocated":962560,"data_stored":720520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18551,"internal_metadata":545044361},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":586824,"kb_used_data":372,"kb_used_omap":20,"kb_used_meta":586411,"kb_avail":733416376,"statfs":{"total":751619276800,"available":751018369024,"internally_reserved":0,"allocated":380928,"data_stored":134915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":600485213},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":497152,"kb_used_data":940,"kb_used_omap":23,"kb_used_meta":496168,"kb_avail":733506048,"statfs":{"total":751619276800,"available":751110193152,"internally_reserved":0,"allocated":962560,"data_stored":720520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":508076849},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:22:32.414 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:32.411+0000 7f4d804d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:32.414 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:32.412+0000 7f4d804d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:32.428 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:32.429 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:32.452 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:32.452 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:32.473 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:32.473 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:32.489 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:32.489 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:32.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 1 127 10833 10706 83.6338 83.6406 0.0274812 0.0118525 2026-02-24T08:22:33.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:32 trial105 ceph-mon[39442]: osdmap e41: 4 total, 4 up, 4 in 2026-02-24T08:22:33.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:32 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2747712686' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:33.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 2 127 21398 21271 83.0831 82.5391 0.00966425 0.0119725 2026-02-24T08:22:34.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:33 trial105 ceph-mon[39442]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:22:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:33 trial105 ceph-mon[39442]: pgmap v80: 17 pgs: 14 creating+peering, 1 active+clean, 2 unknown; 577 KiB data, 2.2 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:22:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:33 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:22:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:33 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:22:34.540 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:34.704 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:34.833 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:34.831+0000 7f1c53ed2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:34.834 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:34.832+0000 7f1c53ed2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:34.851 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:34.852 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:34.868 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:34.868 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:34.882 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:34.882 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:34.899 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:34.899 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:34.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 3 127 32009 31882 83.0194 82.8984 0.0115933 0.0119992 2026-02-24T08:22:35.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/504550943' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:35.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 4 128 42284 42156 82.3295 80.2656 0.0052252 0.0121129 2026-02-24T08:22:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:35 trial105 ceph-mon[39442]: pgmap v81: 17 pgs: 14 creating+peering, 1 active+clean, 2 unknown; 577 KiB data, 2.2 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:22:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:22:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:22:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:22:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:22:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:22:36.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 5 128 51857 51729 80.8203 74.7891 0.00729048 0.0123278 2026-02-24T08:22:36.945 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:37.111 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:37.244 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:37.242+0000 7f8d724e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:37.245 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:37.243+0000 7f8d724e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:37.259 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:37.259 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:37.274 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:37.274 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:37.292 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:37.293 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:37.308 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:37.308 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:37.362 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:37.363 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:37.363 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T08:22:37.363 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:22:37.518 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:37.664 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:37.661+0000 7f8541204640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:37.664 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:37.661+0000 7f8541204640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:37.822 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:22:37.823 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:22:37.878 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2026-02-24T08:22:36.703675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":264430112,"num_objects":4030,"num_object_clones":0,"num_object_copies":12090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4030,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":32342,"num_write_kb":259806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32306,"ondisk_log_size":32306,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":3188708,"kb_used_data":716436,"kb_used_omap":82,"kb_used_meta":2472109,"kb_avail":2932824092,"statfs":{"total":3006477107200,"available":3003211870208,"internally_reserved":0,"allocated":733630464,"data_stored":732575532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":84618,"internal_metadata":2531439990},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":263839744,"num_objects":4028,"num_object_clones":0,"num_object_copies":12084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32207,"num_write_kb":257656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.871861"},"pg_stats":[{"pgid":"3.f","version":"41'1936","reported_seq":1950,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:34.834832+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:22:34.834832+0000","last_peered":"2026-02-24T08:22:34.834832+0000","last_clean":"2026-02-24T08:22:34.834832+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:22:34.834832+0000","last_undegraded":"2026-02-24T08:22:34.834832+0000","last_fullsized":"2026-02-24T08:22:34.834832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":1936,"log_dups_size":0,"ondisk_log_size":1936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1936,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"41'1904","reported_seq":1912,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:34.851663+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:22:34.851663+0000","last_peered":"2026-02-24T08:22:34.851663+0000","last_clean":"2026-02-24T08:22:34.851663+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:22:34.851663+0000","last_undegraded":"2026-02-24T08:22:34.851663+0000","last_fullsized":"2026-02-24T08:22:34.851663+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":1904,"log_dups_size":0,"ondisk_log_size":1904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1904,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"41'2088","reported_seq":2095,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:34.995877+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:22:34.995877+0000","last_peered":"2026-02-24T08:22:34.995877+0000","last_clean":"2026-02-24T08:22:34.995877+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:22:34.995877+0000","last_undegraded":"2026-02-24T08:22:34.995877+0000","last_fullsized":"2026-02-24T08:22:34.995877+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2088,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"41'2056","reported_seq":2070,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:35.013582+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:22:35.013582+0000","last_peered":"2026-02-24T08:22:35.013582+0000","last_clean":"2026-02-24T08:22:35.013582+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:22:35.013582+0000","last_undegraded":"2026-02-24T08:22:35.013582+0000","last_fullsized":"2026-02-24T08:22:35.013582+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2056,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"41'2193","reported_seq":2203,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:35.045459+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:22:35.045459+0000","last_peered":"2026-02-24T08:22:35.045459+0000","last_clean":"2026-02-24T08:22:35.045459+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:22:35.045459+0000","last_undegraded":"2026-02-24T08:22:35.045459+0000","last_fullsized":"2026-02-24T08:22:35.045459+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":2193,"log_dups_size":0,"ondisk_log_size":2193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17965056,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2193,"num_write_kb":17544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"41'1922","reported_seq":1927,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:34.979420+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:22:34.979420+0000","last_peered":"2026-02-24T08:22:34.979420+0000","last_clean":"2026-02-24T08:22:34.979420+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:22:34.979420+0000","last_undegraded":"2026-02-24T08:22:34.979420+0000","last_fullsized":"2026-02-24T08:22:34.979420+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":1922,"log_dups_size":0,"ondisk_log_size":1922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15745024,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1922,"num_write_kb":15376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'2248","reported_seq":2262,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:35.014231+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:22:35.014231+0000","last_peered":"2026-02-24T08:22:35.014231+0000","last_clean":"2026-02-24T08:22:35.014231+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:22:35.014231+0000","last_undegraded":"2026-02-24T08:22:35.014231+0000","last_fullsized":"2026-02-24T08:22:35.014231+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":2248,"log_dups_size":0,"ondisk_log_size":2248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2248,"num_write_kb":17984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"41'2040","reported_seq":2051,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:35.043822+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:22:35.043822+0000","last_peered":"2026-02-24T08:22:35.043822+0000","last_clean":"2026-02-24T08:22:35.043822+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:22:35.043822+0000","last_undegraded":"2026-02-24T08:22:35.043822+0000","last_fullsized":"2026-02-24T08:22:35.043822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":255,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2040,"num_write_kb":16320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"41'2024","reported_seq":2038,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:35.021822+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:22:35.021822+0000","last_peered":"2026-02-24T08:22:35.021822+0000","last_clean":"2026-02-24T08:22:35.021822+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:22:35.021822+0000","last_undegraded":"2026-02-24T08:22:35.021822+0000","last_fullsized":"2026-02-24T08:22:35.021822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16580608,"num_objects":253,"num_object_clones":0,"num_object_copies":759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2024,"num_write_kb":16192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"41'1869","reported_seq":1868,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:34.809295+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:22:34.809295+0000","last_peered":"2026-02-24T08:22:34.809295+0000","last_clean":"2026-02-24T08:22:34.809295+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:22:34.809295+0000","last_undegraded":"2026-02-24T08:22:34.809295+0000","last_fullsized":"2026-02-24T08:22:34.809295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":1869,"log_dups_size":0,"ondisk_log_size":1869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15310848,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1869,"num_write_kb":14952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'1936","reported_seq":1950,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:34.845201+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:22:34.845201+0000","last_peered":"2026-02-24T08:22:34.845201+0000","last_clean":"2026-02-24T08:22:34.845201+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:22:34.845201+0000","last_undegraded":"2026-02-24T08:22:34.845201+0000","last_fullsized":"2026-02-24T08:22:34.845201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":1936,"log_dups_size":0,"ondisk_log_size":1936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1936,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"41'1903","reported_seq":1915,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:35.044460+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:22:35.044460+0000","last_peered":"2026-02-24T08:22:35.044460+0000","last_clean":"2026-02-24T08:22:35.044460+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:22:35.044460+0000","last_undegraded":"2026-02-24T08:22:35.044460+0000","last_fullsized":"2026-02-24T08:22:35.044460+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15589376,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1903,"num_write_kb":15224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'1904","reported_seq":1918,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:34.846670+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:22:34.846670+0000","last_peered":"2026-02-24T08:22:34.846670+0000","last_clean":"2026-02-24T08:22:34.846670+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:22:34.846670+0000","last_undegraded":"2026-02-24T08:22:34.846670+0000","last_fullsized":"2026-02-24T08:22:34.846670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":1904,"log_dups_size":0,"ondisk_log_size":1904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1904,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"41'2064","reported_seq":2078,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:34.803151+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:22:34.803151+0000","last_peered":"2026-02-24T08:22:34.803151+0000","last_clean":"2026-02-24T08:22:34.803151+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:22:34.803151+0000","last_undegraded":"2026-02-24T08:22:34.803151+0000","last_fullsized":"2026-02-24T08:22:34.803151+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":2064,"log_dups_size":0,"ondisk_log_size":2064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2064,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"41'1960","reported_seq":1974,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:35.035295+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:22:35.035295+0000","last_peered":"2026-02-24T08:22:35.035295+0000","last_clean":"2026-02-24T08:22:35.035295+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:22:35.035295+0000","last_undegraded":"2026-02-24T08:22:35.035295+0000","last_fullsized":"2026-02-24T08:22:35.035295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":1960,"log_dups_size":0,"ondisk_log_size":1960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":15680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"41'2160","reported_seq":2174,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:35.039349+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:22:35.039349+0000","last_peered":"2026-02-24T08:22:35.039349+0000","last_clean":"2026-02-24T08:22:35.039349+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:22:35.039349+0000","last_undegraded":"2026-02-24T08:22:35.039349+0000","last_fullsized":"2026-02-24T08:22:35.039349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":2160,"log_dups_size":0,"ondisk_log_size":2160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":270,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2160,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":84,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:31.931550+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:22:31.931550+0000","last_peered":"2026-02-24T08:22:31.931550+0000","last_clean":"2026-02-24T08:22:31.931550+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:22:31.931550+0000","last_undegraded":"2026-02-24T08:22:31.931550+0000","last_fullsized":"2026-02-24T08:22:31.931550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":263839744,"num_objects":4028,"num_object_clones":0,"num_object_copies":12084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32207,"num_write_kb":257656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":782417920,"data_stored":782417920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32207,"ondisk_log_size":32207,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247837,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":895844,"kb_used_data":164880,"kb_used_omap":14,"kb_used_meta":730929,"kb_avail":733107356,"statfs":{"total":751619276800,"available":750701932544,"internally_reserved":0,"allocated":168837120,"data_stored":168572499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15294,"internal_metadata":748471362},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444063,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":767252,"kb_used_data":198848,"kb_used_omap":20,"kb_used_meta":568363,"kb_avail":733235948,"statfs":{"total":751619276800,"available":750833610752,"internally_reserved":0,"allocated":203620352,"data_stored":203355731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20504,"internal_metadata":582004712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":792192,"kb_used_data":169644,"kb_used_omap":22,"kb_used_meta":622505,"kb_avail":733211008,"statfs":{"total":751619276800,"available":750808072192,"internally_reserved":0,"allocated":173715456,"data_stored":173454387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23108,"internal_metadata":637445564},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":733420,"kb_used_data":183064,"kb_used_omap":25,"kb_used_meta":550310,"kb_avail":733269780,"statfs":{"total":751619276800,"available":750868254720,"internally_reserved":0,"allocated":187457536,"data_stored":187192915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":563518352},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":205070336,"data_stored":205070336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":184852480,"data_stored":184852480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":223535104,"data_stored":223535104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":168960000,"data_stored":168960000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:22:37.878 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:22:37.879 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 26 2026-02-24T08:22:37.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 6 127 60114 59987 78.102 64.5156 0.00675125 0.0127686 2026-02-24T08:22:38.040 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:38.102 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:37 trial105 ceph-mon[39442]: pgmap v82: 17 pgs: 17 active+clean; 252 MiB data, 3.0 GiB used, 2.7 TiB / 2.7 TiB avail; 37 MiB/s wr, 4.69k op/s 2026-02-24T08:22:38.102 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/357564112' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:38.177 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:38.175+0000 7f3d88dc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:38.178 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:38.175+0000 7f3d88dc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:38.345 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:22:38.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:22:38.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 7 127 68328 68201 76.1112 64.1719 0.00791156 0.0131205 2026-02-24T08:22:39.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:38 trial105 ceph-mon[39442]: from='client.14549 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:22:39.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:38 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/100441347' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T08:22:39.357 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:39.514 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:39.641 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:22:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:22:39] "GET /metrics HTTP/1.1" 200 3900 "" "Prometheus/3.6.0" 2026-02-24T08:22:39.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 8 128 75091 74963 73.2003 52.8281 0.0110318 0.0136169 2026-02-24T08:22:39.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:22:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:22:39.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:22:39.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:39 trial105 ceph-mon[39442]: pgmap v83: 17 pgs: 17 active+clean; 252 MiB data, 3.0 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 4.03k op/s 2026-02-24T08:22:39.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:39 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:22:39.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:39 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:22:39.976 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:39.938+0000 7f6b7fe07640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:39.976 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:39.939+0000 7f6b7fe07640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:39.976 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:39.976 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:39.988 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:39.988 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:40.004 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:40.004 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:40.020 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:40.020 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:40.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 9 128 80622 80494 69.8678 43.2109 0.0367944 0.0142935 2026-02-24T08:22:40.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3194065315' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:41.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 10 127 87556 87429 68.2986 54.1797 0.0137013 0.0146159 2026-02-24T08:22:42.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:41 trial105 ceph-mon[39442]: pgmap v84: 17 pgs: 17 active+clean; 589 MiB data, 4.2 GiB used, 2.7 TiB / 2.7 TiB avail; 60 MiB/s wr, 7.63k op/s 2026-02-24T08:22:42.705 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:42.878 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:42.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 11 128 94198 94070 66.803 51.8828 0.0275525 0.0149454 2026-02-24T08:22:43.319 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:43.319 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:43.320 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:43.264+0000 7f7a1a721640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:43.320 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:43.264+0000 7f7a1a721640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:43.320 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:43.320 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:43.322 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:43.323 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:43.337 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:43.338 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:43.392 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:43.393 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:43.393 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:22:43.393 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:22:43.857 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:43 trial105 ceph-mon[39442]: pgmap v85: 17 pgs: 17 active+clean; 589 MiB data, 4.2 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.93k op/s 2026-02-24T08:22:43.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 12 128 98786 98658 64.2229 35.8438 0.0130127 0.0155375 2026-02-24T08:22:43.974 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:44.140 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/528827469' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:44.465 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:44.456+0000 7fc2df288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:44.465 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:44.457+0000 7fc2df288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:44.608 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:22:44.609 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:22:44.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 13 127 103750 103623 62.2664 38.7891 0.0524249 0.0160181 2026-02-24T08:22:44.971 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:22:45.324 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2026-02-24T08:22:42.704507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":617153056,"num_objects":9413,"num_object_clones":0,"num_object_copies":28239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9413,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":75399,"num_write_kb":604262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75363,"ondisk_log_size":75363,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4391740,"kb_used_data":1775084,"kb_used_omap":83,"kb_used_meta":2616492,"kb_avail":2931621060,"statfs":{"total":3006477107200,"available":3001979965440,"internally_reserved":0,"allocated":1817686016,"data_stored":1816631084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":85269,"internal_metadata":2679288555},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616562688,"num_objects":9411,"num_object_clones":0,"num_object_copies":28233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75264,"num_write_kb":602112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.864943"},"pg_stats":[{"pgid":"3.f","version":"41'4544","reported_seq":4558,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:39.804998+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:22:39.804998+0000","last_peered":"2026-02-24T08:22:39.804998+0000","last_clean":"2026-02-24T08:22:39.804998+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:22:39.804998+0000","last_undegraded":"2026-02-24T08:22:39.804998+0000","last_fullsized":"2026-02-24T08:22:39.804998+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37224448,"num_objects":568,"num_object_clones":0,"num_object_copies":1704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"41'4480","reported_seq":4494,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:39.797201+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:22:39.797201+0000","last_peered":"2026-02-24T08:22:39.797201+0000","last_clean":"2026-02-24T08:22:39.797201+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:22:39.797201+0000","last_undegraded":"2026-02-24T08:22:39.797201+0000","last_fullsized":"2026-02-24T08:22:39.797201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4480,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"41'4717","reported_seq":4726,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.015068+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:22:40.015068+0000","last_peered":"2026-02-24T08:22:40.015068+0000","last_clean":"2026-02-24T08:22:40.015068+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:22:40.015068+0000","last_undegraded":"2026-02-24T08:22:40.015068+0000","last_fullsized":"2026-02-24T08:22:40.015068+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38641664,"num_objects":590,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4717,"num_write_kb":37736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"41'4688","reported_seq":4699,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.019463+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:22:40.019463+0000","last_peered":"2026-02-24T08:22:40.019463+0000","last_clean":"2026-02-24T08:22:40.019463+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:22:40.019463+0000","last_undegraded":"2026-02-24T08:22:40.019463+0000","last_fullsized":"2026-02-24T08:22:40.019463+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4688,"log_dups_size":0,"ondisk_log_size":4688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38404096,"num_objects":586,"num_object_clones":0,"num_object_copies":1758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4688,"num_write_kb":37504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"41'4776","reported_seq":4784,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.056411+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:22:40.056411+0000","last_peered":"2026-02-24T08:22:40.056411+0000","last_clean":"2026-02-24T08:22:40.056411+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:22:40.056411+0000","last_undegraded":"2026-02-24T08:22:40.056411+0000","last_fullsized":"2026-02-24T08:22:40.056411+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4776,"log_dups_size":0,"ondisk_log_size":4776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4776,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"41'4384","reported_seq":4398,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.014017+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:22:40.014017+0000","last_peered":"2026-02-24T08:22:40.014017+0000","last_clean":"2026-02-24T08:22:40.014017+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:22:40.014017+0000","last_undegraded":"2026-02-24T08:22:40.014017+0000","last_fullsized":"2026-02-24T08:22:40.014017+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4384,"log_dups_size":0,"ondisk_log_size":4384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":548,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4384,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'5144","reported_seq":5158,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.011955+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:22:40.011955+0000","last_peered":"2026-02-24T08:22:40.011955+0000","last_clean":"2026-02-24T08:22:40.011955+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:22:40.011955+0000","last_undegraded":"2026-02-24T08:22:40.011955+0000","last_fullsized":"2026-02-24T08:22:40.011955+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":5144,"log_dups_size":0,"ondisk_log_size":5144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42139648,"num_objects":643,"num_object_clones":0,"num_object_copies":1929,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":643,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5144,"num_write_kb":41152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"41'4872","reported_seq":4886,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.042980+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:22:40.042980+0000","last_peered":"2026-02-24T08:22:40.042980+0000","last_clean":"2026-02-24T08:22:40.042980+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:22:40.042980+0000","last_undegraded":"2026-02-24T08:22:40.042980+0000","last_fullsized":"2026-02-24T08:22:40.042980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4872,"log_dups_size":0,"ondisk_log_size":4872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39911424,"num_objects":609,"num_object_clones":0,"num_object_copies":1827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4872,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"41'4745","reported_seq":4757,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.056003+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:22:40.056003+0000","last_peered":"2026-02-24T08:22:40.056003+0000","last_clean":"2026-02-24T08:22:40.056003+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:22:40.056003+0000","last_undegraded":"2026-02-24T08:22:40.056003+0000","last_fullsized":"2026-02-24T08:22:40.056003+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4745,"log_dups_size":0,"ondisk_log_size":4745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38871040,"num_objects":594,"num_object_clones":0,"num_object_copies":1782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4745,"num_write_kb":37960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"41'4736","reported_seq":4750,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:39.798375+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:22:39.798375+0000","last_peered":"2026-02-24T08:22:39.798375+0000","last_clean":"2026-02-24T08:22:39.798375+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:22:39.798375+0000","last_undegraded":"2026-02-24T08:22:39.798375+0000","last_fullsized":"2026-02-24T08:22:39.798375+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4736,"log_dups_size":0,"ondisk_log_size":4736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4736,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'4736","reported_seq":4750,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:39.789563+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:22:39.789563+0000","last_peered":"2026-02-24T08:22:39.789563+0000","last_clean":"2026-02-24T08:22:39.789563+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:22:39.789563+0000","last_undegraded":"2026-02-24T08:22:39.789563+0000","last_fullsized":"2026-02-24T08:22:39.789563+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4736,"log_dups_size":0,"ondisk_log_size":4736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4736,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"41'4672","reported_seq":4686,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.023775+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:22:40.023775+0000","last_peered":"2026-02-24T08:22:40.023775+0000","last_clean":"2026-02-24T08:22:40.023775+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:22:40.023775+0000","last_undegraded":"2026-02-24T08:22:40.023775+0000","last_fullsized":"2026-02-24T08:22:40.023775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4672,"log_dups_size":0,"ondisk_log_size":4672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38273024,"num_objects":584,"num_object_clones":0,"num_object_copies":1752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4672,"num_write_kb":37376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'4501","reported_seq":4514,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:39.856253+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:22:39.856253+0000","last_peered":"2026-02-24T08:22:39.856253+0000","last_clean":"2026-02-24T08:22:39.856253+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:22:39.856253+0000","last_undegraded":"2026-02-24T08:22:39.856253+0000","last_fullsized":"2026-02-24T08:22:39.856253+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":0,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36872192,"num_objects":563,"num_object_clones":0,"num_object_copies":1689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4501,"num_write_kb":36008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"41'4668","reported_seq":4680,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:39.805314+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:22:39.805314+0000","last_peered":"2026-02-24T08:22:39.805314+0000","last_clean":"2026-02-24T08:22:39.805314+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:22:39.805314+0000","last_undegraded":"2026-02-24T08:22:39.805314+0000","last_fullsized":"2026-02-24T08:22:39.805314+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4668,"log_dups_size":0,"ondisk_log_size":4668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38240256,"num_objects":584,"num_object_clones":0,"num_object_copies":1752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4668,"num_write_kb":37344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"41'4609","reported_seq":4622,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.050221+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:22:40.050221+0000","last_peered":"2026-02-24T08:22:40.050221+0000","last_clean":"2026-02-24T08:22:40.050221+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:22:40.050221+0000","last_undegraded":"2026-02-24T08:22:40.050221+0000","last_fullsized":"2026-02-24T08:22:40.050221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37756928,"num_objects":577,"num_object_clones":0,"num_object_copies":1731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":577,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4609,"num_write_kb":36872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"41'4992","reported_seq":5006,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:40.035208+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:22:40.035208+0000","last_peered":"2026-02-24T08:22:40.035208+0000","last_clean":"2026-02-24T08:22:40.035208+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:22:40.035208+0000","last_undegraded":"2026-02-24T08:22:40.035208+0000","last_fullsized":"2026-02-24T08:22:40.035208+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":4992,"log_dups_size":0,"ondisk_log_size":4992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40894464,"num_objects":624,"num_object_clones":0,"num_object_copies":1872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":624,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4992,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":84,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:31.931550+0000","last_change":"2026-02-24T08:21:27.721605+0000","last_active":"2026-02-24T08:22:31.931550+0000","last_peered":"2026-02-24T08:22:31.931550+0000","last_clean":"2026-02-24T08:22:31.931550+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:22:31.931550+0000","last_undegraded":"2026-02-24T08:22:31.931550+0000","last_fullsized":"2026-02-24T08:22:31.931550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:21:27.721569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:21:27.721569+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:22:44.490441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":616562688,"num_objects":9411,"num_object_clones":0,"num_object_copies":28233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75264,"num_write_kb":602112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1843789824,"data_stored":1843789824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75264,"ondisk_log_size":75264,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247838,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1142396,"kb_used_data":375336,"kb_used_omap":14,"kb_used_meta":767025,"kb_avail":732860804,"statfs":{"total":751619276800,"available":750449463296,"internally_reserved":0,"allocated":384344064,"data_stored":384079443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15294,"internal_metadata":785433666},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444064,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1118428,"kb_used_data":513928,"kb_used_omap":20,"kb_used_meta":604459,"kb_avail":732884772,"statfs":{"total":751619276800,"available":750474006528,"internally_reserved":0,"allocated":526262272,"data_stored":525997651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":618966365},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1068656,"kb_used_data":410012,"kb_used_omap":22,"kb_used_meta":658601,"kb_avail":732934544,"statfs":{"total":751619276800,"available":750524973056,"internally_reserved":0,"allocated":419852288,"data_stored":419591219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23108,"internal_metadata":674407868},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1062260,"kb_used_data":475808,"kb_used_omap":25,"kb_used_meta":586406,"kb_avail":732940940,"statfs":{"total":751619276800,"available":750531522560,"internally_reserved":0,"allocated":487227392,"data_stored":486962771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":600480656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":497917952,"data_stored":497917952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":425377792,"data_stored":425377792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":534528000,"data_stored":534528000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":385966080,"data_stored":385966080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:22:45.326 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:22:45.326 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 61 2026-02-24T08:22:45.482 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:45.626 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:45.622+0000 7f74b0f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:45.631 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:45.623+0000 7f74b0f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:45.786 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:22:45.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:22:45.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 14 128 108931 108803 60.7092 40.4688 0.0212904 0.0164526 2026-02-24T08:22:45.976 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:46.129 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:46.156 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:45 trial105 ceph-mon[39442]: from='client.14557 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:22:46.156 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:45 trial105 ceph-mon[39442]: pgmap v86: 17 pgs: 17 active+clean; 589 MiB data, 4.2 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s wr, 6.27k op/s 2026-02-24T08:22:46.157 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/732365682' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "61"} : dispatch 2026-02-24T08:22:46.255 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:46.252+0000 7f502225a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:46.255 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:46.252+0000 7f502225a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:46.275 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:46.276 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:46.292 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:46.293 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:46.306 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:46.306 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:46.320 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:46.320 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:46.877 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:46 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:22:46.877 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:46 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:22:46.877 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3963224060' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:46.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 15 127 113481 113354 59.0321 35.5547 0.0345706 0.0169195 2026-02-24T08:22:47.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 16 128 118645 118517 57.8635 40.3359 0.014114 0.0172431 2026-02-24T08:22:48.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:47 trial105 ceph-mon[39442]: pgmap v87: 17 pgs: 17 active+clean; 812 MiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.65k op/s 2026-02-24T08:22:48.909 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:48.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 17 127 124027 123900 56.9333 42.0547 0.0192022 0.0175478 2026-02-24T08:22:49.060 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:49.182 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:49.179+0000 7f570c18b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:49.183 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:49.180+0000 7f570c18b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:49.205 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:49.205 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:49.220 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:49.221 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:49.235 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:49.236 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:49.252 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:49.252 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:49.863 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:22:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:22:49] "GET /metrics HTTP/1.1" 200 4208 "" "Prometheus/3.6.0" 2026-02-24T08:22:49.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 18 128 129048 128920 55.9491 39.2188 0.0209566 0.0178554 2026-02-24T08:22:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:22:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:22:49.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:22:50.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:49 trial105 ceph-mon[39442]: pgmap v88: 17 pgs: 17 active+clean; 812 MiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s wr, 5.97k op/s 2026-02-24T08:22:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3596637035' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:50.836 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:50.836 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:50.837 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T08:22:50.837 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:22:50.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 19 128 133817 133689 54.9652 37.2578 0.0157839 0.0181737 2026-02-24T08:22:50.988 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:51.205 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:51.202+0000 7f926cddb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:51.205 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:51.202+0000 7f926cddb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:51.304 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:51.355 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:22:51.356 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:22:51.407 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2026-02-24T08:22:50.705599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1058742816,"num_objects":16153,"num_object_clones":0,"num_object_copies":48459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16153,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":129304,"num_write_kb":1035502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129268,"ondisk_log_size":129268,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5969380,"kb_used_data":3045908,"kb_used_omap":84,"kb_used_meta":2923307,"kb_avail":2930043420,"statfs":{"total":3006477107200,"available":3000364462080,"internally_reserved":0,"allocated":3119009792,"data_stored":3117954860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":86652,"internal_metadata":2993466756},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,5,16,27,24,13,33],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":794312704,"num_objects":12123,"num_object_clones":0,"num_object_copies":36369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96962,"num_write_kb":775696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001643"},"pg_stats":[{"pgid":"3.f","version":"41'7952","reported_seq":7963,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:49.874332+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:22:49.874332+0000","last_peered":"2026-02-24T08:22:49.874332+0000","last_clean":"2026-02-24T08:22:49.874332+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:22:49.874332+0000","last_undegraded":"2026-02-24T08:22:49.874332+0000","last_fullsized":"2026-02-24T08:22:49.874332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":7952,"log_dups_size":0,"ondisk_log_size":7952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65142784,"num_objects":994,"num_object_clones":0,"num_object_copies":2982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7952,"num_write_kb":63616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"41'7896","reported_seq":7908,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:49.871440+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:22:49.871440+0000","last_peered":"2026-02-24T08:22:49.871440+0000","last_clean":"2026-02-24T08:22:49.871440+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:22:49.871440+0000","last_undegraded":"2026-02-24T08:22:49.871440+0000","last_fullsized":"2026-02-24T08:22:49.871440+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":7896,"log_dups_size":0,"ondisk_log_size":7896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64684032,"num_objects":987,"num_object_clones":0,"num_object_copies":2961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":987,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7896,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"41'8040","reported_seq":8054,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:50.016799+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:22:50.016799+0000","last_peered":"2026-02-24T08:22:50.016799+0000","last_clean":"2026-02-24T08:22:50.016799+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:22:50.016799+0000","last_undegraded":"2026-02-24T08:22:50.016799+0000","last_fullsized":"2026-02-24T08:22:50.016799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8040,"log_dups_size":0,"ondisk_log_size":8040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65863680,"num_objects":1005,"num_object_clones":0,"num_object_copies":3015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8040,"num_write_kb":64320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"41'7832","reported_seq":7846,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:49.944403+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:22:49.944403+0000","last_peered":"2026-02-24T08:22:49.944403+0000","last_clean":"2026-02-24T08:22:49.944403+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:22:49.944403+0000","last_undegraded":"2026-02-24T08:22:49.944403+0000","last_fullsized":"2026-02-24T08:22:49.944403+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":7832,"log_dups_size":0,"ondisk_log_size":7832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64159744,"num_objects":979,"num_object_clones":0,"num_object_copies":2937,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":979,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7832,"num_write_kb":62656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"41'8035","reported_seq":8049,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:50.120309+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:22:50.120309+0000","last_peered":"2026-02-24T08:22:50.120309+0000","last_clean":"2026-02-24T08:22:50.120309+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:22:50.120309+0000","last_undegraded":"2026-02-24T08:22:50.120309+0000","last_fullsized":"2026-02-24T08:22:50.120309+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8035,"log_dups_size":0,"ondisk_log_size":8035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65822720,"num_objects":1005,"num_object_clones":0,"num_object_copies":3015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8035,"num_write_kb":64280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"41'7793","reported_seq":7803,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:50.023730+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:22:50.023730+0000","last_peered":"2026-02-24T08:22:50.023730+0000","last_clean":"2026-02-24T08:22:50.023730+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:22:50.023730+0000","last_undegraded":"2026-02-24T08:22:50.023730+0000","last_fullsized":"2026-02-24T08:22:50.023730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":7793,"log_dups_size":0,"ondisk_log_size":7793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63840256,"num_objects":975,"num_object_clones":0,"num_object_copies":2925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7793,"num_write_kb":62344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'8552","reported_seq":8561,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:50.022060+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:22:50.022060+0000","last_peered":"2026-02-24T08:22:50.022060+0000","last_clean":"2026-02-24T08:22:50.022060+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:22:50.022060+0000","last_undegraded":"2026-02-24T08:22:50.022060+0000","last_fullsized":"2026-02-24T08:22:50.022060+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8552,"log_dups_size":0,"ondisk_log_size":8552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70057984,"num_objects":1069,"num_object_clones":0,"num_object_copies":3207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8552,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"41'8472","reported_seq":8486,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:50.114664+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:22:50.114664+0000","last_peered":"2026-02-24T08:22:50.114664+0000","last_clean":"2026-02-24T08:22:50.114664+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:22:50.114664+0000","last_undegraded":"2026-02-24T08:22:50.114664+0000","last_fullsized":"2026-02-24T08:22:50.114664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8472,"log_dups_size":0,"ondisk_log_size":8472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69402624,"num_objects":1059,"num_object_clones":0,"num_object_copies":3177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8472,"num_write_kb":67776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"41'8226","reported_seq":8232,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:50.119154+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:22:50.119154+0000","last_peered":"2026-02-24T08:22:50.119154+0000","last_clean":"2026-02-24T08:22:50.119154+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:22:50.119154+0000","last_undegraded":"2026-02-24T08:22:50.119154+0000","last_fullsized":"2026-02-24T08:22:50.119154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8226,"log_dups_size":0,"ondisk_log_size":8226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67387392,"num_objects":1029,"num_object_clones":0,"num_object_copies":3087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1029,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8226,"num_write_kb":65808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"41'8325","reported_seq":8334,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:49.833356+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:22:49.833356+0000","last_peered":"2026-02-24T08:22:49.833356+0000","last_clean":"2026-02-24T08:22:49.833356+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:22:49.833356+0000","last_undegraded":"2026-02-24T08:22:49.833356+0000","last_fullsized":"2026-02-24T08:22:49.833356+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8325,"log_dups_size":0,"ondisk_log_size":8325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68198400,"num_objects":1041,"num_object_clones":0,"num_object_copies":3123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8325,"num_write_kb":66600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'8008","reported_seq":8020,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:49.872493+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:22:49.872493+0000","last_peered":"2026-02-24T08:22:49.872493+0000","last_clean":"2026-02-24T08:22:49.872493+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:22:49.872493+0000","last_undegraded":"2026-02-24T08:22:49.872493+0000","last_fullsized":"2026-02-24T08:22:49.872493+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8008,"log_dups_size":0,"ondisk_log_size":8008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65601536,"num_objects":1001,"num_object_clones":0,"num_object_copies":3003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8008,"num_write_kb":64064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"41'8103","reported_seq":8116,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:50.115790+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:22:50.115790+0000","last_peered":"2026-02-24T08:22:50.115790+0000","last_clean":"2026-02-24T08:22:50.115790+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:22:50.115790+0000","last_undegraded":"2026-02-24T08:22:50.115790+0000","last_fullsized":"2026-02-24T08:22:50.115790+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8103,"log_dups_size":0,"ondisk_log_size":8103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66379776,"num_objects":1013,"num_object_clones":0,"num_object_copies":3039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8103,"num_write_kb":64824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'7539","reported_seq":7551,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:49.866118+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:22:49.866118+0000","last_peered":"2026-02-24T08:22:49.866118+0000","last_clean":"2026-02-24T08:22:49.866118+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:22:49.866118+0000","last_undegraded":"2026-02-24T08:22:49.866118+0000","last_fullsized":"2026-02-24T08:22:49.866118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":7539,"log_dups_size":0,"ondisk_log_size":7539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61759488,"num_objects":943,"num_object_clones":0,"num_object_copies":2829,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":943,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7539,"num_write_kb":60312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"41'8034","reported_seq":8045,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:49.826190+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:22:49.826190+0000","last_peered":"2026-02-24T08:22:49.826190+0000","last_clean":"2026-02-24T08:22:49.826190+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:22:49.826190+0000","last_undegraded":"2026-02-24T08:22:49.826190+0000","last_fullsized":"2026-02-24T08:22:49.826190+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8034,"log_dups_size":0,"ondisk_log_size":8034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65814528,"num_objects":1005,"num_object_clones":0,"num_object_copies":3015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8034,"num_write_kb":64272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"41'8032","reported_seq":8046,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:50.065053+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:22:50.065053+0000","last_peered":"2026-02-24T08:22:50.065053+0000","last_clean":"2026-02-24T08:22:50.065053+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:22:50.065053+0000","last_undegraded":"2026-02-24T08:22:50.065053+0000","last_fullsized":"2026-02-24T08:22:50.065053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8032,"log_dups_size":0,"ondisk_log_size":8032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65798144,"num_objects":1004,"num_object_clones":0,"num_object_copies":3012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1004,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8032,"num_write_kb":64256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"41'8330","reported_seq":8344,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:50.111264+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:22:50.111264+0000","last_peered":"2026-02-24T08:22:50.111264+0000","last_clean":"2026-02-24T08:22:50.111264+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:22:50.111264+0000","last_undegraded":"2026-02-24T08:22:50.111264+0000","last_fullsized":"2026-02-24T08:22:50.111264+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8330,"log_dups_size":0,"ondisk_log_size":8330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68239360,"num_objects":1042,"num_object_clones":0,"num_object_copies":3126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8330,"num_write_kb":66640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":92,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:46.030099+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:22:46.030099+0000","last_peered":"2026-02-24T08:22:46.030099+0000","last_clean":"2026-02-24T08:22:46.030099+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:22:46.030099+0000","last_undegraded":"2026-02-24T08:22:46.030099+0000","last_fullsized":"2026-02-24T08:22:46.030099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1058152448,"num_objects":16151,"num_object_clones":0,"num_object_copies":48453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129169,"num_write_kb":1033352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3171155968,"data_stored":3171155968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129169,"ondisk_log_size":129169,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9264,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247840,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1421924,"kb_used_data":618768,"kb_used_omap":16,"kb_used_meta":803119,"kb_avail":732581276,"statfs":{"total":751619276800,"available":750163226624,"internally_reserved":0,"allocated":633618432,"data_stored":633353811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16677,"internal_metadata":822394587},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,0,0,24],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444066,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1606140,"kb_used_data":893352,"kb_used_omap":20,"kb_used_meta":712747,"kb_avail":732397060,"statfs":{"total":751619276800,"available":749974589440,"internally_reserved":0,"allocated":914792448,"data_stored":914527827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":729853277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1442760,"kb_used_data":711924,"kb_used_omap":22,"kb_used_meta":730793,"kb_avail":732560440,"statfs":{"total":751619276800,"available":750141890560,"internally_reserved":0,"allocated":729010176,"data_stored":728749107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23108,"internal_metadata":748332476},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,11,14,8,10,9],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1498556,"kb_used_data":821864,"kb_used_omap":25,"kb_used_meta":676646,"kb_avail":732504644,"statfs":{"total":751619276800,"available":750084755456,"internally_reserved":0,"allocated":841588736,"data_stored":841324115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":692886416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,5,13,16,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9264,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":856645632,"data_stored":856645632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":733028352,"data_stored":733028352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":923451392,"data_stored":923451392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":658030592,"data_stored":658030592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:22:51.408 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:22:51.408 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 36 2026-02-24T08:22:51.461 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:51.571 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:51.582 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:51.579+0000 7fac7a047640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:51.583 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:51.580+0000 7fac7a047640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:51.602 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:51.602 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:51.619 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:51.619 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:51.633 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:51.633 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:51.649 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:51.650 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:51.706 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:51.703+0000 7fcce059e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:51.706 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:51.703+0000 7fcce059e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:51.866 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:22:51.906 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:51 trial105 ceph-mon[39442]: pgmap v89: 17 pgs: 17 active+clean; 1010 MiB data, 5.7 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s wr, 8.08k op/s 2026-02-24T08:22:51.907 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2102625570' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:51.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:22:51.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:22:51.931297+0000 min lat: 0.000724324 max lat: 0.151331 avg lat: 0.0185274 2026-02-24T08:22:51.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:22:51.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 20 128 138158 138030 53.9125 33.9141 0.0092854 0.0185274 2026-02-24T08:22:52.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 21 127 142739 142612 53.0497 35.7969 0.0847287 0.0188332 2026-02-24T08:22:53.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:52 trial105 ceph-mon[39442]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:22:53.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1488840817' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T08:22:53.696 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:53.859 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:53.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 22 128 147223 147095 52.2302 35.0234 0.037739 0.0191308 2026-02-24T08:22:53.977 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:53 trial105 ceph-mon[39442]: pgmap v90: 17 pgs: 17 active+clean; 1010 MiB data, 5.7 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.49k op/s 2026-02-24T08:22:53.993 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:53.990+0000 7f66fd147640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:53.993 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:53.990+0000 7f66fd147640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:54.010 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:54.011 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:54.026 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:54.026 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:54.043 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:54.043 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:54.059 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:54.059 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:54.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 23 128 151505 151377 51.4137 33.4531 0.020907 0.0194262 2026-02-24T08:22:55.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2828757458' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:55.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 24 128 155702 155574 50.6376 32.7891 0.0949734 0.0197235 2026-02-24T08:22:56.110 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:22:56.133 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:55 trial105 ceph-mon[39442]: pgmap v91: 17 pgs: 17 active+clean; 1010 MiB data, 5.7 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.49k op/s 2026-02-24T08:22:56.260 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:56.394 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:56.391+0000 7fc17e78b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:56.394 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:56.392+0000 7fc17e78b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:56.419 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:56.419 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:56.432 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:56.433 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:56.446 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:56.446 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:56.461 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:56.462 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:56.909 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:22:56.909 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:22:56.909 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2026-02-24T08:22:56.909 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:22:56.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 25 128 159590 159462 49.827 30.375 0.0303387 0.0200537 2026-02-24T08:22:57.063 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:57.125 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1505295380' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:57.191 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:57.189+0000 7f9796fad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:57.192 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:57.189+0000 7f9796fad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:57.347 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:22:57.347 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:22:57.400 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-24T08:22:56.706431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1244463648,"num_objects":18985,"num_object_clones":0,"num_object_copies":56955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18985,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":151975,"num_write_kb":1216870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151939,"ondisk_log_size":151939,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6588676,"kb_used_data":3592996,"kb_used_omap":84,"kb_used_meta":2995499,"kb_avail":2929424124,"statfs":{"total":3006477107200,"available":2999730302976,"internally_reserved":0,"allocated":3679227904,"data_stored":3678172972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":86652,"internal_metadata":3067391364},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,6,8,30,17,13,13,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":627310592,"num_objects":9572,"num_object_clones":0,"num_object_copies":28716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9572,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76576,"num_write_kb":612608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001652"},"pg_stats":[{"pgid":"3.f","version":"41'9318","reported_seq":9325,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:54.893690+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:22:54.893690+0000","last_peered":"2026-02-24T08:22:54.893690+0000","last_clean":"2026-02-24T08:22:54.893690+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:22:54.893690+0000","last_undegraded":"2026-02-24T08:22:54.893690+0000","last_fullsized":"2026-02-24T08:22:54.893690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9318,"log_dups_size":0,"ondisk_log_size":9318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76333056,"num_objects":1165,"num_object_clones":0,"num_object_copies":3495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9318,"num_write_kb":74544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"41'9441","reported_seq":9452,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:54.888458+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:22:54.888458+0000","last_peered":"2026-02-24T08:22:54.888458+0000","last_clean":"2026-02-24T08:22:54.888458+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:22:54.888458+0000","last_undegraded":"2026-02-24T08:22:54.888458+0000","last_fullsized":"2026-02-24T08:22:54.888458+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9441,"log_dups_size":0,"ondisk_log_size":9441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77340672,"num_objects":1181,"num_object_clones":0,"num_object_copies":3543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9441,"num_write_kb":75528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"41'9527","reported_seq":9533,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.042978+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:22:55.042978+0000","last_peered":"2026-02-24T08:22:55.042978+0000","last_clean":"2026-02-24T08:22:55.042978+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:22:55.042978+0000","last_undegraded":"2026-02-24T08:22:55.042978+0000","last_fullsized":"2026-02-24T08:22:55.042978+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9527,"log_dups_size":0,"ondisk_log_size":9527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78045184,"num_objects":1191,"num_object_clones":0,"num_object_copies":3573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9527,"num_write_kb":76216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"41'9174","reported_seq":9184,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.038881+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:22:55.038881+0000","last_peered":"2026-02-24T08:22:55.038881+0000","last_clean":"2026-02-24T08:22:55.038881+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:22:55.038881+0000","last_undegraded":"2026-02-24T08:22:55.038881+0000","last_fullsized":"2026-02-24T08:22:55.038881+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9174,"log_dups_size":0,"ondisk_log_size":9174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75153408,"num_objects":1147,"num_object_clones":0,"num_object_copies":3441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9174,"num_write_kb":73392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"41'9528","reported_seq":9542,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.143233+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:22:55.143233+0000","last_peered":"2026-02-24T08:22:55.143233+0000","last_clean":"2026-02-24T08:22:55.143233+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:22:55.143233+0000","last_undegraded":"2026-02-24T08:22:55.143233+0000","last_fullsized":"2026-02-24T08:22:55.143233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9528,"log_dups_size":0,"ondisk_log_size":9528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78053376,"num_objects":1191,"num_object_clones":0,"num_object_copies":3573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9528,"num_write_kb":76224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"41'9352","reported_seq":9366,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.037614+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:22:55.037614+0000","last_peered":"2026-02-24T08:22:55.037614+0000","last_clean":"2026-02-24T08:22:55.037614+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:22:55.037614+0000","last_undegraded":"2026-02-24T08:22:55.037614+0000","last_fullsized":"2026-02-24T08:22:55.037614+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9352,"log_dups_size":0,"ondisk_log_size":9352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76611584,"num_objects":1169,"num_object_clones":0,"num_object_copies":3507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1169,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9352,"num_write_kb":74816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'10000","reported_seq":10012,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.042711+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:22:55.042711+0000","last_peered":"2026-02-24T08:22:55.042711+0000","last_clean":"2026-02-24T08:22:55.042711+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:22:55.042711+0000","last_undegraded":"2026-02-24T08:22:55.042711+0000","last_fullsized":"2026-02-24T08:22:55.042711+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10000,"log_dups_size":0,"ondisk_log_size":10000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81920000,"num_objects":1250,"num_object_clones":0,"num_object_copies":3750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10000,"num_write_kb":80000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"41'9744","reported_seq":9758,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.132032+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:22:55.132032+0000","last_peered":"2026-02-24T08:22:55.132032+0000","last_clean":"2026-02-24T08:22:55.132032+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:22:55.132032+0000","last_undegraded":"2026-02-24T08:22:55.132032+0000","last_fullsized":"2026-02-24T08:22:55.132032+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9744,"log_dups_size":0,"ondisk_log_size":9744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79822848,"num_objects":1218,"num_object_clones":0,"num_object_copies":3654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9744,"num_write_kb":77952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"41'9664","reported_seq":9678,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.053872+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:22:55.053872+0000","last_peered":"2026-02-24T08:22:55.053872+0000","last_clean":"2026-02-24T08:22:55.053872+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:22:55.053872+0000","last_undegraded":"2026-02-24T08:22:55.053872+0000","last_fullsized":"2026-02-24T08:22:55.053872+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9664,"log_dups_size":0,"ondisk_log_size":9664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79167488,"num_objects":1208,"num_object_clones":0,"num_object_copies":3624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9664,"num_write_kb":77312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"41'9776","reported_seq":9790,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:54.785556+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:22:54.785556+0000","last_peered":"2026-02-24T08:22:54.785556+0000","last_clean":"2026-02-24T08:22:54.785556+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:22:54.785556+0000","last_undegraded":"2026-02-24T08:22:54.785556+0000","last_fullsized":"2026-02-24T08:22:54.785556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9776,"log_dups_size":0,"ondisk_log_size":9776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80084992,"num_objects":1222,"num_object_clones":0,"num_object_copies":3666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9776,"num_write_kb":78208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'9442","reported_seq":9456,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:54.868454+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:22:54.868454+0000","last_peered":"2026-02-24T08:22:54.868454+0000","last_clean":"2026-02-24T08:22:54.868454+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:22:54.868454+0000","last_undegraded":"2026-02-24T08:22:54.868454+0000","last_fullsized":"2026-02-24T08:22:54.868454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9442,"log_dups_size":0,"ondisk_log_size":9442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77348864,"num_objects":1181,"num_object_clones":0,"num_object_copies":3543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9442,"num_write_kb":75536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"41'9414","reported_seq":9426,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.144924+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:22:55.144924+0000","last_peered":"2026-02-24T08:22:55.144924+0000","last_clean":"2026-02-24T08:22:55.144924+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:22:55.144924+0000","last_undegraded":"2026-02-24T08:22:55.144924+0000","last_fullsized":"2026-02-24T08:22:55.144924+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9414,"log_dups_size":0,"ondisk_log_size":9414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77119488,"num_objects":1177,"num_object_clones":0,"num_object_copies":3531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9414,"num_write_kb":75312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'8976","reported_seq":8990,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:54.859494+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:22:54.859494+0000","last_peered":"2026-02-24T08:22:54.859494+0000","last_clean":"2026-02-24T08:22:54.859494+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:22:54.859494+0000","last_undegraded":"2026-02-24T08:22:54.859494+0000","last_fullsized":"2026-02-24T08:22:54.859494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":8976,"log_dups_size":0,"ondisk_log_size":8976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73531392,"num_objects":1122,"num_object_clones":0,"num_object_copies":3366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8976,"num_write_kb":71808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"41'9304","reported_seq":9318,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:54.831468+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:22:54.831468+0000","last_peered":"2026-02-24T08:22:54.831468+0000","last_clean":"2026-02-24T08:22:54.831468+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:22:54.831468+0000","last_undegraded":"2026-02-24T08:22:54.831468+0000","last_fullsized":"2026-02-24T08:22:54.831468+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9304,"log_dups_size":0,"ondisk_log_size":9304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76218368,"num_objects":1163,"num_object_clones":0,"num_object_copies":3489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1163,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9304,"num_write_kb":74432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"41'9424","reported_seq":9438,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.102515+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:22:55.102515+0000","last_peered":"2026-02-24T08:22:55.102515+0000","last_clean":"2026-02-24T08:22:55.102515+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:22:55.102515+0000","last_undegraded":"2026-02-24T08:22:55.102515+0000","last_fullsized":"2026-02-24T08:22:55.102515+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9424,"log_dups_size":0,"ondisk_log_size":9424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77201408,"num_objects":1178,"num_object_clones":0,"num_object_copies":3534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9424,"num_write_kb":75392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"41'9756","reported_seq":9767,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:55.127176+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:22:55.127176+0000","last_peered":"2026-02-24T08:22:55.127176+0000","last_clean":"2026-02-24T08:22:55.127176+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:22:55.127176+0000","last_undegraded":"2026-02-24T08:22:55.127176+0000","last_fullsized":"2026-02-24T08:22:55.127176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":9756,"log_dups_size":0,"ondisk_log_size":9756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79921152,"num_objects":1220,"num_object_clones":0,"num_object_copies":3660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9756,"num_write_kb":78048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":92,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:46.030099+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:22:46.030099+0000","last_peered":"2026-02-24T08:22:46.030099+0000","last_clean":"2026-02-24T08:22:46.030099+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:22:46.030099+0000","last_undegraded":"2026-02-24T08:22:46.030099+0000","last_fullsized":"2026-02-24T08:22:46.030099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1243873280,"num_objects":18983,"num_object_clones":0,"num_object_copies":56949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18983,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151840,"num_write_kb":1214720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3725697024,"data_stored":3725697024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151840,"ondisk_log_size":151840,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9264,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247841,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1539820,"kb_used_data":736664,"kb_used_omap":16,"kb_used_meta":803119,"kb_avail":732463380,"statfs":{"total":751619276800,"available":750042501120,"internally_reserved":0,"allocated":754343936,"data_stored":754079315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16677,"internal_metadata":822394587},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,1,15,17],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444067,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1783308,"kb_used_data":1052456,"kb_used_omap":20,"kb_used_meta":730795,"kb_avail":732219892,"statfs":{"total":751619276800,"available":749793169408,"internally_reserved":0,"allocated":1077714944,"data_stored":1077450323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":748334429},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,4,3,0,8,13,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1585312,"kb_used_data":836428,"kb_used_omap":22,"kb_used_meta":748841,"kb_avail":732417888,"statfs":{"total":751619276800,"available":749995917312,"internally_reserved":0,"allocated":856502272,"data_stored":856241203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23108,"internal_metadata":766813628},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1680236,"kb_used_data":967448,"kb_used_omap":25,"kb_used_meta":712742,"kb_avail":732322964,"statfs":{"total":751619276800,"available":749898715136,"internally_reserved":0,"allocated":990666752,"data_stored":990402131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":729848720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,3,12,0,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9264,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1005051904,"data_stored":1005051904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":858857472,"data_stored":858857472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1085825024,"data_stored":1085825024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":775962624,"data_stored":775962624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:22:57.402 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_1 pgp_num 36 2026-02-24T08:22:57.586 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:57.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 26 128 163059 162931 48.9529 27.1016 0.0120626 0.0204007 2026-02-24T08:22:57.955 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:57 trial105 ceph-mon[39442]: pgmap v92: 17 pgs: 17 active+clean; 1.2 GiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.38k op/s 2026-02-24T08:22:58.014 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:58.012+0000 7fb9506d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:58.015 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:58.012+0000 7fb9506d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:58.166 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:22:58.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:22:58.506 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:22:58.655 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:22:58.779 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:58.776+0000 7f8cea0bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:58.779 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:22:58.777+0000 7f8cea0bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:22:58.795 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:22:58.795 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:22:58.810 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:22:58.811 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:22:58.824 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:22:58.824 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:22:58.838 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:22:58.839 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:22:58.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 27 128 166524 166396 48.1424 27.0703 0.0110576 0.020751 2026-02-24T08:22:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:58 trial105 ceph-mon[39442]: from='client.14575 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:22:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3512467363' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "36"} : dispatch 2026-02-24T08:22:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1123672374' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:22:59.875 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:22:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:22:59] "GET /metrics HTTP/1.1" 200 4212 "" "Prometheus/3.6.0" 2026-02-24T08:22:59.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 28 128 170379 170251 47.4986 30.1172 0.0353271 0.0210379 2026-02-24T08:22:59.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:22:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:22:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:23:00.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:59 trial105 ceph-mon[39442]: pgmap v93: 17 pgs: 17 active+clean; 1.2 GiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 4.00k op/s 2026-02-24T08:23:00.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:22:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:23:00.881 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:00.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 29 128 174004 173876 46.8372 28.3203 0.0412678 0.021329 2026-02-24T08:23:01.031 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:01.159 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:01.156+0000 7f8963412640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:01.159 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:01.157+0000 7f8963412640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:01.178 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:01.179 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:01.197 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:01.197 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:01.211 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:01.211 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:01.227 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:01.227 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:01.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 30 128 177682 177554 46.2337 28.7344 0.0588261 0.0216119 2026-02-24T08:23:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:01 trial105 ceph-mon[39442]: pgmap v94: 17 pgs: 17 active+clean; 1.3 GiB data, 6.8 GiB used, 2.7 TiB / 2.7 TiB avail; 43 MiB/s wr, 5.56k op/s 2026-02-24T08:23:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1042473865' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:02.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 31 128 181535 181407 45.7132 30.1016 0.0123248 0.0218599 2026-02-24T08:23:03.207 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:23:03.207 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:23:03.207 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:03.267 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:03.361 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:03.427 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:03.683 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:03.680+0000 7f355bf9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:03.683 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:03.680+0000 7f355bf9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:03.730 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:03.728+0000 7f923934c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:03.731 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:03.728+0000 7f923934c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:03.748 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:03.748 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:03.764 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:03.764 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:03.780 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:03.780 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:03.796 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:03.797 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:03.834 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:03.834 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:03.878 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2026-02-24T08:23:02.707302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1398194720,"num_objects":21329,"num_object_clones":0,"num_object_copies":63987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21329,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":170741,"num_write_kb":1366998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161105,"ondisk_log_size":161105,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7138772,"kb_used_data":4052868,"kb_used_omap":84,"kb_used_meta":3085739,"kb_avail":2928874028,"statfs":{"total":3006477107200,"available":2999167004672,"internally_reserved":0,"allocated":4150136832,"data_stored":4149081900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":86652,"internal_metadata":3159797124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,6,13,17,25,7],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":339451904,"num_objects":5176,"num_object_clones":0,"num_object_copies":15528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41437,"num_write_kb":331496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001703"},"pg_stats":[{"pgid":"3.f","version":"41'10616","reported_seq":10630,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:59.896036+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:22:59.896036+0000","last_peered":"2026-02-24T08:22:59.896036+0000","last_clean":"2026-02-24T08:22:59.896036+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:22:59.896036+0000","last_undegraded":"2026-02-24T08:22:59.896036+0000","last_fullsized":"2026-02-24T08:22:59.896036+0000","mapping_epoch":39,"log_start":"41'600","ondisk_log_start":"41'600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86966272,"num_objects":1327,"num_object_clones":0,"num_object_copies":3981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10616,"num_write_kb":84928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"41'10757","reported_seq":10769,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:59.899849+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:22:59.899849+0000","last_peered":"2026-02-24T08:22:59.899849+0000","last_clean":"2026-02-24T08:22:59.899849+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:22:59.899849+0000","last_undegraded":"2026-02-24T08:22:59.899849+0000","last_fullsized":"2026-02-24T08:22:59.899849+0000","mapping_epoch":39,"log_start":"41'700","ondisk_log_start":"41'700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88121344,"num_objects":1345,"num_object_clones":0,"num_object_copies":4035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10757,"num_write_kb":86056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"41'10664","reported_seq":10678,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:00.009123+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:23:00.009123+0000","last_peered":"2026-02-24T08:23:00.009123+0000","last_clean":"2026-02-24T08:23:00.009123+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:00.009123+0000","last_undegraded":"2026-02-24T08:23:00.009123+0000","last_fullsized":"2026-02-24T08:23:00.009123+0000","mapping_epoch":39,"log_start":"41'600","ondisk_log_start":"41'600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87359488,"num_objects":1333,"num_object_clones":0,"num_object_copies":3999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10664,"num_write_kb":85312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"41'10280","reported_seq":10287,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:00.048834+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:23:00.048834+0000","last_peered":"2026-02-24T08:23:00.048834+0000","last_clean":"2026-02-24T08:23:00.048834+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:00.048834+0000","last_undegraded":"2026-02-24T08:23:00.048834+0000","last_fullsized":"2026-02-24T08:23:00.048834+0000","mapping_epoch":39,"log_start":"41'200","ondisk_log_start":"41'200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84213760,"num_objects":1285,"num_object_clones":0,"num_object_copies":3855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10280,"num_write_kb":82240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"41'10720","reported_seq":10734,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:00.152472+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:23:00.152472+0000","last_peered":"2026-02-24T08:23:00.152472+0000","last_clean":"2026-02-24T08:23:00.152472+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:00.152472+0000","last_undegraded":"2026-02-24T08:23:00.152472+0000","last_fullsized":"2026-02-24T08:23:00.152472+0000","mapping_epoch":39,"log_start":"41'700","ondisk_log_start":"41'700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87818240,"num_objects":1340,"num_object_clones":0,"num_object_copies":4020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10720,"num_write_kb":85760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"41'10568","reported_seq":10582,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:59.938636+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:22:59.938636+0000","last_peered":"2026-02-24T08:22:59.938636+0000","last_clean":"2026-02-24T08:22:59.938636+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:22:59.938636+0000","last_undegraded":"2026-02-24T08:22:59.938636+0000","last_fullsized":"2026-02-24T08:22:59.938636+0000","mapping_epoch":39,"log_start":"41'500","ondisk_log_start":"41'500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86573056,"num_objects":1321,"num_object_clones":0,"num_object_copies":3963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1321,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10568,"num_write_kb":84544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"41'10944","reported_seq":10958,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:00.013304+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:23:00.013304+0000","last_peered":"2026-02-24T08:23:00.013304+0000","last_clean":"2026-02-24T08:23:00.013304+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:00.013304+0000","last_undegraded":"2026-02-24T08:23:00.013304+0000","last_fullsized":"2026-02-24T08:23:00.013304+0000","mapping_epoch":39,"log_start":"41'900","ondisk_log_start":"41'900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89653248,"num_objects":1368,"num_object_clones":0,"num_object_copies":4104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10944,"num_write_kb":87552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"41'10888","reported_seq":10902,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:00.119892+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:23:00.119892+0000","last_peered":"2026-02-24T08:23:00.119892+0000","last_clean":"2026-02-24T08:23:00.119892+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:00.119892+0000","last_undegraded":"2026-02-24T08:23:00.119892+0000","last_fullsized":"2026-02-24T08:23:00.119892+0000","mapping_epoch":39,"log_start":"41'800","ondisk_log_start":"41'800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89194496,"num_objects":1361,"num_object_clones":0,"num_object_copies":4083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1361,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10888,"num_write_kb":87104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"41'10792","reported_seq":10806,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:00.110117+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:23:00.110117+0000","last_peered":"2026-02-24T08:23:00.110117+0000","last_clean":"2026-02-24T08:23:00.110117+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:00.110117+0000","last_undegraded":"2026-02-24T08:23:00.110117+0000","last_fullsized":"2026-02-24T08:23:00.110117+0000","mapping_epoch":39,"log_start":"41'700","ondisk_log_start":"41'700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88408064,"num_objects":1349,"num_object_clones":0,"num_object_copies":4047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10792,"num_write_kb":86336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"41'10944","reported_seq":10958,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:59.795072+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:22:59.795072+0000","last_peered":"2026-02-24T08:22:59.795072+0000","last_clean":"2026-02-24T08:22:59.795072+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:22:59.795072+0000","last_undegraded":"2026-02-24T08:22:59.795072+0000","last_fullsized":"2026-02-24T08:22:59.795072+0000","mapping_epoch":39,"log_start":"41'900","ondisk_log_start":"41'900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89653248,"num_objects":1368,"num_object_clones":0,"num_object_copies":4104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10944,"num_write_kb":87552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'10615","reported_seq":10626,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:59.893838+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:22:59.893838+0000","last_peered":"2026-02-24T08:22:59.893838+0000","last_clean":"2026-02-24T08:22:59.893838+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:22:59.893838+0000","last_undegraded":"2026-02-24T08:22:59.893838+0000","last_fullsized":"2026-02-24T08:22:59.893838+0000","mapping_epoch":39,"log_start":"41'600","ondisk_log_start":"41'600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86958080,"num_objects":1327,"num_object_clones":0,"num_object_copies":3981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10615,"num_write_kb":84920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"41'10600","reported_seq":10614,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:00.079799+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:00.079799+0000","last_peered":"2026-02-24T08:23:00.079799+0000","last_clean":"2026-02-24T08:23:00.079799+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:00.079799+0000","last_undegraded":"2026-02-24T08:23:00.079799+0000","last_fullsized":"2026-02-24T08:23:00.079799+0000","mapping_epoch":39,"log_start":"41'500","ondisk_log_start":"41'500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86835200,"num_objects":1325,"num_object_clones":0,"num_object_copies":3975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10600,"num_write_kb":84800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'10194","reported_seq":10206,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:59.899878+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:22:59.899878+0000","last_peered":"2026-02-24T08:22:59.899878+0000","last_clean":"2026-02-24T08:22:59.899878+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:22:59.899878+0000","last_undegraded":"2026-02-24T08:22:59.899878+0000","last_fullsized":"2026-02-24T08:22:59.899878+0000","mapping_epoch":39,"log_start":"41'100","ondisk_log_start":"41'100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83509248,"num_objects":1275,"num_object_clones":0,"num_object_copies":3825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1275,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10194,"num_write_kb":81552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"41'10376","reported_seq":10390,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:59.842352+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:22:59.842352+0000","last_peered":"2026-02-24T08:22:59.842352+0000","last_clean":"2026-02-24T08:22:59.842352+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:22:59.842352+0000","last_undegraded":"2026-02-24T08:22:59.842352+0000","last_fullsized":"2026-02-24T08:22:59.842352+0000","mapping_epoch":39,"log_start":"41'300","ondisk_log_start":"41'300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85000192,"num_objects":1297,"num_object_clones":0,"num_object_copies":3891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10376,"num_write_kb":83008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"41'10664","reported_seq":10671,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:00.149330+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:23:00.149330+0000","last_peered":"2026-02-24T08:23:00.149330+0000","last_clean":"2026-02-24T08:23:00.149330+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:00.149330+0000","last_undegraded":"2026-02-24T08:23:00.149330+0000","last_fullsized":"2026-02-24T08:23:00.149330+0000","mapping_epoch":39,"log_start":"41'600","ondisk_log_start":"41'600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87359488,"num_objects":1333,"num_object_clones":0,"num_object_copies":3999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10664,"num_write_kb":85312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"41'10984","reported_seq":10998,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:00.093704+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:23:00.093704+0000","last_peered":"2026-02-24T08:23:00.093704+0000","last_clean":"2026-02-24T08:23:00.093704+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:00.093704+0000","last_undegraded":"2026-02-24T08:23:00.093704+0000","last_fullsized":"2026-02-24T08:23:00.093704+0000","mapping_epoch":39,"log_start":"41'900","ondisk_log_start":"41'900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89980928,"num_objects":1373,"num_object_clones":0,"num_object_copies":4119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1373,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10984,"num_write_kb":87872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":92,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:22:46.030099+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:22:46.030099+0000","last_peered":"2026-02-24T08:22:46.030099+0000","last_clean":"2026-02-24T08:22:46.030099+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:22:46.030099+0000","last_undegraded":"2026-02-24T08:22:46.030099+0000","last_fullsized":"2026-02-24T08:22:46.030099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1397604352,"num_objects":21327,"num_object_clones":0,"num_object_copies":63981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170606,"num_write_kb":1364848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4188979200,"data_stored":4188979200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161006,"ondisk_log_size":161006,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9264,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247842,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1673700,"kb_used_data":834448,"kb_used_omap":16,"kb_used_meta":839215,"kb_avail":732329500,"statfs":{"total":751619276800,"available":749905408000,"internally_reserved":0,"allocated":854474752,"data_stored":854210131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16677,"internal_metadata":859356891},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,11,5,7],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444068,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1936420,"kb_used_data":1187536,"kb_used_omap":20,"kb_used_meta":748843,"kb_avail":732066780,"statfs":{"total":751619276800,"available":749636382720,"internally_reserved":0,"allocated":1216036864,"data_stored":1215772243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":766815581},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,1,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1709448,"kb_used_data":942516,"kb_used_omap":22,"kb_used_meta":766889,"kb_avail":732293752,"statfs":{"total":751619276800,"available":749868802048,"internally_reserved":0,"allocated":965136384,"data_stored":964875315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23108,"internal_metadata":785294780},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1819204,"kb_used_data":1088368,"kb_used_omap":25,"kb_used_meta":730790,"kb_avail":732183996,"statfs":{"total":751619276800,"available":749756411904,"internally_reserved":0,"allocated":1114488832,"data_stored":1114224211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":748329872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,11,4,20],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9264,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1128783872,"data_stored":1128783872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":965083136,"data_stored":965083136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1222139904,"data_stored":1222139904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":872972288,"data_stored":872972288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:03.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 32 128 184896 184768 45.1052 26.2578 0.15378 0.0221344 2026-02-24T08:23:04.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:03 trial105 ceph-mon[39442]: pgmap v95: 17 pgs: 17 active+clean; 1.3 GiB data, 6.8 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.45k op/s 2026-02-24T08:23:04.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2274750644' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:04.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 33 128 188496 188368 44.5906 28.125 0.0143461 0.0224081 2026-02-24T08:23:05.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:04 trial105 ceph-mon[39442]: from='client.14583 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:05.844 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:05.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 34 127 192317 192190 44.1573 29.8594 0.016588 0.0226297 2026-02-24T08:23:05.995 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:06.128 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:06.125+0000 7ffa69909640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:06.128 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:05 trial105 ceph-mon[39442]: pgmap v96: 17 pgs: 17 active+clean; 1.3 GiB data, 6.8 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.45k op/s 2026-02-24T08:23:06.129 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:06.126+0000 7ffa69909640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:06.144 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:06.145 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:06.160 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:06.160 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:06.174 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:06.174 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:06.192 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:06.192 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:06.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 35 128 196101 195973 43.74 29.5547 0.0548685 0.0228426 2026-02-24T08:23:07.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:06 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4230600302' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:07.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 36 128 199896 199768 43.3485 29.6484 0.0153077 0.0230507 2026-02-24T08:23:08.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:07 trial105 ceph-mon[39442]: pgmap v97: 17 pgs: 17 active+clean; 1.4 GiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 39 MiB/s wr, 4.97k op/s 2026-02-24T08:23:08.239 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:08.403 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:08.543 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:08.540+0000 7f280bad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:08.544 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:08.541+0000 7f280bad7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:08.560 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:08.561 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:08.576 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:08.576 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:08.593 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:08.593 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:08.607 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:08.607 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:08.881 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:23:08.881 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:23:08.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 37 128 203742 203614 42.9889 30.0469 0.0446718 0.0232431 2026-02-24T08:23:09.027 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:09.145 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2676650921' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:09.331 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:09.329+0000 7f2bb41e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:09.331 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:09.329+0000 7f2bb41e9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:09.842 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:23:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:23:09.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:23:09.888 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:23:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:23:09] "GET /metrics HTTP/1.1" 200 4212 "" "Prometheus/3.6.0" 2026-02-24T08:23:09.888 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:23:09.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 38 128 207415 207287 42.6127 28.6953 0.0326674 0.0234519 2026-02-24T08:23:09.934 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:23:10.081 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:10.140 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:09 trial105 ceph-mon[39442]: pgmap v98: 17 pgs: 17 active+clean; 1.4 GiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.08k op/s 2026-02-24T08:23:10.141 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:09 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3109850728' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:23:10.216 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:10.214+0000 7f1d74be4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:10.216 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:10.214+0000 7f1d74be4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:10.653 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:10.798 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:10.890 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:23:10.933 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:10.930+0000 7f337455d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:10.933 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3109850728' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:23:10.933 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:10 trial105 ceph-mon[39442]: osdmap e42: 4 total, 4 up, 4 in 2026-02-24T08:23:10.933 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1653856968' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:23:10.934 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:10.931+0000 7f337455d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:10.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 39 128 211087 210959 42.2556 28.6875 0.0308212 0.0236414 2026-02-24T08:23:10.939 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:23:10.947 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:10.947 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:10.961 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:10.961 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:10.976 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:10.976 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:10.988 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:10.989 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:11.100 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:11.227 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:11.224+0000 7fe53f362640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:11.227 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:11.225+0000 7fe53f362640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:11.891 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:23:11.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:23:11.932839+0000 min lat: 0.000724324 max lat: 0.201373 avg lat: 0.0238396 2026-02-24T08:23:11.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:23:11.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 40 128 214761 214633 41.9168 28.7031 0.0574283 0.0238396 2026-02-24T08:23:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:11 trial105 ceph-mon[39442]: pgmap v100: 17 pgs: 17 active+clean; 1.6 GiB data, 7.9 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.72k op/s 2026-02-24T08:23:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1653856968' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:23:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:11 trial105 ceph-mon[39442]: osdmap e43: 4 total, 4 up, 4 in 2026-02-24T08:23:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/275767294' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2562607106' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:23:12.483 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:23:12.642 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:12.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 41 128 217712 217584 41.4567 23.0547 0.0606253 0.0240967 2026-02-24T08:23:13.011 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:12 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2562607106' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:23:13.011 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:12 trial105 ceph-mon[39442]: osdmap e44: 4 total, 4 up, 4 in 2026-02-24T08:23:13.012 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:12 trial105 ceph-mon[39442]: pgmap v103: 17 pgs: 17 active+clean; 1.6 GiB data, 7.9 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.17k op/s 2026-02-24T08:23:13.040 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:13.061 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:13.009+0000 7f923fef4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:13.061 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:13.009+0000 7f923fef4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:13.186 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:13.654 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:13.582+0000 7fe2a71b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:13.655 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:13.582+0000 7fe2a71b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:13.655 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:13.655 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:13.655 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:13.655 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:13.656 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:13.656 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:13.656 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:13.656 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:13.898 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:23:13.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 42 128 220664 220536 41.0187 23.0625 0.0581785 0.0243571 2026-02-24T08:23:14.045 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:23:14.045 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:14.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/14878496' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:23:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/773862099' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:13 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:23:14.236 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:14.364 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:14.361+0000 7f8a792ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:14.364 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:14.362+0000 7f8a792ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:14.518 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:14.518 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:14.820 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2026-02-24T08:23:13.897406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1702887968,"num_objects":25980,"num_object_clones":0,"num_object_copies":77940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25980,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":207935,"num_write_kb":1664550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160899,"ondisk_log_size":160899,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8266792,"kb_used_data":4946264,"kb_used_omap":85,"kb_used_meta":3320362,"kb_avail":2927746008,"statfs":{"total":3006477107200,"available":2998011912192,"internally_reserved":0,"allocated":5064974336,"data_stored":5063911525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87312,"internal_metadata":3400051440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,7,6,11,10,14,27],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":155656192,"num_objects":2375,"num_object_clones":0,"num_object_copies":7125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2375,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19001,"num_write_kb":152008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.189345"},"pg_stats":[{"pgid":"3.f","version":"41'12864","reported_seq":12880,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.885323+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:23:09.885323+0000","last_peered":"2026-02-24T08:23:09.885323+0000","last_clean":"2026-02-24T08:23:09.885323+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:09.885323+0000","last_undegraded":"2026-02-24T08:23:09.885323+0000","last_fullsized":"2026-02-24T08:23:09.885323+0000","mapping_epoch":39,"log_start":"41'2800","ondisk_log_start":"41'2800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105381888,"num_objects":1608,"num_object_clones":0,"num_object_copies":4824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12864,"num_write_kb":102912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"42'12965","reported_seq":12972,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.933646+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:23:09.933646+0000","last_peered":"2026-02-24T08:23:09.933646+0000","last_clean":"2026-02-24T08:23:09.933646+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:09.933646+0000","last_undegraded":"2026-02-24T08:23:09.933646+0000","last_fullsized":"2026-02-24T08:23:09.933646+0000","mapping_epoch":39,"log_start":"41'2900","ondisk_log_start":"41'2900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106209280,"num_objects":1621,"num_object_clones":0,"num_object_copies":4863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12965,"num_write_kb":103720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"42'13138","reported_seq":13154,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.040679+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:23:10.040679+0000","last_peered":"2026-02-24T08:23:10.040679+0000","last_clean":"2026-02-24T08:23:10.040679+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:10.040679+0000","last_undegraded":"2026-02-24T08:23:10.040679+0000","last_fullsized":"2026-02-24T08:23:10.040679+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107626496,"num_objects":1643,"num_object_clones":0,"num_object_copies":4929,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1643,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13138,"num_write_kb":105104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"42'12425","reported_seq":12434,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.069723+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:23:10.069723+0000","last_peered":"2026-02-24T08:23:10.069723+0000","last_clean":"2026-02-24T08:23:10.069723+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:10.069723+0000","last_undegraded":"2026-02-24T08:23:10.069723+0000","last_fullsized":"2026-02-24T08:23:10.069723+0000","mapping_epoch":39,"log_start":"41'2400","ondisk_log_start":"41'2400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101785600,"num_objects":1554,"num_object_clones":0,"num_object_copies":4662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12425,"num_write_kb":99400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"42'12880","reported_seq":12892,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.185820+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:23:10.185820+0000","last_peered":"2026-02-24T08:23:10.185820+0000","last_clean":"2026-02-24T08:23:10.185820+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:10.185820+0000","last_undegraded":"2026-02-24T08:23:10.185820+0000","last_fullsized":"2026-02-24T08:23:10.185820+0000","mapping_epoch":39,"log_start":"41'2800","ondisk_log_start":"41'2800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105512960,"num_objects":1610,"num_object_clones":0,"num_object_copies":4830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12880,"num_write_kb":103040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"42'12840","reported_seq":12856,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.048157+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:23:10.048157+0000","last_peered":"2026-02-24T08:23:10.048157+0000","last_clean":"2026-02-24T08:23:10.048157+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:10.048157+0000","last_undegraded":"2026-02-24T08:23:10.048157+0000","last_fullsized":"2026-02-24T08:23:10.048157+0000","mapping_epoch":39,"log_start":"41'2800","ondisk_log_start":"41'2800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105185280,"num_objects":1605,"num_object_clones":0,"num_object_copies":4815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12840,"num_write_kb":102720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"42'13176","reported_seq":13190,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.064846+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:23:10.064846+0000","last_peered":"2026-02-24T08:23:10.064846+0000","last_clean":"2026-02-24T08:23:10.064846+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:10.064846+0000","last_undegraded":"2026-02-24T08:23:10.064846+0000","last_fullsized":"2026-02-24T08:23:10.064846+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107937792,"num_objects":1647,"num_object_clones":0,"num_object_copies":4941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":105408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"42'13072","reported_seq":13087,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.181644+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:23:10.181644+0000","last_peered":"2026-02-24T08:23:10.181644+0000","last_clean":"2026-02-24T08:23:10.181644+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:10.181644+0000","last_undegraded":"2026-02-24T08:23:10.181644+0000","last_fullsized":"2026-02-24T08:23:10.181644+0000","mapping_epoch":39,"log_start":"41'3000","ondisk_log_start":"41'3000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107085824,"num_objects":1634,"num_object_clones":0,"num_object_copies":4902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13072,"num_write_kb":104576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"42'13224","reported_seq":13240,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.172502+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:23:10.172502+0000","last_peered":"2026-02-24T08:23:10.172502+0000","last_clean":"2026-02-24T08:23:10.172502+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:10.172502+0000","last_undegraded":"2026-02-24T08:23:10.172502+0000","last_fullsized":"2026-02-24T08:23:10.172502+0000","mapping_epoch":39,"log_start":"41'3200","ondisk_log_start":"41'3200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108331008,"num_objects":1653,"num_object_clones":0,"num_object_copies":4959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13224,"num_write_kb":105792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"41'13424","reported_seq":13435,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.875183+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:23:09.875183+0000","last_peered":"2026-02-24T08:23:09.875183+0000","last_clean":"2026-02-24T08:23:09.875183+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:09.875183+0000","last_undegraded":"2026-02-24T08:23:09.875183+0000","last_fullsized":"2026-02-24T08:23:09.875183+0000","mapping_epoch":39,"log_start":"41'3400","ondisk_log_start":"41'3400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109969408,"num_objects":1678,"num_object_clones":0,"num_object_copies":5034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13424,"num_write_kb":107392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'13000","reported_seq":13016,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.885321+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:09.885321+0000","last_peered":"2026-02-24T08:23:09.885321+0000","last_clean":"2026-02-24T08:23:09.885321+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:09.885321+0000","last_undegraded":"2026-02-24T08:23:09.885321+0000","last_fullsized":"2026-02-24T08:23:09.885321+0000","mapping_epoch":39,"log_start":"41'2900","ondisk_log_start":"41'2900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106496000,"num_objects":1625,"num_object_clones":0,"num_object_copies":4875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13000,"num_write_kb":104000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"42'13102","reported_seq":13117,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.186771+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:10.186771+0000","last_peered":"2026-02-24T08:23:10.186771+0000","last_clean":"2026-02-24T08:23:10.186771+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:10.186771+0000","last_undegraded":"2026-02-24T08:23:10.186771+0000","last_fullsized":"2026-02-24T08:23:10.186771+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107331584,"num_objects":1638,"num_object_clones":0,"num_object_copies":4914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13102,"num_write_kb":104816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"42'12432","reported_seq":12447,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.929432+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:23:09.929432+0000","last_peered":"2026-02-24T08:23:09.929432+0000","last_clean":"2026-02-24T08:23:09.929432+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:09.929432+0000","last_undegraded":"2026-02-24T08:23:09.929432+0000","last_fullsized":"2026-02-24T08:23:09.929432+0000","mapping_epoch":39,"log_start":"41'2400","ondisk_log_start":"41'2400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101842944,"num_objects":1554,"num_object_clones":0,"num_object_copies":4662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12432,"num_write_kb":99456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"41'12736","reported_seq":12750,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.825244+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:23:09.825244+0000","last_peered":"2026-02-24T08:23:09.825244+0000","last_clean":"2026-02-24T08:23:09.825244+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:09.825244+0000","last_undegraded":"2026-02-24T08:23:09.825244+0000","last_fullsized":"2026-02-24T08:23:09.825244+0000","mapping_epoch":39,"log_start":"41'2700","ondisk_log_start":"41'2700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104333312,"num_objects":1592,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12736,"num_write_kb":101888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"42'13178","reported_seq":13186,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.181787+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:23:10.181787+0000","last_peered":"2026-02-24T08:23:10.181787+0000","last_clean":"2026-02-24T08:23:10.181787+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:10.181787+0000","last_undegraded":"2026-02-24T08:23:10.181787+0000","last_fullsized":"2026-02-24T08:23:10.181787+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107954176,"num_objects":1648,"num_object_clones":0,"num_object_copies":4944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13178,"num_write_kb":105424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"42'13344","reported_seq":13360,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.146978+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:23:10.146978+0000","last_peered":"2026-02-24T08:23:10.146978+0000","last_clean":"2026-02-24T08:23:10.146978+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:10.146978+0000","last_undegraded":"2026-02-24T08:23:10.146978+0000","last_fullsized":"2026-02-24T08:23:10.146978+0000","mapping_epoch":39,"log_start":"41'3300","ondisk_log_start":"41'3300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109314048,"num_objects":1668,"num_object_clones":0,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13344,"num_write_kb":106752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":94,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.885337+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:09.885337+0000","last_peered":"2026-02-24T08:23:09.885337+0000","last_clean":"2026-02-24T08:23:09.885337+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:09.885337+0000","last_undegraded":"2026-02-24T08:23:09.885337+0000","last_fullsized":"2026-02-24T08:23:09.885337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1702297600,"num_objects":25978,"num_object_clones":0,"num_object_copies":77934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25978,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207800,"num_write_kb":1662400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5102837760,"data_stored":5102837760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160800,"ondisk_log_size":160800,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247844,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1947480,"kb_used_data":1036036,"kb_used_omap":16,"kb_used_meta":911407,"kb_avail":732055720,"statfs":{"total":751619276800,"available":749625057280,"internally_reserved":0,"allocated":1060900864,"data_stored":1060628364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17337,"internal_metadata":933280839},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444070,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2267764,"kb_used_data":1446688,"kb_used_omap":20,"kb_used_meta":821035,"kb_avail":731735436,"statfs":{"total":751619276800,"available":749297086464,"internally_reserved":0,"allocated":1481408512,"data_stored":1481143891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":840740189},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1932280,"kb_used_data":1129252,"kb_used_omap":22,"kb_used_meta":802985,"kb_avail":732070920,"statfs":{"total":751619276800,"available":749640622080,"internally_reserved":0,"allocated":1156354048,"data_stored":1156092979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23108,"internal_metadata":822257084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,7,6,11,10,14,27],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2119268,"kb_used_data":1334288,"kb_used_omap":25,"kb_used_meta":784934,"kb_avail":731883932,"statfs":{"total":751619276800,"available":749449146368,"internally_reserved":0,"allocated":1366310912,"data_stored":1366046291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":803773328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1377615872,"data_stored":1377615872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1174847488,"data_stored":1174847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1489387520,"data_stored":1489387520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1060986880,"data_stored":1060986880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:14.823 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:14.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 43 128 223999 223871 40.6706 26.0547 0.0271354 0.0245707 2026-02-24T08:23:14.975 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:15.021 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:14 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/14878496' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:23:15.021 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:14 trial105 ceph-mon[39442]: osdmap e45: 4 total, 4 up, 4 in 2026-02-24T08:23:15.021 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:14 trial105 ceph-mon[39442]: from='client.14603 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:15.021 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:14 trial105 ceph-mon[39442]: pgmap v105: 17 pgs: 17 active+clean; 1.6 GiB data, 7.9 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.42k op/s 2026-02-24T08:23:15.098 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:15.096+0000 7f5842c36640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:15.099 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:15.096+0000 7f5842c36640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:15.249 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:15.249 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:15.299 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2026-02-24T08:23:14.708915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1702887968,"num_objects":25980,"num_object_clones":0,"num_object_copies":77940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25980,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":207935,"num_write_kb":1664550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160899,"ondisk_log_size":160899,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8266792,"kb_used_data":4946264,"kb_used_omap":85,"kb_used_meta":3320362,"kb_avail":2927746008,"statfs":{"total":3006477107200,"available":2998011912192,"internally_reserved":0,"allocated":5064974336,"data_stored":5063911525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87312,"internal_metadata":3400051440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,7,6,11,10,14,27],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":135307264,"num_objects":2066,"num_object_clones":0,"num_object_copies":6198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16517,"num_write_kb":132136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.824209"},"pg_stats":[{"pgid":"3.f","version":"41'12864","reported_seq":12880,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.885323+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:23:09.885323+0000","last_peered":"2026-02-24T08:23:09.885323+0000","last_clean":"2026-02-24T08:23:09.885323+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:09.885323+0000","last_undegraded":"2026-02-24T08:23:09.885323+0000","last_fullsized":"2026-02-24T08:23:09.885323+0000","mapping_epoch":39,"log_start":"41'2800","ondisk_log_start":"41'2800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105381888,"num_objects":1608,"num_object_clones":0,"num_object_copies":4824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12864,"num_write_kb":102912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"42'12965","reported_seq":12972,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.933646+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:23:09.933646+0000","last_peered":"2026-02-24T08:23:09.933646+0000","last_clean":"2026-02-24T08:23:09.933646+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:09.933646+0000","last_undegraded":"2026-02-24T08:23:09.933646+0000","last_fullsized":"2026-02-24T08:23:09.933646+0000","mapping_epoch":39,"log_start":"41'2900","ondisk_log_start":"41'2900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106209280,"num_objects":1621,"num_object_clones":0,"num_object_copies":4863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12965,"num_write_kb":103720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"42'13138","reported_seq":13154,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.040679+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:23:10.040679+0000","last_peered":"2026-02-24T08:23:10.040679+0000","last_clean":"2026-02-24T08:23:10.040679+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:10.040679+0000","last_undegraded":"2026-02-24T08:23:10.040679+0000","last_fullsized":"2026-02-24T08:23:10.040679+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107626496,"num_objects":1643,"num_object_clones":0,"num_object_copies":4929,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1643,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13138,"num_write_kb":105104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"42'12425","reported_seq":12434,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.069723+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:23:10.069723+0000","last_peered":"2026-02-24T08:23:10.069723+0000","last_clean":"2026-02-24T08:23:10.069723+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:10.069723+0000","last_undegraded":"2026-02-24T08:23:10.069723+0000","last_fullsized":"2026-02-24T08:23:10.069723+0000","mapping_epoch":39,"log_start":"41'2400","ondisk_log_start":"41'2400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101785600,"num_objects":1554,"num_object_clones":0,"num_object_copies":4662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12425,"num_write_kb":99400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"42'12880","reported_seq":12892,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.185820+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:23:10.185820+0000","last_peered":"2026-02-24T08:23:10.185820+0000","last_clean":"2026-02-24T08:23:10.185820+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:10.185820+0000","last_undegraded":"2026-02-24T08:23:10.185820+0000","last_fullsized":"2026-02-24T08:23:10.185820+0000","mapping_epoch":39,"log_start":"41'2800","ondisk_log_start":"41'2800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105512960,"num_objects":1610,"num_object_clones":0,"num_object_copies":4830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12880,"num_write_kb":103040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"42'12840","reported_seq":12856,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.048157+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:23:10.048157+0000","last_peered":"2026-02-24T08:23:10.048157+0000","last_clean":"2026-02-24T08:23:10.048157+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:10.048157+0000","last_undegraded":"2026-02-24T08:23:10.048157+0000","last_fullsized":"2026-02-24T08:23:10.048157+0000","mapping_epoch":39,"log_start":"41'2800","ondisk_log_start":"41'2800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105185280,"num_objects":1605,"num_object_clones":0,"num_object_copies":4815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12840,"num_write_kb":102720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"42'13176","reported_seq":13190,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.064846+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:23:10.064846+0000","last_peered":"2026-02-24T08:23:10.064846+0000","last_clean":"2026-02-24T08:23:10.064846+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:10.064846+0000","last_undegraded":"2026-02-24T08:23:10.064846+0000","last_fullsized":"2026-02-24T08:23:10.064846+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107937792,"num_objects":1647,"num_object_clones":0,"num_object_copies":4941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":105408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"42'13072","reported_seq":13087,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.181644+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:23:10.181644+0000","last_peered":"2026-02-24T08:23:10.181644+0000","last_clean":"2026-02-24T08:23:10.181644+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:10.181644+0000","last_undegraded":"2026-02-24T08:23:10.181644+0000","last_fullsized":"2026-02-24T08:23:10.181644+0000","mapping_epoch":39,"log_start":"41'3000","ondisk_log_start":"41'3000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107085824,"num_objects":1634,"num_object_clones":0,"num_object_copies":4902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13072,"num_write_kb":104576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"42'13224","reported_seq":13240,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.172502+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:23:10.172502+0000","last_peered":"2026-02-24T08:23:10.172502+0000","last_clean":"2026-02-24T08:23:10.172502+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:10.172502+0000","last_undegraded":"2026-02-24T08:23:10.172502+0000","last_fullsized":"2026-02-24T08:23:10.172502+0000","mapping_epoch":39,"log_start":"41'3200","ondisk_log_start":"41'3200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108331008,"num_objects":1653,"num_object_clones":0,"num_object_copies":4959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13224,"num_write_kb":105792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"41'13424","reported_seq":13435,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.875183+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:23:09.875183+0000","last_peered":"2026-02-24T08:23:09.875183+0000","last_clean":"2026-02-24T08:23:09.875183+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:09.875183+0000","last_undegraded":"2026-02-24T08:23:09.875183+0000","last_fullsized":"2026-02-24T08:23:09.875183+0000","mapping_epoch":39,"log_start":"41'3400","ondisk_log_start":"41'3400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109969408,"num_objects":1678,"num_object_clones":0,"num_object_copies":5034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13424,"num_write_kb":107392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'13000","reported_seq":13016,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.885321+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:09.885321+0000","last_peered":"2026-02-24T08:23:09.885321+0000","last_clean":"2026-02-24T08:23:09.885321+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:09.885321+0000","last_undegraded":"2026-02-24T08:23:09.885321+0000","last_fullsized":"2026-02-24T08:23:09.885321+0000","mapping_epoch":39,"log_start":"41'2900","ondisk_log_start":"41'2900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106496000,"num_objects":1625,"num_object_clones":0,"num_object_copies":4875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13000,"num_write_kb":104000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"42'13102","reported_seq":13117,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.186771+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:10.186771+0000","last_peered":"2026-02-24T08:23:10.186771+0000","last_clean":"2026-02-24T08:23:10.186771+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:10.186771+0000","last_undegraded":"2026-02-24T08:23:10.186771+0000","last_fullsized":"2026-02-24T08:23:10.186771+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107331584,"num_objects":1638,"num_object_clones":0,"num_object_copies":4914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13102,"num_write_kb":104816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"42'12432","reported_seq":12447,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.929432+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:23:09.929432+0000","last_peered":"2026-02-24T08:23:09.929432+0000","last_clean":"2026-02-24T08:23:09.929432+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:09.929432+0000","last_undegraded":"2026-02-24T08:23:09.929432+0000","last_fullsized":"2026-02-24T08:23:09.929432+0000","mapping_epoch":39,"log_start":"41'2400","ondisk_log_start":"41'2400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101842944,"num_objects":1554,"num_object_clones":0,"num_object_copies":4662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12432,"num_write_kb":99456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"41'12736","reported_seq":12750,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.825244+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:23:09.825244+0000","last_peered":"2026-02-24T08:23:09.825244+0000","last_clean":"2026-02-24T08:23:09.825244+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:09.825244+0000","last_undegraded":"2026-02-24T08:23:09.825244+0000","last_fullsized":"2026-02-24T08:23:09.825244+0000","mapping_epoch":39,"log_start":"41'2700","ondisk_log_start":"41'2700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104333312,"num_objects":1592,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12736,"num_write_kb":101888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"42'13178","reported_seq":13186,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.181787+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:23:10.181787+0000","last_peered":"2026-02-24T08:23:10.181787+0000","last_clean":"2026-02-24T08:23:10.181787+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:10.181787+0000","last_undegraded":"2026-02-24T08:23:10.181787+0000","last_fullsized":"2026-02-24T08:23:10.181787+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107954176,"num_objects":1648,"num_object_clones":0,"num_object_copies":4944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13178,"num_write_kb":105424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"42'13344","reported_seq":13360,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.146978+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:23:10.146978+0000","last_peered":"2026-02-24T08:23:10.146978+0000","last_clean":"2026-02-24T08:23:10.146978+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:10.146978+0000","last_undegraded":"2026-02-24T08:23:10.146978+0000","last_fullsized":"2026-02-24T08:23:10.146978+0000","mapping_epoch":39,"log_start":"41'3300","ondisk_log_start":"41'3300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109314048,"num_objects":1668,"num_object_clones":0,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13344,"num_write_kb":106752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":94,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.885337+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:09.885337+0000","last_peered":"2026-02-24T08:23:09.885337+0000","last_clean":"2026-02-24T08:23:09.885337+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:09.885337+0000","last_undegraded":"2026-02-24T08:23:09.885337+0000","last_fullsized":"2026-02-24T08:23:09.885337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1702297600,"num_objects":25978,"num_object_clones":0,"num_object_copies":77934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25978,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207800,"num_write_kb":1662400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5102837760,"data_stored":5102837760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160800,"ondisk_log_size":160800,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247844,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1947480,"kb_used_data":1036036,"kb_used_omap":16,"kb_used_meta":911407,"kb_avail":732055720,"statfs":{"total":751619276800,"available":749625057280,"internally_reserved":0,"allocated":1060900864,"data_stored":1060628364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17337,"internal_metadata":933280839},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444070,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2267764,"kb_used_data":1446688,"kb_used_omap":20,"kb_used_meta":821035,"kb_avail":731735436,"statfs":{"total":751619276800,"available":749297086464,"internally_reserved":0,"allocated":1481408512,"data_stored":1481143891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":840740189},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1932280,"kb_used_data":1129252,"kb_used_omap":22,"kb_used_meta":802985,"kb_avail":732070920,"statfs":{"total":751619276800,"available":749640622080,"internally_reserved":0,"allocated":1156354048,"data_stored":1156092979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23108,"internal_metadata":822257084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,7,6,11,10,14,27],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2119268,"kb_used_data":1334288,"kb_used_omap":25,"kb_used_meta":784934,"kb_avail":731883932,"statfs":{"total":751619276800,"available":749449146368,"internally_reserved":0,"allocated":1366310912,"data_stored":1366046291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":803773328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1377615872,"data_stored":1377615872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1174847488,"data_stored":1174847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1489387520,"data_stored":1489387520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1060986880,"data_stored":1060986880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:15.303 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:23:15.303 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:23:15.303 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T08:23:15.304 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:15.458 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:15.579 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:15.577+0000 7f64d546e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:15.579 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:15.577+0000 7f64d546e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:15.735 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:15.736 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:15.783 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2026-02-24T08:23:14.708915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1702887968,"num_objects":25980,"num_object_clones":0,"num_object_copies":77940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25980,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":207935,"num_write_kb":1664550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160899,"ondisk_log_size":160899,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8266792,"kb_used_data":4946264,"kb_used_omap":85,"kb_used_meta":3320362,"kb_avail":2927746008,"statfs":{"total":3006477107200,"available":2998011912192,"internally_reserved":0,"allocated":5064974336,"data_stored":5063911525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87312,"internal_metadata":3400051440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,7,6,11,10,14,27],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":135307264,"num_objects":2066,"num_object_clones":0,"num_object_copies":6198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2066,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16517,"num_write_kb":132136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.824209"},"pg_stats":[{"pgid":"3.f","version":"41'12864","reported_seq":12880,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.885323+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:23:09.885323+0000","last_peered":"2026-02-24T08:23:09.885323+0000","last_clean":"2026-02-24T08:23:09.885323+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:09.885323+0000","last_undegraded":"2026-02-24T08:23:09.885323+0000","last_fullsized":"2026-02-24T08:23:09.885323+0000","mapping_epoch":39,"log_start":"41'2800","ondisk_log_start":"41'2800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105381888,"num_objects":1608,"num_object_clones":0,"num_object_copies":4824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12864,"num_write_kb":102912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"42'12965","reported_seq":12972,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.933646+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:23:09.933646+0000","last_peered":"2026-02-24T08:23:09.933646+0000","last_clean":"2026-02-24T08:23:09.933646+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:09.933646+0000","last_undegraded":"2026-02-24T08:23:09.933646+0000","last_fullsized":"2026-02-24T08:23:09.933646+0000","mapping_epoch":39,"log_start":"41'2900","ondisk_log_start":"41'2900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106209280,"num_objects":1621,"num_object_clones":0,"num_object_copies":4863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12965,"num_write_kb":103720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"42'13138","reported_seq":13154,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.040679+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:23:10.040679+0000","last_peered":"2026-02-24T08:23:10.040679+0000","last_clean":"2026-02-24T08:23:10.040679+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:10.040679+0000","last_undegraded":"2026-02-24T08:23:10.040679+0000","last_fullsized":"2026-02-24T08:23:10.040679+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107626496,"num_objects":1643,"num_object_clones":0,"num_object_copies":4929,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1643,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13138,"num_write_kb":105104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"42'12425","reported_seq":12434,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.069723+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:23:10.069723+0000","last_peered":"2026-02-24T08:23:10.069723+0000","last_clean":"2026-02-24T08:23:10.069723+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:10.069723+0000","last_undegraded":"2026-02-24T08:23:10.069723+0000","last_fullsized":"2026-02-24T08:23:10.069723+0000","mapping_epoch":39,"log_start":"41'2400","ondisk_log_start":"41'2400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101785600,"num_objects":1554,"num_object_clones":0,"num_object_copies":4662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12425,"num_write_kb":99400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"42'12880","reported_seq":12892,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.185820+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:23:10.185820+0000","last_peered":"2026-02-24T08:23:10.185820+0000","last_clean":"2026-02-24T08:23:10.185820+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:10.185820+0000","last_undegraded":"2026-02-24T08:23:10.185820+0000","last_fullsized":"2026-02-24T08:23:10.185820+0000","mapping_epoch":39,"log_start":"41'2800","ondisk_log_start":"41'2800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105512960,"num_objects":1610,"num_object_clones":0,"num_object_copies":4830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12880,"num_write_kb":103040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"42'12840","reported_seq":12856,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.048157+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:23:10.048157+0000","last_peered":"2026-02-24T08:23:10.048157+0000","last_clean":"2026-02-24T08:23:10.048157+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:10.048157+0000","last_undegraded":"2026-02-24T08:23:10.048157+0000","last_fullsized":"2026-02-24T08:23:10.048157+0000","mapping_epoch":39,"log_start":"41'2800","ondisk_log_start":"41'2800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105185280,"num_objects":1605,"num_object_clones":0,"num_object_copies":4815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12840,"num_write_kb":102720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"42'13176","reported_seq":13190,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.064846+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:23:10.064846+0000","last_peered":"2026-02-24T08:23:10.064846+0000","last_clean":"2026-02-24T08:23:10.064846+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:10.064846+0000","last_undegraded":"2026-02-24T08:23:10.064846+0000","last_fullsized":"2026-02-24T08:23:10.064846+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107937792,"num_objects":1647,"num_object_clones":0,"num_object_copies":4941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1647,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":105408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"42'13072","reported_seq":13087,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.181644+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:23:10.181644+0000","last_peered":"2026-02-24T08:23:10.181644+0000","last_clean":"2026-02-24T08:23:10.181644+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:10.181644+0000","last_undegraded":"2026-02-24T08:23:10.181644+0000","last_fullsized":"2026-02-24T08:23:10.181644+0000","mapping_epoch":39,"log_start":"41'3000","ondisk_log_start":"41'3000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107085824,"num_objects":1634,"num_object_clones":0,"num_object_copies":4902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13072,"num_write_kb":104576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"42'13224","reported_seq":13240,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.172502+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:23:10.172502+0000","last_peered":"2026-02-24T08:23:10.172502+0000","last_clean":"2026-02-24T08:23:10.172502+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:10.172502+0000","last_undegraded":"2026-02-24T08:23:10.172502+0000","last_fullsized":"2026-02-24T08:23:10.172502+0000","mapping_epoch":39,"log_start":"41'3200","ondisk_log_start":"41'3200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108331008,"num_objects":1653,"num_object_clones":0,"num_object_copies":4959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13224,"num_write_kb":105792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"41'13424","reported_seq":13435,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.875183+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:23:09.875183+0000","last_peered":"2026-02-24T08:23:09.875183+0000","last_clean":"2026-02-24T08:23:09.875183+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:09.875183+0000","last_undegraded":"2026-02-24T08:23:09.875183+0000","last_fullsized":"2026-02-24T08:23:09.875183+0000","mapping_epoch":39,"log_start":"41'3400","ondisk_log_start":"41'3400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109969408,"num_objects":1678,"num_object_clones":0,"num_object_copies":5034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13424,"num_write_kb":107392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'13000","reported_seq":13016,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.885321+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:09.885321+0000","last_peered":"2026-02-24T08:23:09.885321+0000","last_clean":"2026-02-24T08:23:09.885321+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:09.885321+0000","last_undegraded":"2026-02-24T08:23:09.885321+0000","last_fullsized":"2026-02-24T08:23:09.885321+0000","mapping_epoch":39,"log_start":"41'2900","ondisk_log_start":"41'2900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106496000,"num_objects":1625,"num_object_clones":0,"num_object_copies":4875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13000,"num_write_kb":104000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"42'13102","reported_seq":13117,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.186771+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:10.186771+0000","last_peered":"2026-02-24T08:23:10.186771+0000","last_clean":"2026-02-24T08:23:10.186771+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:10.186771+0000","last_undegraded":"2026-02-24T08:23:10.186771+0000","last_fullsized":"2026-02-24T08:23:10.186771+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107331584,"num_objects":1638,"num_object_clones":0,"num_object_copies":4914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13102,"num_write_kb":104816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"42'12432","reported_seq":12447,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.929432+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:23:09.929432+0000","last_peered":"2026-02-24T08:23:09.929432+0000","last_clean":"2026-02-24T08:23:09.929432+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:09.929432+0000","last_undegraded":"2026-02-24T08:23:09.929432+0000","last_fullsized":"2026-02-24T08:23:09.929432+0000","mapping_epoch":39,"log_start":"41'2400","ondisk_log_start":"41'2400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101842944,"num_objects":1554,"num_object_clones":0,"num_object_copies":4662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12432,"num_write_kb":99456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"41'12736","reported_seq":12750,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.825244+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:23:09.825244+0000","last_peered":"2026-02-24T08:23:09.825244+0000","last_clean":"2026-02-24T08:23:09.825244+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:09.825244+0000","last_undegraded":"2026-02-24T08:23:09.825244+0000","last_fullsized":"2026-02-24T08:23:09.825244+0000","mapping_epoch":39,"log_start":"41'2700","ondisk_log_start":"41'2700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104333312,"num_objects":1592,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12736,"num_write_kb":101888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"42'13178","reported_seq":13186,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.181787+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:23:10.181787+0000","last_peered":"2026-02-24T08:23:10.181787+0000","last_clean":"2026-02-24T08:23:10.181787+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:10.181787+0000","last_undegraded":"2026-02-24T08:23:10.181787+0000","last_fullsized":"2026-02-24T08:23:10.181787+0000","mapping_epoch":39,"log_start":"41'3100","ondisk_log_start":"41'3100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107954176,"num_objects":1648,"num_object_clones":0,"num_object_copies":4944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13178,"num_write_kb":105424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"42'13344","reported_seq":13360,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:10.146978+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:23:10.146978+0000","last_peered":"2026-02-24T08:23:10.146978+0000","last_clean":"2026-02-24T08:23:10.146978+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:10.146978+0000","last_undegraded":"2026-02-24T08:23:10.146978+0000","last_fullsized":"2026-02-24T08:23:10.146978+0000","mapping_epoch":39,"log_start":"41'3300","ondisk_log_start":"41'3300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109314048,"num_objects":1668,"num_object_clones":0,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13344,"num_write_kb":106752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":94,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-24T08:23:09.885337+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:09.885337+0000","last_peered":"2026-02-24T08:23:09.885337+0000","last_clean":"2026-02-24T08:23:09.885337+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:09.885337+0000","last_undegraded":"2026-02-24T08:23:09.885337+0000","last_fullsized":"2026-02-24T08:23:09.885337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1702297600,"num_objects":25978,"num_object_clones":0,"num_object_copies":77934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25978,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207800,"num_write_kb":1662400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5102837760,"data_stored":5102837760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160800,"ondisk_log_size":160800,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247844,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1947480,"kb_used_data":1036036,"kb_used_omap":16,"kb_used_meta":911407,"kb_avail":732055720,"statfs":{"total":751619276800,"available":749625057280,"internally_reserved":0,"allocated":1060900864,"data_stored":1060628364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17337,"internal_metadata":933280839},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444070,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2267764,"kb_used_data":1446688,"kb_used_omap":20,"kb_used_meta":821035,"kb_avail":731735436,"statfs":{"total":751619276800,"available":749297086464,"internally_reserved":0,"allocated":1481408512,"data_stored":1481143891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21155,"internal_metadata":840740189},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1932280,"kb_used_data":1129252,"kb_used_omap":22,"kb_used_meta":802985,"kb_avail":732070920,"statfs":{"total":751619276800,"available":749640622080,"internally_reserved":0,"allocated":1156354048,"data_stored":1156092979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23108,"internal_metadata":822257084},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,7,6,11,10,14,27],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2119268,"kb_used_data":1334288,"kb_used_omap":25,"kb_used_meta":784934,"kb_avail":731883932,"statfs":{"total":751619276800,"available":749449146368,"internally_reserved":0,"allocated":1366310912,"data_stored":1366046291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":803773328},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1377615872,"data_stored":1377615872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1174847488,"data_stored":1174847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1489387520,"data_stored":1489387520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1060986880,"data_stored":1060986880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:15.785 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:23:15.785 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 46 2026-02-24T08:23:15.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 44 128 227640 227512 40.3927 28.4453 0.0522827 0.024742 2026-02-24T08:23:15.943 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:16.038 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:16.061 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:15 trial105 ceph-mon[39442]: from='client.14605 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:16.061 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:15 trial105 ceph-mon[39442]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:16.077 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:16.075+0000 7f43e1bb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:16.077 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:16.075+0000 7f43e1bb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:16.180 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:16.229 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:23:16.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:23:16.309 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:16.307+0000 7f6af4344640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:16.309 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:16.307+0000 7f6af4344640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:16.324 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:16.325 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:16.342 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:16.342 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:16.357 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:16.357 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:16.372 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:16.372 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:16.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 45 128 231326 231198 40.135 28.7969 0.0369919 0.0248958 2026-02-24T08:23:17.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/590278576' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T08:23:17.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1979365210' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:17.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:16 trial105 ceph-mon[39442]: pgmap v106: 17 pgs: 17 active+clean; 1.7 GiB data, 8.4 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.78k op/s 2026-02-24T08:23:17.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 46 128 235154 235026 39.9126 29.9062 0.020598 0.0250417 2026-02-24T08:23:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:17 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:23:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:17 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:23:18.420 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:18.570 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:18.691 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:18.689+0000 7fdf706f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:18.691 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:18.689+0000 7fdf706f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:18.707 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:18.708 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:18.722 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:18.722 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:18.737 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:18.737 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:18.754 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:18.754 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:18.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 47 128 238871 238743 39.6812 29.0391 0.0239181 0.0251854 2026-02-24T08:23:19.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3579024169' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:19.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:18 trial105 ceph-mon[39442]: pgmap v107: 17 pgs: 17 active+clean; 1.7 GiB data, 8.4 GiB used, 2.7 TiB / 2.7 TiB avail; 17 MiB/s wr, 2.13k op/s 2026-02-24T08:23:19.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:23:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:23:19.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:23:19.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 48 128 242734 242606 39.4832 30.1797 0.0189566 0.025313 2026-02-24T08:23:19.938 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:23:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:23:19] "GET /metrics HTTP/1.1" 200 4206 "" "Prometheus/3.6.0" 2026-02-24T08:23:20.799 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:20.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 49 128 246433 246305 39.2671 28.8984 0.0900476 0.0254511 2026-02-24T08:23:20.947 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:21.076 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:21.073+0000 7f912e7e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:21.076 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:21.074+0000 7f912e7e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:21.090 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:21.090 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:21.104 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:21.104 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:21.118 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:21.118 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:21.133 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:21.133 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:21.272 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:23:21.273 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:23:21.273 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:23:21.273 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:21.414 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:21.548 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:21.545+0000 7f316b921640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:21.548 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:21.545+0000 7f316b921640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:21.696 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:21.697 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:21.744 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2026-02-24T08:23:20.709720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1993146912,"num_objects":30411,"num_object_clones":0,"num_object_copies":91233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30411,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":243367,"num_write_kb":1948006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160931,"ondisk_log_size":160931,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9349276,"kb_used_data":5794116,"kb_used_omap":95,"kb_used_meta":3554976,"kb_avail":2926663524,"statfs":{"total":3006477107200,"available":2996903448576,"internally_reserved":0,"allocated":5933174784,"data_stored":5931993788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":97731,"internal_metadata":3640295997},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,1,4,8,18,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":290258944,"num_objects":4431,"num_object_clones":0,"num_object_copies":13293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35432,"num_write_kb":283456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.819430"},"pg_stats":[{"pgid":"3.f","version":"45'15200","reported_seq":15219,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:19.953307+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:23:19.953307+0000","last_peered":"2026-02-24T08:23:19.953307+0000","last_clean":"2026-02-24T08:23:19.953307+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:19.953307+0000","last_undegraded":"2026-02-24T08:23:19.953307+0000","last_fullsized":"2026-02-24T08:23:19.953307+0000","mapping_epoch":39,"log_start":"41'5100","ondisk_log_start":"41'5100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124518400,"num_objects":1900,"num_object_clones":0,"num_object_copies":5700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1900,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15200,"num_write_kb":121600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"45'15163","reported_seq":15174,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:19.944824+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:23:19.944824+0000","last_peered":"2026-02-24T08:23:19.944824+0000","last_clean":"2026-02-24T08:23:19.944824+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:19.944824+0000","last_undegraded":"2026-02-24T08:23:19.944824+0000","last_fullsized":"2026-02-24T08:23:19.944824+0000","mapping_epoch":39,"log_start":"41'5100","ondisk_log_start":"41'5100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124215296,"num_objects":1896,"num_object_clones":0,"num_object_copies":5688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15163,"num_write_kb":121304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"45'15367","reported_seq":15377,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.077398+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:23:20.077398+0000","last_peered":"2026-02-24T08:23:20.077398+0000","last_clean":"2026-02-24T08:23:20.077398+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:20.077398+0000","last_undegraded":"2026-02-24T08:23:20.077398+0000","last_fullsized":"2026-02-24T08:23:20.077398+0000","mapping_epoch":39,"log_start":"41'5300","ondisk_log_start":"41'5300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125886464,"num_objects":1921,"num_object_clones":0,"num_object_copies":5763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1921,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15367,"num_write_kb":122936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"45'14602","reported_seq":14620,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.083414+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:23:20.083414+0000","last_peered":"2026-02-24T08:23:20.083414+0000","last_clean":"2026-02-24T08:23:20.083414+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:20.083414+0000","last_undegraded":"2026-02-24T08:23:20.083414+0000","last_fullsized":"2026-02-24T08:23:20.083414+0000","mapping_epoch":39,"log_start":"41'4600","ondisk_log_start":"41'4600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119619584,"num_objects":1826,"num_object_clones":0,"num_object_copies":5478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14602,"num_write_kb":116816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"45'15171","reported_seq":15187,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.224275+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:23:20.224275+0000","last_peered":"2026-02-24T08:23:20.224275+0000","last_clean":"2026-02-24T08:23:20.224275+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:20.224275+0000","last_undegraded":"2026-02-24T08:23:20.224275+0000","last_fullsized":"2026-02-24T08:23:20.224275+0000","mapping_epoch":39,"log_start":"41'5100","ondisk_log_start":"41'5100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124280832,"num_objects":1897,"num_object_clones":0,"num_object_copies":5691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15171,"num_write_kb":121368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"45'15133","reported_seq":15153,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.081719+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:23:20.081719+0000","last_peered":"2026-02-24T08:23:20.081719+0000","last_clean":"2026-02-24T08:23:20.081719+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:20.081719+0000","last_undegraded":"2026-02-24T08:23:20.081719+0000","last_fullsized":"2026-02-24T08:23:20.081719+0000","mapping_epoch":39,"log_start":"41'5100","ondisk_log_start":"41'5100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123969536,"num_objects":1892,"num_object_clones":0,"num_object_copies":5676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15133,"num_write_kb":121064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"45'15528","reported_seq":15550,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.072622+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:23:20.072622+0000","last_peered":"2026-02-24T08:23:20.072622+0000","last_clean":"2026-02-24T08:23:20.072622+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:20.072622+0000","last_undegraded":"2026-02-24T08:23:20.072622+0000","last_fullsized":"2026-02-24T08:23:20.072622+0000","mapping_epoch":39,"log_start":"41'5500","ondisk_log_start":"41'5500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127205376,"num_objects":1941,"num_object_clones":0,"num_object_copies":5823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1941,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15528,"num_write_kb":124224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"45'15142","reported_seq":15160,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.218283+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:23:20.218283+0000","last_peered":"2026-02-24T08:23:20.218283+0000","last_clean":"2026-02-24T08:23:20.218283+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:20.218283+0000","last_undegraded":"2026-02-24T08:23:20.218283+0000","last_fullsized":"2026-02-24T08:23:20.218283+0000","mapping_epoch":39,"log_start":"41'5100","ondisk_log_start":"41'5100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124043264,"num_objects":1893,"num_object_clones":0,"num_object_copies":5679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1893,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15142,"num_write_kb":121136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"45'15541","reported_seq":15560,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.225716+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:23:20.225716+0000","last_peered":"2026-02-24T08:23:20.225716+0000","last_clean":"2026-02-24T08:23:20.225716+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:20.225716+0000","last_undegraded":"2026-02-24T08:23:20.225716+0000","last_fullsized":"2026-02-24T08:23:20.225716+0000","mapping_epoch":39,"log_start":"41'5500","ondisk_log_start":"41'5500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127311872,"num_objects":1943,"num_object_clones":0,"num_object_copies":5829,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1943,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15541,"num_write_kb":124328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"45'15560","reported_seq":15575,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:19.865429+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:23:19.865429+0000","last_peered":"2026-02-24T08:23:19.865429+0000","last_clean":"2026-02-24T08:23:19.865429+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:19.865429+0000","last_undegraded":"2026-02-24T08:23:19.865429+0000","last_fullsized":"2026-02-24T08:23:19.865429+0000","mapping_epoch":39,"log_start":"41'5500","ondisk_log_start":"41'5500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127467520,"num_objects":1945,"num_object_clones":0,"num_object_copies":5835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1945,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15560,"num_write_kb":124480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"45'14935","reported_seq":14957,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:19.948770+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:19.948770+0000","last_peered":"2026-02-24T08:23:19.948770+0000","last_clean":"2026-02-24T08:23:19.948770+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:19.948770+0000","last_undegraded":"2026-02-24T08:23:19.948770+0000","last_fullsized":"2026-02-24T08:23:19.948770+0000","mapping_epoch":39,"log_start":"41'4900","ondisk_log_start":"41'4900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122347520,"num_objects":1867,"num_object_clones":0,"num_object_copies":5601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14935,"num_write_kb":119480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"45'15400","reported_seq":15422,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.217075+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:20.217075+0000","last_peered":"2026-02-24T08:23:20.217075+0000","last_clean":"2026-02-24T08:23:20.217075+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:20.217075+0000","last_undegraded":"2026-02-24T08:23:20.217075+0000","last_fullsized":"2026-02-24T08:23:20.217075+0000","mapping_epoch":39,"log_start":"41'5300","ondisk_log_start":"41'5300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126156800,"num_objects":1925,"num_object_clones":0,"num_object_copies":5775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1925,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15400,"num_write_kb":123200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"45'14630","reported_seq":14649,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:19.950401+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:23:19.950401+0000","last_peered":"2026-02-24T08:23:19.950401+0000","last_clean":"2026-02-24T08:23:19.950401+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:19.950401+0000","last_undegraded":"2026-02-24T08:23:19.950401+0000","last_fullsized":"2026-02-24T08:23:19.950401+0000","mapping_epoch":39,"log_start":"41'4600","ondisk_log_start":"41'4600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119848960,"num_objects":1829,"num_object_clones":0,"num_object_copies":5487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14630,"num_write_kb":117040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"45'14938","reported_seq":14960,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:19.890022+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:23:19.890022+0000","last_peered":"2026-02-24T08:23:19.890022+0000","last_clean":"2026-02-24T08:23:19.890022+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:19.890022+0000","last_undegraded":"2026-02-24T08:23:19.890022+0000","last_fullsized":"2026-02-24T08:23:19.890022+0000","mapping_epoch":39,"log_start":"41'4900","ondisk_log_start":"41'4900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122372096,"num_objects":1868,"num_object_clones":0,"num_object_copies":5604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14938,"num_write_kb":119504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"45'15296","reported_seq":15318,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.205874+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:23:20.205874+0000","last_peered":"2026-02-24T08:23:20.205874+0000","last_clean":"2026-02-24T08:23:20.205874+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:20.205874+0000","last_undegraded":"2026-02-24T08:23:20.205874+0000","last_fullsized":"2026-02-24T08:23:20.205874+0000","mapping_epoch":39,"log_start":"41'5200","ondisk_log_start":"41'5200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125304832,"num_objects":1912,"num_object_clones":0,"num_object_copies":5736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15296,"num_write_kb":122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"45'15626","reported_seq":15647,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:20.198099+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:23:20.198099+0000","last_peered":"2026-02-24T08:23:20.198099+0000","last_clean":"2026-02-24T08:23:20.198099+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:20.198099+0000","last_undegraded":"2026-02-24T08:23:20.198099+0000","last_fullsized":"2026-02-24T08:23:20.198099+0000","mapping_epoch":39,"log_start":"41'5600","ondisk_log_start":"41'5600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128008192,"num_objects":1954,"num_object_clones":0,"num_object_copies":5862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15626,"num_write_kb":125008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":100,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:13.899280+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:13.899280+0000","last_peered":"2026-02-24T08:23:13.899280+0000","last_clean":"2026-02-24T08:23:13.899280+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:13.899280+0000","last_undegraded":"2026-02-24T08:23:13.899280+0000","last_fullsized":"2026-02-24T08:23:13.899280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1992556544,"num_objects":30409,"num_object_clones":0,"num_object_copies":91227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30409,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243232,"num_write_kb":1945856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5971968000,"data_stored":5971968000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160832,"ondisk_log_size":160832,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247846,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2158004,"kb_used_data":1210464,"kb_used_omap":19,"kb_used_meta":947500,"kb_avail":731845196,"statfs":{"total":751619276800,"available":749409480704,"internally_reserved":0,"allocated":1239515136,"data_stored":1239218999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19944,"internal_metadata":970240536},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444072,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2566396,"kb_used_data":1691176,"kb_used_omap":23,"kb_used_meta":875176,"kb_avail":731436804,"statfs":{"total":751619276800,"available":748991287296,"internally_reserved":0,"allocated":1731764224,"data_stored":1731468087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":896181041},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2202632,"kb_used_data":1327404,"kb_used_omap":25,"kb_used_meta":875174,"kb_avail":731800568,"statfs":{"total":751619276800,"available":749363781632,"internally_reserved":0,"allocated":1359261696,"data_stored":1358969111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":896179088},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,1,4,8,18,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2422244,"kb_used_data":1565072,"kb_used_omap":27,"kb_used_meta":857124,"kb_avail":731580956,"statfs":{"total":751619276800,"available":749138898944,"internally_reserved":0,"allocated":1602633728,"data_stored":1602337591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28316,"internal_metadata":877695332},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1611292672,"data_stored":1611292672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1375010816,"data_stored":1375010816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1741938688,"data_stored":1741938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1243725824,"data_stored":1243725824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:21.746 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:23:21.746 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 71 2026-02-24T08:23:21.906 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:21.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 50 128 249807 249679 39.0089 26.3594 0.00967746 0.0256199 2026-02-24T08:23:21.960 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:21 trial105 ceph-mon[39442]: pgmap v108: 17 pgs: 17 active+clean; 1.9 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 4.02k op/s 2026-02-24T08:23:21.960 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2648944343' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:22.039 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:22.036+0000 7fa58e0d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:22.040 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:22.036+0000 7fa58e0d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:22.192 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:23:22.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:23:22.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 51 127 253403 253276 38.795 28.1016 0.0132909 0.0257642 2026-02-24T08:23:23.176 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:23.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:22 trial105 ceph-mon[39442]: from='client.14617 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:23.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:22 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/300382079' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "71"} : dispatch 2026-02-24T08:23:23.328 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:23.456 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:23.453+0000 7f2917a7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:23.457 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:23.453+0000 7f2917a7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:23.472 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:23.472 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:23.491 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:23.491 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:23.509 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:23.509 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:23.526 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:23.526 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:23.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 52 127 256977 256850 38.5859 27.9219 0.0248433 0.0258994 2026-02-24T08:23:24.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:23 trial105 ceph-mon[39442]: pgmap v109: 17 pgs: 17 active+clean; 1.9 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.54k op/s 2026-02-24T08:23:24.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/873982365' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:24.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 53 128 260774 260646 38.4174 29.6562 0.0392535 0.0260155 2026-02-24T08:23:25.574 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:25.716 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:25.870 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:25 trial105 ceph-mon[39442]: pgmap v110: 17 pgs: 17 active+clean; 1.9 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.28k op/s 2026-02-24T08:23:25.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 54 128 264267 264139 38.2113 27.2891 0.0371308 0.0261396 2026-02-24T08:23:26.169 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:26.165+0000 7f91c6a64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:26.169 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:26.165+0000 7f91c6a64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:26.189 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:26.189 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:26.202 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:26.202 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:26.216 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:26.216 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:26.229 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:26.229 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:26.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 55 128 267910 267782 38.034 28.4609 0.0218579 0.026277 2026-02-24T08:23:27.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/139858722' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:27.238 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:23:27.238 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:23:27.238 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2026-02-24T08:23:27.238 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:27.388 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:27.514 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:27.511+0000 7f0e87707640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:27.514 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:27.511+0000 7f0e87707640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:27.667 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:27.667 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:27.716 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2026-02-24T08:23:26.710573+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2140676640,"num_objects":32659,"num_object_clones":0,"num_object_copies":97977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32659,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":261376,"num_write_kb":2092078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160840,"ondisk_log_size":160840,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9856132,"kb_used_data":6228788,"kb_used_omap":95,"kb_used_meta":3627168,"kb_avail":2926156668,"statfs":{"total":3006477107200,"available":2996384428032,"internally_reserved":0,"allocated":6378278912,"data_stored":6377097916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":97731,"internal_metadata":3714220605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,1,1,8,22,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":437788672,"num_objects":6679,"num_object_clones":0,"num_object_copies":20037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53441,"num_write_kb":427528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001657"},"pg_stats":[{"pgid":"3.f","version":"45'16328","reported_seq":16339,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:24.973112+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:23:24.973112+0000","last_peered":"2026-02-24T08:23:24.973112+0000","last_clean":"2026-02-24T08:23:24.973112+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:24.973112+0000","last_undegraded":"2026-02-24T08:23:24.973112+0000","last_fullsized":"2026-02-24T08:23:24.973112+0000","mapping_epoch":39,"log_start":"41'6300","ondisk_log_start":"41'6300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133758976,"num_objects":2041,"num_object_clones":0,"num_object_copies":6123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16328,"num_write_kb":130624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"45'16156","reported_seq":16177,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:24.971461+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:23:24.971461+0000","last_peered":"2026-02-24T08:23:24.971461+0000","last_clean":"2026-02-24T08:23:24.971461+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:24.971461+0000","last_undegraded":"2026-02-24T08:23:24.971461+0000","last_fullsized":"2026-02-24T08:23:24.971461+0000","mapping_epoch":39,"log_start":"41'6100","ondisk_log_start":"41'6100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132349952,"num_objects":2020,"num_object_clones":0,"num_object_copies":6060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16156,"num_write_kb":129248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"45'16360","reported_seq":16382,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.028431+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:23:25.028431+0000","last_peered":"2026-02-24T08:23:25.028431+0000","last_clean":"2026-02-24T08:23:25.028431+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:25.028431+0000","last_undegraded":"2026-02-24T08:23:25.028431+0000","last_fullsized":"2026-02-24T08:23:25.028431+0000","mapping_epoch":39,"log_start":"41'6300","ondisk_log_start":"41'6300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134021120,"num_objects":2045,"num_object_clones":0,"num_object_copies":6135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2045,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16360,"num_write_kb":130880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"45'15736","reported_seq":15746,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.088732+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:23:25.088732+0000","last_peered":"2026-02-24T08:23:25.088732+0000","last_clean":"2026-02-24T08:23:25.088732+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:25.088732+0000","last_undegraded":"2026-02-24T08:23:25.088732+0000","last_fullsized":"2026-02-24T08:23:25.088732+0000","mapping_epoch":39,"log_start":"41'5700","ondisk_log_start":"41'5700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128909312,"num_objects":1967,"num_object_clones":0,"num_object_copies":5901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15736,"num_write_kb":125888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"45'16208","reported_seq":16230,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.199022+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:23:25.199022+0000","last_peered":"2026-02-24T08:23:25.199022+0000","last_clean":"2026-02-24T08:23:25.199022+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:25.199022+0000","last_undegraded":"2026-02-24T08:23:25.199022+0000","last_fullsized":"2026-02-24T08:23:25.199022+0000","mapping_epoch":39,"log_start":"41'6200","ondisk_log_start":"41'6200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132775936,"num_objects":2026,"num_object_clones":0,"num_object_copies":6078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16208,"num_write_kb":129664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"45'16304","reported_seq":16326,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.032268+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:23:25.032268+0000","last_peered":"2026-02-24T08:23:25.032268+0000","last_clean":"2026-02-24T08:23:25.032268+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:25.032268+0000","last_undegraded":"2026-02-24T08:23:25.032268+0000","last_fullsized":"2026-02-24T08:23:25.032268+0000","mapping_epoch":39,"log_start":"41'6300","ondisk_log_start":"41'6300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133562368,"num_objects":2038,"num_object_clones":0,"num_object_copies":6114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2038,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16304,"num_write_kb":130432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"45'16704","reported_seq":16726,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.054214+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:23:25.054214+0000","last_peered":"2026-02-24T08:23:25.054214+0000","last_clean":"2026-02-24T08:23:25.054214+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:25.054214+0000","last_undegraded":"2026-02-24T08:23:25.054214+0000","last_fullsized":"2026-02-24T08:23:25.054214+0000","mapping_epoch":39,"log_start":"41'6700","ondisk_log_start":"41'6700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136839168,"num_objects":2088,"num_object_clones":0,"num_object_copies":6264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2088,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16704,"num_write_kb":133632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"45'16296","reported_seq":16318,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.219128+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:23:25.219128+0000","last_peered":"2026-02-24T08:23:25.219128+0000","last_clean":"2026-02-24T08:23:25.219128+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:25.219128+0000","last_undegraded":"2026-02-24T08:23:25.219128+0000","last_fullsized":"2026-02-24T08:23:25.219128+0000","mapping_epoch":39,"log_start":"41'6200","ondisk_log_start":"41'6200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133496832,"num_objects":2037,"num_object_clones":0,"num_object_copies":6111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2037,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16296,"num_write_kb":130368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"45'16584","reported_seq":16599,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.225625+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:23:25.225625+0000","last_peered":"2026-02-24T08:23:25.225625+0000","last_clean":"2026-02-24T08:23:25.225625+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:25.225625+0000","last_undegraded":"2026-02-24T08:23:25.225625+0000","last_fullsized":"2026-02-24T08:23:25.225625+0000","mapping_epoch":39,"log_start":"41'6500","ondisk_log_start":"41'6500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135856128,"num_objects":2073,"num_object_clones":0,"num_object_copies":6219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16584,"num_write_kb":132672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"45'16760","reported_seq":16782,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:24.874193+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:23:24.874193+0000","last_peered":"2026-02-24T08:23:24.874193+0000","last_clean":"2026-02-24T08:23:24.874193+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:24.874193+0000","last_undegraded":"2026-02-24T08:23:24.874193+0000","last_fullsized":"2026-02-24T08:23:24.874193+0000","mapping_epoch":39,"log_start":"41'6700","ondisk_log_start":"41'6700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137297920,"num_objects":2095,"num_object_clones":0,"num_object_copies":6285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16760,"num_write_kb":134080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"45'15862","reported_seq":15883,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:24.965571+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:24.965571+0000","last_peered":"2026-02-24T08:23:24.965571+0000","last_clean":"2026-02-24T08:23:24.965571+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:24.965571+0000","last_undegraded":"2026-02-24T08:23:24.965571+0000","last_fullsized":"2026-02-24T08:23:24.965571+0000","mapping_epoch":39,"log_start":"41'5800","ondisk_log_start":"41'5800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129941504,"num_objects":1983,"num_object_clones":0,"num_object_copies":5949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1983,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15862,"num_write_kb":126896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"45'16568","reported_seq":16590,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.207529+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:25.207529+0000","last_peered":"2026-02-24T08:23:25.207529+0000","last_clean":"2026-02-24T08:23:25.207529+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:25.207529+0000","last_undegraded":"2026-02-24T08:23:25.207529+0000","last_fullsized":"2026-02-24T08:23:25.207529+0000","mapping_epoch":39,"log_start":"41'6500","ondisk_log_start":"41'6500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135725056,"num_objects":2071,"num_object_clones":0,"num_object_copies":6213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2071,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16568,"num_write_kb":132544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"45'15819","reported_seq":15840,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:24.968114+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:23:24.968114+0000","last_peered":"2026-02-24T08:23:24.968114+0000","last_clean":"2026-02-24T08:23:24.968114+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:24.968114+0000","last_undegraded":"2026-02-24T08:23:24.968114+0000","last_fullsized":"2026-02-24T08:23:24.968114+0000","mapping_epoch":39,"log_start":"41'5800","ondisk_log_start":"41'5800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129589248,"num_objects":1978,"num_object_clones":0,"num_object_copies":5934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1978,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15819,"num_write_kb":126552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"45'16128","reported_seq":16150,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:24.876798+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:23:24.876798+0000","last_peered":"2026-02-24T08:23:24.876798+0000","last_clean":"2026-02-24T08:23:24.876798+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:24.876798+0000","last_undegraded":"2026-02-24T08:23:24.876798+0000","last_fullsized":"2026-02-24T08:23:24.876798+0000","mapping_epoch":39,"log_start":"41'6100","ondisk_log_start":"41'6100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132120576,"num_objects":2016,"num_object_clones":0,"num_object_copies":6048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2016,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16128,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"45'16660","reported_seq":16680,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.236972+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:23:25.236972+0000","last_peered":"2026-02-24T08:23:25.236972+0000","last_clean":"2026-02-24T08:23:25.236972+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:25.236972+0000","last_undegraded":"2026-02-24T08:23:25.236972+0000","last_fullsized":"2026-02-24T08:23:25.236972+0000","mapping_epoch":39,"log_start":"41'6600","ondisk_log_start":"41'6600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136478720,"num_objects":2083,"num_object_clones":0,"num_object_copies":6249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2083,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16660,"num_write_kb":133280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"45'16768","reported_seq":16790,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:25.062375+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:23:25.062375+0000","last_peered":"2026-02-24T08:23:25.062375+0000","last_clean":"2026-02-24T08:23:25.062375+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:25.062375+0000","last_undegraded":"2026-02-24T08:23:25.062375+0000","last_fullsized":"2026-02-24T08:23:25.062375+0000","mapping_epoch":39,"log_start":"41'6700","ondisk_log_start":"41'6700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137363456,"num_objects":2096,"num_object_clones":0,"num_object_copies":6288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16768,"num_write_kb":134144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":100,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:13.899280+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:13.899280+0000","last_peered":"2026-02-24T08:23:13.899280+0000","last_clean":"2026-02-24T08:23:13.899280+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:13.899280+0000","last_undegraded":"2026-02-24T08:23:13.899280+0000","last_fullsized":"2026-02-24T08:23:13.899280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2140086272,"num_objects":32657,"num_object_clones":0,"num_object_copies":97971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261241,"num_write_kb":2089928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6416039936,"data_stored":6416039936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160741,"ondisk_log_size":160741,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247847,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2264572,"kb_used_data":1298984,"kb_used_omap":19,"kb_used_meta":965548,"kb_avail":731738628,"statfs":{"total":751619276800,"available":749300355072,"internally_reserved":0,"allocated":1330159616,"data_stored":1329863479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19944,"internal_metadata":988721688},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,1,1,8,22,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444073,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2711628,"kb_used_data":1818360,"kb_used_omap":23,"kb_used_meta":893224,"kb_avail":731291572,"statfs":{"total":751619276800,"available":748842569728,"internally_reserved":0,"allocated":1862000640,"data_stored":1861704503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":914662193},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2322448,"kb_used_data":1429180,"kb_used_omap":25,"kb_used_meta":893222,"kb_avail":731680752,"statfs":{"total":751619276800,"available":749241090048,"internally_reserved":0,"allocated":1463480320,"data_stored":1463187735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":914660240},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2557484,"kb_used_data":1682264,"kb_used_omap":27,"kb_used_meta":875172,"kb_avail":731445716,"statfs":{"total":751619276800,"available":749000413184,"internally_reserved":0,"allocated":1722638336,"data_stored":1722342199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28316,"internal_metadata":896176484},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1731903488,"data_stored":1731903488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1478451200,"data_stored":1478451200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1872707584,"data_stored":1872707584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1332977664,"data_stored":1332977664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:27.716 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_1 pgp_num 46 2026-02-24T08:23:27.868 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:27.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 56 128 271478 271350 37.8525 27.875 0.0576718 0.0264069 2026-02-24T08:23:28.015 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:28.012+0000 7f92c7ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:28.015 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:28.012+0000 7f92c7ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:28.181 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:23:28.181 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:27 trial105 ceph-mon[39442]: pgmap v111: 17 pgs: 17 active+clean; 2.0 GiB data, 9.4 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.45k op/s 2026-02-24T08:23:28.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:23:28.280 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:28.428 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:28.556 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:28.553+0000 7fc0c3cb3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:28.556 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:28.553+0000 7fc0c3cb3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:28.575 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:28.575 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:28.592 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:28.592 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:28.607 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:28.607 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:28.622 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:28.622 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:28.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 57 128 275074 274946 37.6813 28.0938 0.0166746 0.0265238 2026-02-24T08:23:29.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:28 trial105 ceph-mon[39442]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:29.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3649998777' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "46"} : dispatch 2026-02-24T08:23:29.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/534067845' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:23:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:23:29.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:23:29.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 58 128 278789 278661 37.532 29.0234 0.0718877 0.0266319 2026-02-24T08:23:29.938 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:23:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:23:29] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-24T08:23:29.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:29 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:23:29.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:29 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:23:29.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:29 trial105 ceph-mon[39442]: pgmap v112: 17 pgs: 17 active+clean; 2.0 GiB data, 9.4 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.06k op/s 2026-02-24T08:23:29.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:23:30.670 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:30.813 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:30.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 59 127 282391 282264 37.3729 28.1484 0.145805 0.0267346 2026-02-24T08:23:30.937 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:30.934+0000 7f157f2f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:30.937 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:30.934+0000 7f157f2f8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:30.954 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:30.954 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:30.969 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:30.969 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:30.983 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:30.983 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:30.998 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:30.998 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:31.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:23:31.934392+0000 min lat: 0.000724324 max lat: 0.201373 avg lat: 0.0268524 2026-02-24T08:23:31.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:23:31.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 60 128 286021 285893 37.2225 28.3516 0.0275948 0.0268524 2026-02-24T08:23:32.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:31 trial105 ceph-mon[39442]: pgmap v113: 17 pgs: 17 active+clean; 2.1 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.57k op/s 2026-02-24T08:23:32.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:31 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3982668129' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:32.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 61 128 289766 289638 37.0919 29.2578 0.0161323 0.026948 2026-02-24T08:23:33.045 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:33.210 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:33.225 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:23:33.225 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:23:33.225 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2026-02-24T08:23:33.225 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:33.338 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:33.335+0000 7fdbb05b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:33.339 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:33.335+0000 7fdbb05b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:33.362 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:33.363 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:33.382 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:33.382 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:33.389 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:33.396 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:33.396 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:33.408 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:33.409 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:33.505 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:33.503+0000 7f5453e98640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:33.505 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:33.503+0000 7f5453e98640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:33.658 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:33.659 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:33.705 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2026-02-24T08:23:32.711447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2288853536,"num_objects":34921,"num_object_clones":0,"num_object_copies":104763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34921,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":279464,"num_write_kb":2236782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160728,"ondisk_log_size":160728,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10347660,"kb_used_data":6666172,"kb_used_omap":96,"kb_used_meta":3681311,"kb_avail":2925665140,"statfs":{"total":3006477107200,"available":2995881103360,"internally_reserved":0,"allocated":6826160128,"data_stored":6824979132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98382,"internal_metadata":3769663410},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,4,18,23,29,32,9],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":295706624,"num_objects":4510,"num_object_clones":0,"num_object_copies":13530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4510,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36097,"num_write_kb":288776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001726"},"pg_stats":[{"pgid":"3.f","version":"45'17526","reported_seq":17540,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:29.994376+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:23:29.994376+0000","last_peered":"2026-02-24T08:23:29.994376+0000","last_clean":"2026-02-24T08:23:29.994376+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:29.994376+0000","last_undegraded":"2026-02-24T08:23:29.994376+0000","last_fullsized":"2026-02-24T08:23:29.994376+0000","mapping_epoch":39,"log_start":"41'7500","ondisk_log_start":"41'7500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143572992,"num_objects":2191,"num_object_clones":0,"num_object_copies":6573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17526,"num_write_kb":140208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"45'17224","reported_seq":17246,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:29.988504+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:23:29.988504+0000","last_peered":"2026-02-24T08:23:29.988504+0000","last_clean":"2026-02-24T08:23:29.988504+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:29.988504+0000","last_undegraded":"2026-02-24T08:23:29.988504+0000","last_fullsized":"2026-02-24T08:23:29.988504+0000","mapping_epoch":39,"log_start":"41'7200","ondisk_log_start":"41'7200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141099008,"num_objects":2153,"num_object_clones":0,"num_object_copies":6459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17224,"num_write_kb":137792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"45'17376","reported_seq":17398,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.104499+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:23:30.104499+0000","last_peered":"2026-02-24T08:23:30.104499+0000","last_clean":"2026-02-24T08:23:30.104499+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:30.104499+0000","last_undegraded":"2026-02-24T08:23:30.104499+0000","last_fullsized":"2026-02-24T08:23:30.104499+0000","mapping_epoch":39,"log_start":"41'7300","ondisk_log_start":"41'7300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142344192,"num_objects":2172,"num_object_clones":0,"num_object_copies":6516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17376,"num_write_kb":139008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"45'16872","reported_seq":16893,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.118546+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:23:30.118546+0000","last_peered":"2026-02-24T08:23:30.118546+0000","last_clean":"2026-02-24T08:23:30.118546+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:30.118546+0000","last_undegraded":"2026-02-24T08:23:30.118546+0000","last_fullsized":"2026-02-24T08:23:30.118546+0000","mapping_epoch":39,"log_start":"41'6800","ondisk_log_start":"41'6800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138215424,"num_objects":2109,"num_object_clones":0,"num_object_copies":6327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16872,"num_write_kb":134976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"45'17414","reported_seq":17436,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.246354+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:23:30.246354+0000","last_peered":"2026-02-24T08:23:30.246354+0000","last_clean":"2026-02-24T08:23:30.246354+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:30.246354+0000","last_undegraded":"2026-02-24T08:23:30.246354+0000","last_fullsized":"2026-02-24T08:23:30.246354+0000","mapping_epoch":39,"log_start":"41'7400","ondisk_log_start":"41'7400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142655488,"num_objects":2177,"num_object_clones":0,"num_object_copies":6531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17414,"num_write_kb":139312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"45'17664","reported_seq":17686,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.107955+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:23:30.107955+0000","last_peered":"2026-02-24T08:23:30.107955+0000","last_clean":"2026-02-24T08:23:30.107955+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:30.107955+0000","last_undegraded":"2026-02-24T08:23:30.107955+0000","last_fullsized":"2026-02-24T08:23:30.107955+0000","mapping_epoch":39,"log_start":"41'7600","ondisk_log_start":"41'7600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144703488,"num_objects":2208,"num_object_clones":0,"num_object_copies":6624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2208,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17664,"num_write_kb":141312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"45'17905","reported_seq":17916,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.116754+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:23:30.116754+0000","last_peered":"2026-02-24T08:23:30.116754+0000","last_clean":"2026-02-24T08:23:30.116754+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:30.116754+0000","last_undegraded":"2026-02-24T08:23:30.116754+0000","last_fullsized":"2026-02-24T08:23:30.116754+0000","mapping_epoch":39,"log_start":"41'7900","ondisk_log_start":"41'7900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146677760,"num_objects":2239,"num_object_clones":0,"num_object_copies":6717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17905,"num_write_kb":143240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"45'17354","reported_seq":17376,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.245936+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:23:30.245936+0000","last_peered":"2026-02-24T08:23:30.245936+0000","last_clean":"2026-02-24T08:23:30.245936+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:30.245936+0000","last_undegraded":"2026-02-24T08:23:30.245936+0000","last_fullsized":"2026-02-24T08:23:30.245936+0000","mapping_epoch":39,"log_start":"41'7300","ondisk_log_start":"41'7300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.243741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142163968,"num_objects":2170,"num_object_clones":0,"num_object_copies":6510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17354,"num_write_kb":138832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"45'17728","reported_seq":17750,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.203060+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:23:30.203060+0000","last_peered":"2026-02-24T08:23:30.203060+0000","last_clean":"2026-02-24T08:23:30.203060+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:30.203060+0000","last_undegraded":"2026-02-24T08:23:30.203060+0000","last_fullsized":"2026-02-24T08:23:30.203060+0000","mapping_epoch":39,"log_start":"41'7700","ondisk_log_start":"41'7700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145227776,"num_objects":2216,"num_object_clones":0,"num_object_copies":6648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17728,"num_write_kb":141824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"45'18048","reported_seq":18070,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:29.894238+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:23:29.894238+0000","last_peered":"2026-02-24T08:23:29.894238+0000","last_clean":"2026-02-24T08:23:29.894238+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:29.894238+0000","last_undegraded":"2026-02-24T08:23:29.894238+0000","last_fullsized":"2026-02-24T08:23:29.894238+0000","mapping_epoch":39,"log_start":"41'8000","ondisk_log_start":"41'8000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147849216,"num_objects":2256,"num_object_clones":0,"num_object_copies":6768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2256,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18048,"num_write_kb":144384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"45'17128","reported_seq":17150,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:29.974080+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:29.974080+0000","last_peered":"2026-02-24T08:23:29.974080+0000","last_clean":"2026-02-24T08:23:29.974080+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:29.974080+0000","last_undegraded":"2026-02-24T08:23:29.974080+0000","last_fullsized":"2026-02-24T08:23:29.974080+0000","mapping_epoch":39,"log_start":"41'7100","ondisk_log_start":"41'7100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140312576,"num_objects":2141,"num_object_clones":0,"num_object_copies":6423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17128,"num_write_kb":137024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"45'17628","reported_seq":17648,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.252826+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:30.252826+0000","last_peered":"2026-02-24T08:23:30.252826+0000","last_clean":"2026-02-24T08:23:30.252826+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:30.252826+0000","last_undegraded":"2026-02-24T08:23:30.252826+0000","last_fullsized":"2026-02-24T08:23:30.252826+0000","mapping_epoch":39,"log_start":"41'7600","ondisk_log_start":"41'7600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144408576,"num_objects":2204,"num_object_clones":0,"num_object_copies":6612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17628,"num_write_kb":141024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"45'16942","reported_seq":16964,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:29.990598+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:23:29.990598+0000","last_peered":"2026-02-24T08:23:29.990598+0000","last_clean":"2026-02-24T08:23:29.990598+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:29.990598+0000","last_undegraded":"2026-02-24T08:23:29.990598+0000","last_fullsized":"2026-02-24T08:23:29.990598+0000","mapping_epoch":39,"log_start":"41'6900","ondisk_log_start":"41'6900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:32.355189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138788864,"num_objects":2118,"num_object_clones":0,"num_object_copies":6354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2118,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16942,"num_write_kb":135536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"45'17160","reported_seq":17181,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:29.920001+0000","last_change":"2026-02-24T08:22:30.846365+0000","last_active":"2026-02-24T08:23:29.920001+0000","last_peered":"2026-02-24T08:23:29.920001+0000","last_clean":"2026-02-24T08:23:29.920001+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:29.920001+0000","last_undegraded":"2026-02-24T08:23:29.920001+0000","last_fullsized":"2026-02-24T08:23:29.920001+0000","mapping_epoch":39,"log_start":"41'7100","ondisk_log_start":"41'7100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:31.828426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140574720,"num_objects":2145,"num_object_clones":0,"num_object_copies":6435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":137280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"45'17552","reported_seq":17574,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.138198+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:23:30.138198+0000","last_peered":"2026-02-24T08:23:30.138198+0000","last_clean":"2026-02-24T08:23:30.138198+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:30.138198+0000","last_undegraded":"2026-02-24T08:23:30.138198+0000","last_fullsized":"2026-02-24T08:23:30.138198+0000","mapping_epoch":39,"log_start":"41'7500","ondisk_log_start":"41'7500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143785984,"num_objects":2194,"num_object_clones":0,"num_object_copies":6582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17552,"num_write_kb":140416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"45'17808","reported_seq":17830,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:30.239096+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:23:30.239096+0000","last_peered":"2026-02-24T08:23:30.239096+0000","last_clean":"2026-02-24T08:23:30.239096+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:30.239096+0000","last_undegraded":"2026-02-24T08:23:30.239096+0000","last_fullsized":"2026-02-24T08:23:30.239096+0000","mapping_epoch":39,"log_start":"41'7800","ondisk_log_start":"41'7800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145883136,"num_objects":2226,"num_object_clones":0,"num_object_copies":6678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17808,"num_write_kb":142464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":100,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:13.899280+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:13.899280+0000","last_peered":"2026-02-24T08:23:13.899280+0000","last_clean":"2026-02-24T08:23:13.899280+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:13.899280+0000","last_undegraded":"2026-02-24T08:23:13.899280+0000","last_fullsized":"2026-02-24T08:23:13.899280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2288263168,"num_objects":34919,"num_object_clones":0,"num_object_copies":104757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34919,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279329,"num_write_kb":2234632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6860087296,"data_stored":6860087296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160629,"ondisk_log_size":160629,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247848,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2358460,"kb_used_data":1392872,"kb_used_omap":19,"kb_used_meta":965548,"kb_avail":731644740,"statfs":{"total":751619276800,"available":749204213760,"internally_reserved":0,"allocated":1426300928,"data_stored":1426004791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19944,"internal_metadata":988721688},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,4,9,3,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444074,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2856252,"kb_used_data":1944936,"kb_used_omap":23,"kb_used_meta":911272,"kb_avail":731146948,"statfs":{"total":751619276800,"available":748694474752,"internally_reserved":0,"allocated":1991614464,"data_stored":1991318327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":933143345},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,9,0,8,4,9],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2438288,"kb_used_data":1526972,"kb_used_omap":25,"kb_used_meta":911270,"kb_avail":731564912,"statfs":{"total":751619276800,"available":749122469888,"internally_reserved":0,"allocated":1563619328,"data_stored":1563326743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":933141392},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,5,14,18,25],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2694660,"kb_used_data":1801392,"kb_used_omap":28,"kb_used_meta":893219,"kb_avail":731308540,"statfs":{"total":751619276800,"available":748859944960,"internally_reserved":0,"allocated":1844625408,"data_stored":1844329271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28967,"internal_metadata":914656985},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1851883520,"data_stored":1851883520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1578909696,"data_stored":1578909696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2001870848,"data_stored":2001870848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1427423232,"data_stored":1427423232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:33.707 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_1 pgp_num 46 2026-02-24T08:23:33.864 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:33.921 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:33 trial105 ceph-mon[39442]: pgmap v114: 17 pgs: 17 active+clean; 2.1 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 3.01k op/s 2026-02-24T08:23:33.921 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2076527636' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:33.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 62 128 293287 293159 36.9373 27.5078 0.0917426 0.02706 2026-02-24T08:23:33.999 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:33.997+0000 7f4f871ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:33.999 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:33.997+0000 7f4f871ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:34.138 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:23:34.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:23:34.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 63 128 296883 296755 36.7968 28.0938 0.0108875 0.0271648 2026-02-24T08:23:35.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:34 trial105 ceph-mon[39442]: from='client.14635 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:35.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:34 trial105 ceph-mon[39442]: 3.1 scrub starts 2026-02-24T08:23:35.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1581869995' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pgp_num", "val": "46"} : dispatch 2026-02-24T08:23:35.455 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:35.604 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:35.735 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:35.732+0000 7f6479a2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:35.738 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:35.736+0000 7f6479a2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:35.761 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:35.761 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:35.777 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:35.778 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:35.794 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:35.795 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:35.810 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:35.810 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:35.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 64 128 300494 300366 36.6627 28.2109 0.0551208 0.0272658 2026-02-24T08:23:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:35 trial105 ceph-mon[39442]: 3.1 scrub ok 2026-02-24T08:23:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:35 trial105 ceph-mon[39442]: pgmap v115: 17 pgs: 17 active+clean; 2.1 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 3.01k op/s 2026-02-24T08:23:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:23:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:23:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:23:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:23:36.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:23:36.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/436800127' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:36.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 65 127 304245 304118 36.5496 29.3125 0.0141635 0.0273484 2026-02-24T08:23:37.862 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:37.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 66 128 307918 307790 36.4304 28.6875 0.0317529 0.0274381 2026-02-24T08:23:38.012 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:38.035 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:37 trial105 ceph-mon[39442]: pgmap v116: 17 pgs: 17 active+clean; 2.3 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.52k op/s 2026-02-24T08:23:38.035 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:37 trial105 ceph-mon[39442]: 3.8 scrub starts 2026-02-24T08:23:38.150 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:38.147+0000 7f594dc17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:38.150 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:38.148+0000 7f594dc17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:38.170 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:38.171 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:38.183 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:38.184 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:38.197 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:38.198 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:38.214 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:38.215 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:38.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 67 128 311580 311452 36.3136 28.6094 0.027568 0.0275275 2026-02-24T08:23:39.179 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:23:39.179 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:23:39.180 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:23:39.180 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:39.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:38 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/492277275' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:39.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:38 trial105 ceph-mon[39442]: 3.8 scrub ok 2026-02-24T08:23:39.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:38 trial105 ceph-mon[39442]: 3.3 scrub starts 2026-02-24T08:23:39.331 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:39.453 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:39.450+0000 7fafd8b6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:39.453 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:39.450+0000 7fafd8b6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:39.602 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:39.603 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:39.647 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2026-02-24T08:23:38.712251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2437734944,"num_objects":37193,"num_object_clones":0,"num_object_copies":111579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37193,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":297638,"num_write_kb":2382174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160702,"ondisk_log_size":160702,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10875500,"kb_used_data":7103772,"kb_used_omap":96,"kb_used_meta":3771551,"kb_avail":2925137300,"statfs":{"total":3006477107200,"available":2995340595200,"internally_reserved":0,"allocated":7274262528,"data_stored":7273081532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98382,"internal_metadata":3862069170},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,11,11,17,25,15],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":297058304,"num_objects":4534,"num_object_clones":0,"num_object_copies":13602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36262,"num_write_kb":290096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001678"},"pg_stats":[{"pgid":"3.f","version":"45'18712","reported_seq":18729,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.017248+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:23:35.017248+0000","last_peered":"2026-02-24T08:23:35.017248+0000","last_clean":"2026-02-24T08:23:35.017248+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:35.017248+0000","last_undegraded":"2026-02-24T08:23:35.017248+0000","last_fullsized":"2026-02-24T08:23:35.017248+0000","mapping_epoch":39,"log_start":"41'8700","ondisk_log_start":"41'8700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153288704,"num_objects":2339,"num_object_clones":0,"num_object_copies":7017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2339,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18712,"num_write_kb":149696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"45'18410","reported_seq":18431,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.014100+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:23:35.014100+0000","last_peered":"2026-02-24T08:23:35.014100+0000","last_clean":"2026-02-24T08:23:35.014100+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:35.014100+0000","last_undegraded":"2026-02-24T08:23:35.014100+0000","last_fullsized":"2026-02-24T08:23:35.014100+0000","mapping_epoch":39,"log_start":"41'8400","ondisk_log_start":"41'8400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150814720,"num_objects":2302,"num_object_clones":0,"num_object_copies":6906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2302,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18410,"num_write_kb":147280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"45'18605","reported_seq":18627,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.123378+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:23:35.123378+0000","last_peered":"2026-02-24T08:23:35.123378+0000","last_clean":"2026-02-24T08:23:35.123378+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:35.123378+0000","last_undegraded":"2026-02-24T08:23:35.123378+0000","last_fullsized":"2026-02-24T08:23:35.123378+0000","mapping_epoch":39,"log_start":"41'8600","ondisk_log_start":"41'8600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152412160,"num_objects":2326,"num_object_clones":0,"num_object_copies":6978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18605,"num_write_kb":148840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"45'18032","reported_seq":18047,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.115236+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:23:35.115236+0000","last_peered":"2026-02-24T08:23:35.115236+0000","last_clean":"2026-02-24T08:23:35.115236+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:35.115236+0000","last_undegraded":"2026-02-24T08:23:35.115236+0000","last_fullsized":"2026-02-24T08:23:35.115236+0000","mapping_epoch":39,"log_start":"41'8000","ondisk_log_start":"41'8000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147718144,"num_objects":2254,"num_object_clones":0,"num_object_copies":6762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2254,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18032,"num_write_kb":144256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"45'18440","reported_seq":18462,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.263465+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:23:35.263465+0000","last_peered":"2026-02-24T08:23:35.263465+0000","last_clean":"2026-02-24T08:23:35.263465+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:35.263465+0000","last_undegraded":"2026-02-24T08:23:35.263465+0000","last_fullsized":"2026-02-24T08:23:35.263465+0000","mapping_epoch":39,"log_start":"41'8400","ondisk_log_start":"41'8400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151060480,"num_objects":2305,"num_object_clones":0,"num_object_copies":6915,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18440,"num_write_kb":147520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"45'18896","reported_seq":18918,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.105492+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:23:35.105492+0000","last_peered":"2026-02-24T08:23:35.105492+0000","last_clean":"2026-02-24T08:23:35.105492+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:35.105492+0000","last_undegraded":"2026-02-24T08:23:35.105492+0000","last_fullsized":"2026-02-24T08:23:35.105492+0000","mapping_epoch":39,"log_start":"41'8800","ondisk_log_start":"41'8800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154796032,"num_objects":2362,"num_object_clones":0,"num_object_copies":7086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2362,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18896,"num_write_kb":151168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"45'19104","reported_seq":19126,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.087375+0000","last_change":"2026-02-24T08:22:30.845810+0000","last_active":"2026-02-24T08:23:35.087375+0000","last_peered":"2026-02-24T08:23:35.087375+0000","last_clean":"2026-02-24T08:23:35.087375+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:35.087375+0000","last_undegraded":"2026-02-24T08:23:35.087375+0000","last_fullsized":"2026-02-24T08:23:35.087375+0000","mapping_epoch":39,"log_start":"41'9100","ondisk_log_start":"41'9100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:35.433647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156499968,"num_objects":2388,"num_object_clones":0,"num_object_copies":7164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2388,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19104,"num_write_kb":152832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"45'18509","reported_seq":18528,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.265164+0000","last_change":"2026-02-24T08:22:30.844845+0000","last_active":"2026-02-24T08:23:35.265164+0000","last_peered":"2026-02-24T08:23:35.265164+0000","last_clean":"2026-02-24T08:23:35.265164+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:35.265164+0000","last_undegraded":"2026-02-24T08:23:35.265164+0000","last_fullsized":"2026-02-24T08:23:35.265164+0000","mapping_epoch":39,"log_start":"41'8500","ondisk_log_start":"41'8500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151625728,"num_objects":2314,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18509,"num_write_kb":148072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"45'18784","reported_seq":18806,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.253929+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:23:35.253929+0000","last_peered":"2026-02-24T08:23:35.253929+0000","last_clean":"2026-02-24T08:23:35.253929+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:35.253929+0000","last_undegraded":"2026-02-24T08:23:35.253929+0000","last_fullsized":"2026-02-24T08:23:35.253929+0000","mapping_epoch":39,"log_start":"41'8700","ondisk_log_start":"41'8700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153878528,"num_objects":2348,"num_object_clones":0,"num_object_copies":7044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2348,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18784,"num_write_kb":150272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"45'19160","reported_seq":19182,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:34.928963+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:23:34.928963+0000","last_peered":"2026-02-24T08:23:34.928963+0000","last_clean":"2026-02-24T08:23:34.928963+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:34.928963+0000","last_undegraded":"2026-02-24T08:23:34.928963+0000","last_fullsized":"2026-02-24T08:23:34.928963+0000","mapping_epoch":39,"log_start":"41'9100","ondisk_log_start":"41'9100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156958720,"num_objects":2395,"num_object_clones":0,"num_object_copies":7185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2395,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19160,"num_write_kb":153280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"45'18123","reported_seq":18145,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:34.995693+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:34.995693+0000","last_peered":"2026-02-24T08:23:34.995693+0000","last_clean":"2026-02-24T08:23:34.995693+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:34.995693+0000","last_undegraded":"2026-02-24T08:23:34.995693+0000","last_fullsized":"2026-02-24T08:23:34.995693+0000","mapping_epoch":39,"log_start":"41'8100","ondisk_log_start":"41'8100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148463616,"num_objects":2266,"num_object_clones":0,"num_object_copies":6798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18123,"num_write_kb":144984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"45'18712","reported_seq":18729,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.260824+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:35.260824+0000","last_peered":"2026-02-24T08:23:35.260824+0000","last_clean":"2026-02-24T08:23:35.260824+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:35.260824+0000","last_undegraded":"2026-02-24T08:23:35.260824+0000","last_fullsized":"2026-02-24T08:23:35.260824+0000","mapping_epoch":39,"log_start":"41'8700","ondisk_log_start":"41'8700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153288704,"num_objects":2339,"num_object_clones":0,"num_object_copies":7017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2339,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18712,"num_write_kb":149696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"45'18050","reported_seq":18071,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:34.999914+0000","last_change":"2026-02-24T08:22:30.845594+0000","last_active":"2026-02-24T08:23:34.999914+0000","last_peered":"2026-02-24T08:23:34.999914+0000","last_clean":"2026-02-24T08:23:34.999914+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:34.999914+0000","last_undegraded":"2026-02-24T08:23:34.999914+0000","last_fullsized":"2026-02-24T08:23:34.999914+0000","mapping_epoch":39,"log_start":"41'8000","ondisk_log_start":"41'8000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147865600,"num_objects":2257,"num_object_clones":0,"num_object_copies":6771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2257,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18050,"num_write_kb":144400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"45'18294","reported_seq":18342,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:34.920132+0000","last_change":"2026-02-24T08:23:34.668724+0000","last_active":"2026-02-24T08:23:34.920132+0000","last_peered":"2026-02-24T08:23:34.920132+0000","last_clean":"2026-02-24T08:23:34.920132+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:34.920132+0000","last_undegraded":"2026-02-24T08:23:34.920132+0000","last_fullsized":"2026-02-24T08:23:34.920132+0000","mapping_epoch":39,"log_start":"41'8200","ondisk_log_start":"41'8200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'18240","last_scrub_stamp":"2026-02-24T08:23:34.668671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:34.668671+0000","objects_scrubbed":2275,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:37.815374+0000","scrub_duration":966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149864448,"num_objects":2287,"num_object_clones":0,"num_object_copies":6861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2287,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18294,"num_write_kb":146352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"45'18744","reported_seq":18766,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.243727+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:23:35.243727+0000","last_peered":"2026-02-24T08:23:35.243727+0000","last_clean":"2026-02-24T08:23:35.243727+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:35.243727+0000","last_undegraded":"2026-02-24T08:23:35.243727+0000","last_fullsized":"2026-02-24T08:23:35.243727+0000","mapping_epoch":39,"log_start":"41'8700","ondisk_log_start":"41'8700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153550848,"num_objects":2343,"num_object_clones":0,"num_object_copies":7029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2343,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18744,"num_write_kb":149952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"45'18928","reported_seq":18950,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:35.256201+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:23:35.256201+0000","last_peered":"2026-02-24T08:23:35.256201+0000","last_clean":"2026-02-24T08:23:35.256201+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:35.256201+0000","last_undegraded":"2026-02-24T08:23:35.256201+0000","last_fullsized":"2026-02-24T08:23:35.256201+0000","mapping_epoch":39,"log_start":"41'8900","ondisk_log_start":"41'8900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:37.644736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155058176,"num_objects":2366,"num_object_clones":0,"num_object_copies":7098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2366,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18928,"num_write_kb":151424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":100,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:13.899280+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:13.899280+0000","last_peered":"2026-02-24T08:23:13.899280+0000","last_clean":"2026-02-24T08:23:13.899280+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:13.899280+0000","last_undegraded":"2026-02-24T08:23:13.899280+0000","last_fullsized":"2026-02-24T08:23:13.899280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2437144576,"num_objects":37191,"num_object_clones":0,"num_object_copies":111573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297503,"num_write_kb":2380024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7306911744,"data_stored":7306911744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160603,"ondisk_log_size":160603,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247849,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2486756,"kb_used_data":1485072,"kb_used_omap":19,"kb_used_meta":1001644,"kb_avail":731516444,"statfs":{"total":751619276800,"available":749072838656,"internally_reserved":0,"allocated":1520713728,"data_stored":1520417591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19944,"internal_metadata":1025683992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,10,8,17,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444075,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3004924,"kb_used_data":2075560,"kb_used_omap":23,"kb_used_meta":929320,"kb_avail":730998276,"statfs":{"total":751619276800,"available":748542234624,"internally_reserved":0,"allocated":2125373440,"data_stored":2125077303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":951624497},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2554392,"kb_used_data":1625028,"kb_used_omap":25,"kb_used_meta":929318,"kb_avail":731448808,"statfs":{"total":751619276800,"available":749003579392,"internally_reserved":0,"allocated":1664028672,"data_stored":1663736087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":951622544},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,7,1,9,8,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2829428,"kb_used_data":1918112,"kb_used_omap":28,"kb_used_meta":911267,"kb_avail":731173772,"statfs":{"total":751619276800,"available":748721942528,"internally_reserved":0,"allocated":1964146688,"data_stored":1963850551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28967,"internal_metadata":933138137},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1971429376,"data_stored":1971429376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1681039360,"data_stored":1681039360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2133016576,"data_stored":2133016576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1521426432,"data_stored":1521426432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:39.649 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:23:39.649 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 81 2026-02-24T08:23:39.841 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:23:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:23:39.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:23:39.841 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:39.867 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:39 trial105 ceph-mon[39442]: pgmap v117: 17 pgs: 17 active+clean; 2.3 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.02k op/s 2026-02-24T08:23:39.868 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:39 trial105 ceph-mon[39442]: 3.3 scrub ok 2026-02-24T08:23:39.868 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:23:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:23:39] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-24T08:23:39.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 68 127 315019 314892 36.1748 26.875 0.010845 0.0276319 2026-02-24T08:23:39.978 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:39.976+0000 7f2aa48b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:39.978 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:39.976+0000 7f2aa48b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:40.143 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:23:40.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:23:40.262 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:40.405 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:40.539 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:40.536+0000 7f425bd4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:40.539 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:40.537+0000 7f425bd4d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:40.555 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:40.555 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:40.569 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:40.569 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:40.583 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:40.583 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:40.597 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:40.597 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:40.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 69 128 318413 318285 36.0347 26.5078 0.0864414 0.0277386 2026-02-24T08:23:41.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:40 trial105 ceph-mon[39442]: from='client.14643 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:41.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:40 trial105 ceph-mon[39442]: 3.9 scrub starts 2026-02-24T08:23:41.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2809894052' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "81"} : dispatch 2026-02-24T08:23:41.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:40 trial105 ceph-mon[39442]: 3.2 scrub starts 2026-02-24T08:23:41.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1863069466' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:41.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 70 127 322093 321966 35.9307 28.7578 0.0310282 0.0278208 2026-02-24T08:23:42.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:41 trial105 ceph-mon[39442]: 3.9 scrub ok 2026-02-24T08:23:42.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:41 trial105 ceph-mon[39442]: pgmap v118: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.4 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.54k op/s 2026-02-24T08:23:42.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:41 trial105 ceph-mon[39442]: 3.2 scrub ok 2026-02-24T08:23:42.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:41 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:23:42.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:41 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:23:42.646 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:42.796 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:42.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 71 128 325633 325505 35.8138 27.6484 0.078854 0.0279064 2026-02-24T08:23:43.099 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:43.096+0000 7fbd288eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:43.099 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:43.097+0000 7fbd288eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:43.117 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:43.117 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:43.134 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:43.134 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:43.149 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:43.150 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:43.166 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:43.166 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:43.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 72 128 329221 329093 35.7057 28.0312 0.0133314 0.027993 2026-02-24T08:23:44.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:43 trial105 ceph-mon[39442]: pgmap v119: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.4 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.03k op/s 2026-02-24T08:23:44.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/249743789' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:44.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 73 128 332798 332670 35.5993 27.9453 0.00979023 0.028078 2026-02-24T08:23:45.186 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:23:45.187 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:23:45.187 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:45.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:44 trial105 ceph-mon[39442]: 3.6 scrub starts 2026-02-24T08:23:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:23:45.212 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:45.338 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:45.381 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:45.489 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:45.487+0000 7f0eb35ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:45.490 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:45.487+0000 7f0eb35ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:45.498 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:45.496+0000 7f5cee9ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:45.499 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:45.497+0000 7f5cee9ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:45.518 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:45.519 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:45.533 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:45.533 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:45.547 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:45.547 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:45.570 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:45.570 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:45.646 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:45.647 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:45.695 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2026-02-24T08:23:44.713039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2587124256,"num_objects":39472,"num_object_clones":0,"num_object_copies":118416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39472,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":315874,"num_write_kb":2528062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160938,"ondisk_log_size":160938,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11466844,"kb_used_data":7540940,"kb_used_omap":96,"kb_used_meta":3925727,"kb_avail":2924545956,"statfs":{"total":3006477107200,"available":2994735058944,"internally_reserved":0,"allocated":7721922560,"data_stored":7720741564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98382,"internal_metadata":4019945394},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,2,7,9,23],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":298270720,"num_objects":4551,"num_object_clones":0,"num_object_copies":13653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36410,"num_write_kb":291280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001591"},"pg_stats":[{"pgid":"3.f","version":"45'19880","reported_seq":19902,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.036846+0000","last_change":"2026-02-24T08:22:30.845768+0000","last_active":"2026-02-24T08:23:40.036846+0000","last_peered":"2026-02-24T08:23:40.036846+0000","last_clean":"2026-02-24T08:23:40.036846+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:40.036846+0000","last_undegraded":"2026-02-24T08:23:40.036846+0000","last_fullsized":"2026-02-24T08:23:40.036846+0000","mapping_epoch":39,"log_start":"41'9800","ondisk_log_start":"41'9800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:50.947807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162856960,"num_objects":2485,"num_object_clones":0,"num_object_copies":7455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2485,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19880,"num_write_kb":159040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"45'19400","reported_seq":19422,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.027677+0000","last_change":"2026-02-24T08:22:30.844610+0000","last_active":"2026-02-24T08:23:40.027677+0000","last_peered":"2026-02-24T08:23:40.027677+0000","last_clean":"2026-02-24T08:23:40.027677+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:40.027677+0000","last_undegraded":"2026-02-24T08:23:40.027677+0000","last_fullsized":"2026-02-24T08:23:40.027677+0000","mapping_epoch":39,"log_start":"41'9300","ondisk_log_start":"41'9300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.631886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158924800,"num_objects":2425,"num_object_clones":0,"num_object_copies":7275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19400,"num_write_kb":155200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"45'19760","reported_seq":19782,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.130566+0000","last_change":"2026-02-24T08:22:30.845526+0000","last_active":"2026-02-24T08:23:40.130566+0000","last_peered":"2026-02-24T08:23:40.130566+0000","last_clean":"2026-02-24T08:23:40.130566+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:40.130566+0000","last_undegraded":"2026-02-24T08:23:40.130566+0000","last_fullsized":"2026-02-24T08:23:40.130566+0000","mapping_epoch":39,"log_start":"41'9700","ondisk_log_start":"41'9700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:49.346734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161873920,"num_objects":2470,"num_object_clones":0,"num_object_copies":7410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19760,"num_write_kb":158080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"45'19237","reported_seq":19250,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.150144+0000","last_change":"2026-02-24T08:22:30.844266+0000","last_active":"2026-02-24T08:23:40.150144+0000","last_peered":"2026-02-24T08:23:40.150144+0000","last_clean":"2026-02-24T08:23:40.150144+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:40.150144+0000","last_undegraded":"2026-02-24T08:23:40.150144+0000","last_fullsized":"2026-02-24T08:23:40.150144+0000","mapping_epoch":39,"log_start":"41'9200","ondisk_log_start":"41'9200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.506347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157589504,"num_objects":2405,"num_object_clones":0,"num_object_copies":7215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19237,"num_write_kb":153896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"45'19520","reported_seq":19542,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.132864+0000","last_change":"2026-02-24T08:22:30.845430+0000","last_active":"2026-02-24T08:23:40.132864+0000","last_peered":"2026-02-24T08:23:40.132864+0000","last_clean":"2026-02-24T08:23:40.132864+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:40.132864+0000","last_undegraded":"2026-02-24T08:23:40.132864+0000","last_fullsized":"2026-02-24T08:23:40.132864+0000","mapping_epoch":39,"log_start":"41'9500","ondisk_log_start":"41'9500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:44.578772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159907840,"num_objects":2440,"num_object_clones":0,"num_object_copies":7320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2440,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19520,"num_write_kb":156160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"45'19967","reported_seq":19987,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.150057+0000","last_change":"2026-02-24T08:22:30.845566+0000","last_active":"2026-02-24T08:23:40.150057+0000","last_peered":"2026-02-24T08:23:40.150057+0000","last_clean":"2026-02-24T08:23:40.150057+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:40.150057+0000","last_undegraded":"2026-02-24T08:23:40.150057+0000","last_fullsized":"2026-02-24T08:23:40.150057+0000","mapping_epoch":39,"log_start":"41'9900","ondisk_log_start":"41'9900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.674874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163569664,"num_objects":2496,"num_object_clones":0,"num_object_copies":7488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19967,"num_write_kb":159736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"45'20245","reported_seq":20276,"reported_epoch":45,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:23:40.128715+0000","last_change":"2026-02-24T08:23:40.024344+0000","last_active":"2026-02-24T08:23:40.128715+0000","last_peered":"2026-02-24T08:23:40.128715+0000","last_clean":"2026-02-24T08:23:40.128715+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:40.128715+0000","last_undegraded":"2026-02-24T08:23:40.128715+0000","last_fullsized":"2026-02-24T08:23:40.128715+0000","mapping_epoch":39,"log_start":"41'10200","ondisk_log_start":"41'10200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":999,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165847040,"num_objects":2531,"num_object_clones":0,"num_object_copies":7593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20245,"num_write_kb":161960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"45'19657","reported_seq":19709,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.267693+0000","last_change":"2026-02-24T08:23:38.342118+0000","last_active":"2026-02-24T08:23:40.267693+0000","last_peered":"2026-02-24T08:23:40.267693+0000","last_clean":"2026-02-24T08:23:40.267693+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:40.267693+0000","last_undegraded":"2026-02-24T08:23:40.267693+0000","last_fullsized":"2026-02-24T08:23:40.267693+0000","mapping_epoch":39,"log_start":"41'9600","ondisk_log_start":"41'9600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19184","last_scrub_stamp":"2026-02-24T08:23:38.342009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:38.342009+0000","objects_scrubbed":2388,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.378916+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161030144,"num_objects":2458,"num_object_clones":0,"num_object_copies":7374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19657,"num_write_kb":157256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"45'19976","reported_seq":19968,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.274110+0000","last_change":"2026-02-24T08:22:30.843825+0000","last_active":"2026-02-24T08:23:40.274110+0000","last_peered":"2026-02-24T08:23:40.274110+0000","last_clean":"2026-02-24T08:23:40.274110+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:40.274110+0000","last_undegraded":"2026-02-24T08:23:40.274110+0000","last_fullsized":"2026-02-24T08:23:40.274110+0000","mapping_epoch":39,"log_start":"41'9900","ondisk_log_start":"41'9900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:47.738260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163643392,"num_objects":2497,"num_object_clones":0,"num_object_copies":7491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19976,"num_write_kb":159808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"45'20268","reported_seq":20287,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:39.905928+0000","last_change":"2026-02-24T08:22:30.845018+0000","last_active":"2026-02-24T08:23:39.905928+0000","last_peered":"2026-02-24T08:23:39.905928+0000","last_clean":"2026-02-24T08:23:39.905928+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:39.905928+0000","last_undegraded":"2026-02-24T08:23:39.905928+0000","last_fullsized":"2026-02-24T08:23:39.905928+0000","mapping_epoch":39,"log_start":"41'10200","ondisk_log_start":"41'10200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:40.977841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166035456,"num_objects":2534,"num_object_clones":0,"num_object_copies":7602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20268,"num_write_kb":162144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"45'19358","reported_seq":19380,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.013708+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:40.013708+0000","last_peered":"2026-02-24T08:23:40.013708+0000","last_clean":"2026-02-24T08:23:40.013708+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:40.013708+0000","last_undegraded":"2026-02-24T08:23:40.013708+0000","last_fullsized":"2026-02-24T08:23:40.013708+0000","mapping_epoch":39,"log_start":"41'9300","ondisk_log_start":"41'9300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:52.738386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158580736,"num_objects":2420,"num_object_clones":0,"num_object_copies":7260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19358,"num_write_kb":154864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"45'19848","reported_seq":19870,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.242383+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:40.242383+0000","last_peered":"2026-02-24T08:23:40.242383+0000","last_clean":"2026-02-24T08:23:40.242383+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:40.242383+0000","last_undegraded":"2026-02-24T08:23:40.242383+0000","last_fullsized":"2026-02-24T08:23:40.242383+0000","mapping_epoch":39,"log_start":"41'9800","ondisk_log_start":"41'9800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:54.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162594816,"num_objects":2481,"num_object_clones":0,"num_object_copies":7443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19848,"num_write_kb":158784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"45'19231","reported_seq":19279,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.045389+0000","last_change":"2026-02-24T08:23:39.137696+0000","last_active":"2026-02-24T08:23:40.045389+0000","last_peered":"2026-02-24T08:23:40.045389+0000","last_clean":"2026-02-24T08:23:40.045389+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:40.045389+0000","last_undegraded":"2026-02-24T08:23:40.045389+0000","last_fullsized":"2026-02-24T08:23:40.045389+0000","mapping_epoch":39,"log_start":"41'9200","ondisk_log_start":"41'9200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19008","last_scrub_stamp":"2026-02-24T08:23:39.137654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:39.137654+0000","objects_scrubbed":2373,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:46.178505+0000","scrub_duration":464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157540352,"num_objects":2404,"num_object_clones":0,"num_object_copies":7212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19231,"num_write_kb":153848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"45'19440","reported_seq":19492,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:39.934323+0000","last_change":"2026-02-24T08:23:34.668724+0000","last_active":"2026-02-24T08:23:39.934323+0000","last_peered":"2026-02-24T08:23:39.934323+0000","last_clean":"2026-02-24T08:23:39.934323+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:39.934323+0000","last_undegraded":"2026-02-24T08:23:39.934323+0000","last_fullsized":"2026-02-24T08:23:39.934323+0000","mapping_epoch":39,"log_start":"41'9400","ondisk_log_start":"41'9400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'18240","last_scrub_stamp":"2026-02-24T08:23:34.668671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:34.668671+0000","objects_scrubbed":2275,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:37.815374+0000","scrub_duration":966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159252480,"num_objects":2430,"num_object_clones":0,"num_object_copies":7290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2430,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19440,"num_write_kb":155520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"45'19824","reported_seq":19841,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.271260+0000","last_change":"2026-02-24T08:22:30.844609+0000","last_active":"2026-02-24T08:23:40.271260+0000","last_peered":"2026-02-24T08:23:40.271260+0000","last_clean":"2026-02-24T08:23:40.271260+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:40.271260+0000","last_undegraded":"2026-02-24T08:23:40.271260+0000","last_fullsized":"2026-02-24T08:23:40.271260+0000","mapping_epoch":39,"log_start":"41'9800","ondisk_log_start":"41'9800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:23:51.803327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162398208,"num_objects":2478,"num_object_clones":0,"num_object_copies":7434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19824,"num_write_kb":158592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"45'20128","reported_seq":20150,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:40.251004+0000","last_change":"2026-02-24T08:22:30.844020+0000","last_active":"2026-02-24T08:23:40.251004+0000","last_peered":"2026-02-24T08:23:40.251004+0000","last_clean":"2026-02-24T08:23:40.251004+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:40.251004+0000","last_undegraded":"2026-02-24T08:23:40.251004+0000","last_fullsized":"2026-02-24T08:23:40.251004+0000","mapping_epoch":39,"log_start":"41'10100","ondisk_log_start":"41'10100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164888576,"num_objects":2516,"num_object_clones":0,"num_object_copies":7548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20128,"num_write_kb":161024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":100,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-24T08:23:13.899280+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:13.899280+0000","last_peered":"2026-02-24T08:23:13.899280+0000","last_clean":"2026-02-24T08:23:13.899280+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:13.899280+0000","last_undegraded":"2026-02-24T08:23:13.899280+0000","last_fullsized":"2026-02-24T08:23:13.899280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2586533888,"num_objects":39470,"num_object_clones":0,"num_object_copies":118410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315739,"num_write_kb":2525912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7753768960,"data_stored":7753768960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160839,"ondisk_log_size":160839,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247850,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2618180,"kb_used_data":1576112,"kb_used_omap":19,"kb_used_meta":1042028,"kb_avail":731385020,"statfs":{"total":751619276800,"available":748938260480,"internally_reserved":0,"allocated":1613938688,"data_stored":1613642551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19944,"internal_metadata":1067037208},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,2,7,9,23],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444076,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3209876,"kb_used_data":2202816,"kb_used_omap":23,"kb_used_meta":1007016,"kb_avail":730793324,"statfs":{"total":751619276800,"available":748332363776,"internally_reserved":0,"allocated":2255683584,"data_stored":2255387447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23759,"internal_metadata":1031185201},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2671512,"kb_used_data":1724100,"kb_used_omap":25,"kb_used_meta":947366,"kb_avail":731331688,"statfs":{"total":751619276800,"available":748883648512,"internally_reserved":0,"allocated":1765478400,"data_stored":1765185815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":970103696},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2967276,"kb_used_data":2037912,"kb_used_omap":28,"kb_used_meta":929315,"kb_avail":731035924,"statfs":{"total":751619276800,"available":748580786176,"internally_reserved":0,"allocated":2086821888,"data_stored":2086525751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28967,"internal_metadata":951619289},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9456,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2093891584,"data_stored":2093891584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1781760000,"data_stored":1781760000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2263031808,"data_stored":2263031808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1615085568,"data_stored":1615085568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:45.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 74 128 336168 336040 35.474 26.3281 0.0835038 0.0281793 2026-02-24T08:23:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:45 trial105 ceph-mon[39442]: 3.6 scrub ok 2026-02-24T08:23:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:45 trial105 ceph-mon[39442]: pgmap v120: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.4 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.03k op/s 2026-02-24T08:23:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2983576488' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:46.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 75 128 339725 339597 35.3715 27.7891 0.0270056 0.028262 2026-02-24T08:23:47.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:46 trial105 ceph-mon[39442]: 3.b scrub starts 2026-02-24T08:23:47.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:46 trial105 ceph-mon[39442]: from='client.14651 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:47.617 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:47.766 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:47.887 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:47.884+0000 7f0124076640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:47.887 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:47.885+0000 7f0124076640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:47.910 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:47.911 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:47.911 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:47 trial105 ceph-mon[39442]: pgmap v121: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.51k op/s 2026-02-24T08:23:47.911 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:47 trial105 ceph-mon[39442]: 3.b scrub ok 2026-02-24T08:23:47.911 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:47 trial105 ceph-mon[39442]: 3.e scrub starts 2026-02-24T08:23:47.928 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:47.928 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:47.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 76 128 343264 343136 35.2699 27.6484 0.0601215 0.028344 2026-02-24T08:23:47.942 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:47.943 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:47.959 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:47.959 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:48.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 77 128 346856 346728 35.1763 28.0625 0.0257314 0.0284146 2026-02-24T08:23:49.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:48 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/854917616' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:49.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:48 trial105 ceph-mon[39442]: 3.e scrub ok 2026-02-24T08:23:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:23:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:23:49.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:23:49.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 78 128 350490 350362 35.0892 28.3906 0.0219521 0.028489 2026-02-24T08:23:49.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:49 trial105 ceph-mon[39442]: pgmap v122: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.99k op/s 2026-02-24T08:23:49.938 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:49 trial105 ceph-mon[39442]: 3.7 scrub starts 2026-02-24T08:23:49.938 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:23:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:23:49] "GET /metrics HTTP/1.1" 200 4220 "" "Prometheus/3.6.0" 2026-02-24T08:23:50.002 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:50.149 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:50.279 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:50.277+0000 7f170a2b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:50.279 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:50.277+0000 7f170a2b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:50.298 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:50.298 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:50.324 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:50.324 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:50.338 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:50.338 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:50.353 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:50.354 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:50.698 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:23:50.698 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:23:50.846 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:50.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 79 128 353974 353846 34.9896 27.2188 0.0471227 0.0285721 2026-02-24T08:23:50.983 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:50 trial105 ceph-mon[39442]: 3.7 scrub ok 2026-02-24T08:23:50.983 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1174505849' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:50.983 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:50.981+0000 7f6961b8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:50.983 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:50.981+0000 7f6961b8f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:51.794 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:23:51.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:23:51.936365+0000 min lat: 0.000724324 max lat: 0.242938 avg lat: 0.0286483 2026-02-24T08:23:51.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:23:51.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 80 128 357477 357349 34.8943 27.3672 0.0476902 0.0286483 2026-02-24T08:23:52.094 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:51 trial105 ceph-mon[39442]: pgmap v123: 17 pgs: 17 active+clean; 2.7 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 35 MiB/s wr, 4.47k op/s 2026-02-24T08:23:52.094 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:51 trial105 ceph-mon[39442]: 3.d scrub starts 2026-02-24T08:23:52.094 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:51 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:23:52.094 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:51 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:23:52.094 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1859233217' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:23:52.249 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:23:52.401 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:52.422 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:52.599 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:52.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 81 128 360181 360053 34.7243 21.125 0.0150605 0.0287855 2026-02-24T08:23:53.038 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:52.807+0000 7fde07944640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:53.038 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:52.808+0000 7fde07944640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:53.039 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1859233217' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:23:53.039 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:52 trial105 ceph-mon[39442]: osdmap e46: 4 total, 4 up, 4 in 2026-02-24T08:23:53.039 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:52 trial105 ceph-mon[39442]: 3.a scrub starts 2026-02-24T08:23:53.039 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:52 trial105 ceph-mon[39442]: 3.d scrub ok 2026-02-24T08:23:53.227 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:53.206+0000 7ffaf804c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:53.227 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:53.207+0000 7ffaf804c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:53.241 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:53.241 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:53.256 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:53.256 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:53.270 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:53.270 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:53.283 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:53.284 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:53.800 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:23:53.845 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:23:53.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 82 128 363389 363261 34.6064 25.0625 0.0293798 0.0288849 2026-02-24T08:23:53.995 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:54.113 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:53 trial105 ceph-mon[39442]: pgmap v125: 17 pgs: 17 active+clean; 2.7 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.54k op/s 2026-02-24T08:23:54.113 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:53 trial105 ceph-mon[39442]: 3.f scrub starts 2026-02-24T08:23:54.113 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:53 trial105 ceph-mon[39442]: 3.a scrub ok 2026-02-24T08:23:54.113 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:53 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2807553499' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:23:54.113 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:53 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4043603732' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:54.113 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:53 trial105 ceph-mon[39442]: 3.f scrub ok 2026-02-24T08:23:54.323 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:54.320+0000 7f38cae24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:54.323 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:54.320+0000 7f38cae24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:54.805 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:23:54.852 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:23:54.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 83 128 366853 366725 34.5155 27.0625 0.0125063 0.0289618 2026-02-24T08:23:55.008 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:55.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2807553499' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:23:55.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:54 trial105 ceph-mon[39442]: osdmap e47: 4 total, 4 up, 4 in 2026-02-24T08:23:55.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:54 trial105 ceph-mon[39442]: 3.c scrub starts 2026-02-24T08:23:55.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:54 trial105 ceph-mon[39442]: 3.0 scrub starts 2026-02-24T08:23:55.055 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3651635007' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:23:55.136 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:55.133+0000 7f3ae3b5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:55.136 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:55.133+0000 7f3ae3b5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:55.352 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:23:55.501 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:55.631 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:55.627+0000 7f106a703640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:55.631 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:55.627+0000 7f106a703640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:55.651 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:55.651 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:55.666 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:55.667 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:55.680 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:55.680 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:55.694 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:55.694 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:55.805 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:23:55.853 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:23:55.854 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:55.880 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:55 trial105 ceph-mon[39442]: pgmap v127: 17 pgs: 17 active+clean; 2.7 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 17 MiB/s wr, 2.21k op/s 2026-02-24T08:23:55.880 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3651635007' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:23:55.880 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:55 trial105 ceph-mon[39442]: osdmap e48: 4 total, 4 up, 4 in 2026-02-24T08:23:55.880 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:55 trial105 ceph-mon[39442]: 3.c scrub ok 2026-02-24T08:23:55.880 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4254214396' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:23:55.880 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:55 trial105 ceph-mon[39442]: 3.4 scrub starts 2026-02-24T08:23:55.880 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1102422404' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:55.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 84 127 370265 370138 34.422 26.6641 0.0206028 0.0290401 2026-02-24T08:23:56.004 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:56.138 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:56.136+0000 7f8b2e73a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:56.139 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:56.136+0000 7f8b2e73a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:56.294 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:56.294 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:56.341 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2026-02-24T08:23:55.804892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3011797536,"num_objects":45952,"num_object_clones":0,"num_object_copies":137856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45952,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":367714,"num_write_kb":2942782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160978,"ondisk_log_size":160978,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13052200,"kb_used_data":8780248,"kb_used_omap":103,"kb_used_meta":4271768,"kb_avail":2922960600,"statfs":{"total":3006477107200,"available":2993111654400,"internally_reserved":0,"allocated":8990973952,"data_stored":8989722045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":105533,"internal_metadata":4374291395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,13,8,8,0,20],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":134586368,"num_objects":2055,"num_object_clones":0,"num_object_copies":6165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16429,"num_write_kb":131432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.091022"},"pg_stats":[{"pgid":"3.f","version":"48'23003","reported_seq":23062,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.080051+0000","last_change":"2026-02-24T08:23:53.395926+0000","last_active":"2026-02-24T08:23:55.080051+0000","last_peered":"2026-02-24T08:23:55.080051+0000","last_clean":"2026-02-24T08:23:55.080051+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:55.080051+0000","last_undegraded":"2026-02-24T08:23:55.080051+0000","last_fullsized":"2026-02-24T08:23:55.080051+0000","mapping_epoch":39,"log_start":"42'13000","ondisk_log_start":"42'13000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22656","last_scrub_stamp":"2026-02-24T08:23:53.395879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:53.395879+0000","objects_scrubbed":2828,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.122475+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188440576,"num_objects":2876,"num_object_clones":0,"num_object_copies":8628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23003,"num_write_kb":184024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'22792","reported_seq":22854,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.076293+0000","last_change":"2026-02-24T08:23:48.485242+0000","last_active":"2026-02-24T08:23:55.076293+0000","last_peered":"2026-02-24T08:23:55.076293+0000","last_clean":"2026-02-24T08:23:55.076293+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:55.076293+0000","last_undegraded":"2026-02-24T08:23:55.076293+0000","last_fullsized":"2026-02-24T08:23:55.076293+0000","mapping_epoch":39,"log_start":"41'12700","ondisk_log_start":"41'12700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21369","last_scrub_stamp":"2026-02-24T08:23:48.485131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:48.485131+0000","objects_scrubbed":2663,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:49.324274+0000","scrub_duration":801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186712064,"num_objects":2849,"num_object_clones":0,"num_object_copies":8547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2849,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22792,"num_write_kb":182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'22927","reported_seq":22987,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.195476+0000","last_change":"2026-02-24T08:23:52.409060+0000","last_active":"2026-02-24T08:23:55.195476+0000","last_peered":"2026-02-24T08:23:55.195476+0000","last_clean":"2026-02-24T08:23:55.195476+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:55.195476+0000","last_undegraded":"2026-02-24T08:23:55.195476+0000","last_fullsized":"2026-02-24T08:23:55.195476+0000","mapping_epoch":39,"log_start":"41'12900","ondisk_log_start":"41'12900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22408","last_scrub_stamp":"2026-02-24T08:23:52.408922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.408922+0000","objects_scrubbed":2777,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.952734+0000","scrub_duration":1473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187817984,"num_objects":2866,"num_object_clones":0,"num_object_copies":8598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2866,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22927,"num_write_kb":183416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"48'22480","reported_seq":22545,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.185233+0000","last_change":"2026-02-24T08:23:55.156896+0000","last_active":"2026-02-24T08:23:55.185233+0000","last_peered":"2026-02-24T08:23:55.185233+0000","last_clean":"2026-02-24T08:23:55.185233+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:55.185233+0000","last_undegraded":"2026-02-24T08:23:55.185233+0000","last_fullsized":"2026-02-24T08:23:55.185233+0000","mapping_epoch":39,"log_start":"42'12400","ondisk_log_start":"42'12400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'22472","last_scrub_stamp":"2026-02-24T08:23:55.156822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:55.156822+0000","objects_scrubbed":2797,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:16.905128+0000","scrub_duration":1274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184156160,"num_objects":2810,"num_object_clones":0,"num_object_copies":8430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22480,"num_write_kb":179840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"48'22784","reported_seq":22841,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.337950+0000","last_change":"2026-02-24T08:23:46.810453+0000","last_active":"2026-02-24T08:23:55.337950+0000","last_peered":"2026-02-24T08:23:55.337950+0000","last_clean":"2026-02-24T08:23:55.337950+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:55.337950+0000","last_undegraded":"2026-02-24T08:23:55.337950+0000","last_fullsized":"2026-02-24T08:23:55.337950+0000","mapping_epoch":39,"log_start":"41'12700","ondisk_log_start":"41'12700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21080","last_scrub_stamp":"2026-02-24T08:23:46.810392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:46.810392+0000","objects_scrubbed":2607,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:01.823881+0000","scrub_duration":1259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186646528,"num_objects":2848,"num_object_clones":0,"num_object_copies":8544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22784,"num_write_kb":182272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"48'22896","reported_seq":22960,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.171737+0000","last_change":"2026-02-24T08:23:52.943894+0000","last_active":"2026-02-24T08:23:55.171737+0000","last_peered":"2026-02-24T08:23:55.171737+0000","last_clean":"2026-02-24T08:23:55.171737+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:55.171737+0000","last_undegraded":"2026-02-24T08:23:55.171737+0000","last_fullsized":"2026-02-24T08:23:55.171737+0000","mapping_epoch":39,"log_start":"42'12800","ondisk_log_start":"42'12800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22488","last_scrub_stamp":"2026-02-24T08:23:52.943848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.943848+0000","objects_scrubbed":2804,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:06.784781+0000","scrub_duration":1056,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187564032,"num_objects":2862,"num_object_clones":0,"num_object_copies":8586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22896,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"48'23584","reported_seq":23643,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.200123+0000","last_change":"2026-02-24T08:23:40.659816+0000","last_active":"2026-02-24T08:23:55.200123+0000","last_peered":"2026-02-24T08:23:55.200123+0000","last_clean":"2026-02-24T08:23:55.200123+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:55.200123+0000","last_undegraded":"2026-02-24T08:23:55.200123+0000","last_fullsized":"2026-02-24T08:23:55.200123+0000","mapping_epoch":39,"log_start":"43'13500","ondisk_log_start":"43'13500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20376","last_scrub_stamp":"2026-02-24T08:23:40.659760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:40.659760+0000","objects_scrubbed":2535,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:44.100357+0000","scrub_duration":636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193200128,"num_objects":2948,"num_object_clones":0,"num_object_copies":8844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23584,"num_write_kb":188672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"48'23128","reported_seq":23187,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.336913+0000","last_change":"2026-02-24T08:23:38.342118+0000","last_active":"2026-02-24T08:23:55.336913+0000","last_peered":"2026-02-24T08:23:55.336913+0000","last_clean":"2026-02-24T08:23:55.336913+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:55.336913+0000","last_undegraded":"2026-02-24T08:23:55.336913+0000","last_fullsized":"2026-02-24T08:23:55.336913+0000","mapping_epoch":39,"log_start":"42'13100","ondisk_log_start":"42'13100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19184","last_scrub_stamp":"2026-02-24T08:23:38.342009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:38.342009+0000","objects_scrubbed":2388,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.378916+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189464576,"num_objects":2891,"num_object_clones":0,"num_object_copies":8673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23128,"num_write_kb":185024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"48'23064","reported_seq":23127,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.243034+0000","last_change":"2026-02-24T08:23:50.046655+0000","last_active":"2026-02-24T08:23:55.243034+0000","last_peered":"2026-02-24T08:23:55.243034+0000","last_clean":"2026-02-24T08:23:55.243034+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:55.243034+0000","last_undegraded":"2026-02-24T08:23:55.243034+0000","last_fullsized":"2026-02-24T08:23:55.243034+0000","mapping_epoch":39,"log_start":"41'13000","ondisk_log_start":"41'13000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'22024","last_scrub_stamp":"2026-02-24T08:23:50.046592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:50.046592+0000","objects_scrubbed":2743,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.450660+0000","scrub_duration":561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188940288,"num_objects":2883,"num_object_clones":0,"num_object_copies":8649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23064,"num_write_kb":184512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"48'23726","reported_seq":23783,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:54.956646+0000","last_change":"2026-02-24T08:23:44.128672+0000","last_active":"2026-02-24T08:23:54.956646+0000","last_peered":"2026-02-24T08:23:54.956646+0000","last_clean":"2026-02-24T08:23:54.956646+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:54.956646+0000","last_undegraded":"2026-02-24T08:23:54.956646+0000","last_fullsized":"2026-02-24T08:23:54.956646+0000","mapping_epoch":39,"log_start":"43'13700","ondisk_log_start":"43'13700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21088","last_scrub_stamp":"2026-02-24T08:23:44.128612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:44.128612+0000","objects_scrubbed":2631,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:08.319563+0000","scrub_duration":570,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194363392,"num_objects":2966,"num_object_clones":0,"num_object_copies":8898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23726,"num_write_kb":189808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"48'22700","reported_seq":22728,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.065309+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:55.065309+0000","last_peered":"2026-02-24T08:23:55.065309+0000","last_clean":"2026-02-24T08:23:55.065309+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:55.065309+0000","last_undegraded":"2026-02-24T08:23:55.065309+0000","last_fullsized":"2026-02-24T08:23:55.065309+0000","mapping_epoch":39,"log_start":"41'12600","ondisk_log_start":"41'12600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185958400,"num_objects":2838,"num_object_clones":0,"num_object_copies":8514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2838,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22700,"num_write_kb":181600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"48'23016","reported_seq":23044,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.318105+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:55.318105+0000","last_peered":"2026-02-24T08:23:55.318105+0000","last_clean":"2026-02-24T08:23:55.318105+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:55.318105+0000","last_undegraded":"2026-02-24T08:23:55.318105+0000","last_fullsized":"2026-02-24T08:23:55.318105+0000","mapping_epoch":39,"log_start":"41'13000","ondisk_log_start":"41'13000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188547072,"num_objects":2877,"num_object_clones":0,"num_object_copies":8631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23016,"num_write_kb":184128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"48'22856","reported_seq":22916,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.029530+0000","last_change":"2026-02-24T08:23:39.137696+0000","last_active":"2026-02-24T08:23:55.029530+0000","last_peered":"2026-02-24T08:23:55.029530+0000","last_clean":"2026-02-24T08:23:55.029530+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:55.029530+0000","last_undegraded":"2026-02-24T08:23:55.029530+0000","last_fullsized":"2026-02-24T08:23:55.029530+0000","mapping_epoch":39,"log_start":"43'12800","ondisk_log_start":"43'12800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19008","last_scrub_stamp":"2026-02-24T08:23:39.137654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:39.137654+0000","objects_scrubbed":2373,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:46.178505+0000","scrub_duration":464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187236352,"num_objects":2857,"num_object_clones":0,"num_object_copies":8571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22856,"num_write_kb":182848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"48'22560","reported_seq":22618,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:54.875438+0000","last_change":"2026-02-24T08:23:34.668724+0000","last_active":"2026-02-24T08:23:54.875438+0000","last_peered":"2026-02-24T08:23:54.875438+0000","last_clean":"2026-02-24T08:23:54.875438+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:54.875438+0000","last_undegraded":"2026-02-24T08:23:54.875438+0000","last_fullsized":"2026-02-24T08:23:54.875438+0000","mapping_epoch":39,"log_start":"41'12500","ondisk_log_start":"41'12500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'18240","last_scrub_stamp":"2026-02-24T08:23:34.668671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:34.668671+0000","objects_scrubbed":2275,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:37.815374+0000","scrub_duration":966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184811520,"num_objects":2820,"num_object_clones":0,"num_object_copies":8460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22560,"num_write_kb":180480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"48'22949","reported_seq":22979,"reported_epoch":48,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:23:55.295297+0000","last_change":"2026-02-24T08:23:54.408548+0000","last_active":"2026-02-24T08:23:55.295297+0000","last_peered":"2026-02-24T08:23:55.295297+0000","last_clean":"2026-02-24T08:23:55.295297+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:55.295297+0000","last_undegraded":"2026-02-24T08:23:55.295297+0000","last_fullsized":"2026-02-24T08:23:55.295297+0000","mapping_epoch":39,"log_start":"41'12900","ondisk_log_start":"41'12900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":1050,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187998208,"num_objects":2869,"num_object_clones":0,"num_object_copies":8607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2869,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22949,"num_write_kb":183592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'23114","reported_seq":23174,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.333727+0000","last_change":"2026-02-24T08:23:41.042420+0000","last_active":"2026-02-24T08:23:55.333727+0000","last_peered":"2026-02-24T08:23:55.333727+0000","last_clean":"2026-02-24T08:23:55.333727+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:55.333727+0000","last_undegraded":"2026-02-24T08:23:55.333727+0000","last_fullsized":"2026-02-24T08:23:55.333727+0000","mapping_epoch":39,"log_start":"41'13100","ondisk_log_start":"41'13100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20238","last_scrub_stamp":"2026-02-24T08:23:41.042354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:41.042354+0000","objects_scrubbed":2526,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:02.398622+0000","scrub_duration":573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189349888,"num_objects":2890,"num_object_clones":0,"num_object_copies":8670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23114,"num_write_kb":184912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":106,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:54.804953+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:54.804953+0000","last_peered":"2026-02-24T08:23:54.804953+0000","last_clean":"2026-02-24T08:23:54.804953+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:54.804953+0000","last_undegraded":"2026-02-24T08:23:54.804953+0000","last_fullsized":"2026-02-24T08:23:54.804953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3011207168,"num_objects":45950,"num_object_clones":0,"num_object_copies":137850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367579,"num_write_kb":2940632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9029705728,"data_stored":9029705728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160879,"ondisk_log_size":160879,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9536,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2930192,"kb_used_data":1831804,"kb_used_omap":21,"kb_used_meta":1098346,"kb_avail":731073008,"statfs":{"total":751619276800,"available":748618760192,"internally_reserved":0,"allocated":1875767296,"data_stored":1875447522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21887,"internal_metadata":1124706945},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444079,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3647916,"kb_used_data":2565848,"kb_used_omap":25,"kb_used_meta":1082022,"kb_avail":730355284,"statfs":{"total":751619276800,"available":747883810816,"internally_reserved":0,"allocated":2627428352,"data_stored":2627116457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":1107991440},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3050440,"kb_used_data":2005108,"kb_used_omap":27,"kb_used_meta":1045284,"kb_avail":730952760,"statfs":{"total":751619276800,"available":748495626240,"internally_reserved":0,"allocated":2053230592,"data_stored":2052922249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27665,"internal_metadata":1070371823},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,13,8,8,0,20],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3423652,"kb_used_data":2377488,"kb_used_omap":29,"kb_used_meta":1046114,"kb_avail":730579548,"statfs":{"total":751619276800,"available":748113457152,"internally_reserved":0,"allocated":2434547712,"data_stored":2434235817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30269,"internal_metadata":1071221187},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9536,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2442674176,"data_stored":2442674176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2071183360,"data_stored":2071183360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2636029952,"data_stored":2636029952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1879818240,"data_stored":1879818240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:56.344 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:56.533 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:56.658 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:56.655+0000 7f1d4227d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:56.658 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:56.655+0000 7f1d4227d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:56.809 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:56.809 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:56.859 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2026-02-24T08:23:56.714673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3011797536,"num_objects":45952,"num_object_clones":0,"num_object_copies":137856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45952,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":367714,"num_write_kb":2942782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160978,"ondisk_log_size":160978,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13052200,"kb_used_data":8780248,"kb_used_omap":103,"kb_used_meta":4271768,"kb_avail":2922960600,"statfs":{"total":3006477107200,"available":2993111654400,"internally_reserved":0,"allocated":8990973952,"data_stored":8989722045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":105533,"internal_metadata":4374291395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,13,8,8,0,20],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":134586368,"num_objects":2055,"num_object_clones":0,"num_object_copies":6165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16429,"num_write_kb":131432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.918791"},"pg_stats":[{"pgid":"3.f","version":"48'23003","reported_seq":23062,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.080051+0000","last_change":"2026-02-24T08:23:53.395926+0000","last_active":"2026-02-24T08:23:55.080051+0000","last_peered":"2026-02-24T08:23:55.080051+0000","last_clean":"2026-02-24T08:23:55.080051+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:55.080051+0000","last_undegraded":"2026-02-24T08:23:55.080051+0000","last_fullsized":"2026-02-24T08:23:55.080051+0000","mapping_epoch":39,"log_start":"42'13000","ondisk_log_start":"42'13000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22656","last_scrub_stamp":"2026-02-24T08:23:53.395879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:53.395879+0000","objects_scrubbed":2828,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.122475+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188440576,"num_objects":2876,"num_object_clones":0,"num_object_copies":8628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23003,"num_write_kb":184024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'22792","reported_seq":22854,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.076293+0000","last_change":"2026-02-24T08:23:48.485242+0000","last_active":"2026-02-24T08:23:55.076293+0000","last_peered":"2026-02-24T08:23:55.076293+0000","last_clean":"2026-02-24T08:23:55.076293+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:55.076293+0000","last_undegraded":"2026-02-24T08:23:55.076293+0000","last_fullsized":"2026-02-24T08:23:55.076293+0000","mapping_epoch":39,"log_start":"41'12700","ondisk_log_start":"41'12700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21369","last_scrub_stamp":"2026-02-24T08:23:48.485131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:48.485131+0000","objects_scrubbed":2663,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:49.324274+0000","scrub_duration":801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186712064,"num_objects":2849,"num_object_clones":0,"num_object_copies":8547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2849,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22792,"num_write_kb":182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'22927","reported_seq":22987,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.195476+0000","last_change":"2026-02-24T08:23:52.409060+0000","last_active":"2026-02-24T08:23:55.195476+0000","last_peered":"2026-02-24T08:23:55.195476+0000","last_clean":"2026-02-24T08:23:55.195476+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:55.195476+0000","last_undegraded":"2026-02-24T08:23:55.195476+0000","last_fullsized":"2026-02-24T08:23:55.195476+0000","mapping_epoch":39,"log_start":"41'12900","ondisk_log_start":"41'12900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22408","last_scrub_stamp":"2026-02-24T08:23:52.408922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.408922+0000","objects_scrubbed":2777,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.952734+0000","scrub_duration":1473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187817984,"num_objects":2866,"num_object_clones":0,"num_object_copies":8598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2866,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22927,"num_write_kb":183416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"48'22480","reported_seq":22545,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.185233+0000","last_change":"2026-02-24T08:23:55.156896+0000","last_active":"2026-02-24T08:23:55.185233+0000","last_peered":"2026-02-24T08:23:55.185233+0000","last_clean":"2026-02-24T08:23:55.185233+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:55.185233+0000","last_undegraded":"2026-02-24T08:23:55.185233+0000","last_fullsized":"2026-02-24T08:23:55.185233+0000","mapping_epoch":39,"log_start":"42'12400","ondisk_log_start":"42'12400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'22472","last_scrub_stamp":"2026-02-24T08:23:55.156822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:55.156822+0000","objects_scrubbed":2797,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:16.905128+0000","scrub_duration":1274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184156160,"num_objects":2810,"num_object_clones":0,"num_object_copies":8430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22480,"num_write_kb":179840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"48'22784","reported_seq":22841,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.337950+0000","last_change":"2026-02-24T08:23:46.810453+0000","last_active":"2026-02-24T08:23:55.337950+0000","last_peered":"2026-02-24T08:23:55.337950+0000","last_clean":"2026-02-24T08:23:55.337950+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:55.337950+0000","last_undegraded":"2026-02-24T08:23:55.337950+0000","last_fullsized":"2026-02-24T08:23:55.337950+0000","mapping_epoch":39,"log_start":"41'12700","ondisk_log_start":"41'12700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21080","last_scrub_stamp":"2026-02-24T08:23:46.810392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:46.810392+0000","objects_scrubbed":2607,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:01.823881+0000","scrub_duration":1259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186646528,"num_objects":2848,"num_object_clones":0,"num_object_copies":8544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22784,"num_write_kb":182272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"48'22896","reported_seq":22960,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.171737+0000","last_change":"2026-02-24T08:23:52.943894+0000","last_active":"2026-02-24T08:23:55.171737+0000","last_peered":"2026-02-24T08:23:55.171737+0000","last_clean":"2026-02-24T08:23:55.171737+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:55.171737+0000","last_undegraded":"2026-02-24T08:23:55.171737+0000","last_fullsized":"2026-02-24T08:23:55.171737+0000","mapping_epoch":39,"log_start":"42'12800","ondisk_log_start":"42'12800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22488","last_scrub_stamp":"2026-02-24T08:23:52.943848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.943848+0000","objects_scrubbed":2804,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:06.784781+0000","scrub_duration":1056,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187564032,"num_objects":2862,"num_object_clones":0,"num_object_copies":8586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22896,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"48'23584","reported_seq":23643,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.200123+0000","last_change":"2026-02-24T08:23:40.659816+0000","last_active":"2026-02-24T08:23:55.200123+0000","last_peered":"2026-02-24T08:23:55.200123+0000","last_clean":"2026-02-24T08:23:55.200123+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:55.200123+0000","last_undegraded":"2026-02-24T08:23:55.200123+0000","last_fullsized":"2026-02-24T08:23:55.200123+0000","mapping_epoch":39,"log_start":"43'13500","ondisk_log_start":"43'13500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20376","last_scrub_stamp":"2026-02-24T08:23:40.659760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:40.659760+0000","objects_scrubbed":2535,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:44.100357+0000","scrub_duration":636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193200128,"num_objects":2948,"num_object_clones":0,"num_object_copies":8844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23584,"num_write_kb":188672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"48'23128","reported_seq":23187,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.336913+0000","last_change":"2026-02-24T08:23:38.342118+0000","last_active":"2026-02-24T08:23:55.336913+0000","last_peered":"2026-02-24T08:23:55.336913+0000","last_clean":"2026-02-24T08:23:55.336913+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:55.336913+0000","last_undegraded":"2026-02-24T08:23:55.336913+0000","last_fullsized":"2026-02-24T08:23:55.336913+0000","mapping_epoch":39,"log_start":"42'13100","ondisk_log_start":"42'13100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19184","last_scrub_stamp":"2026-02-24T08:23:38.342009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:38.342009+0000","objects_scrubbed":2388,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.378916+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189464576,"num_objects":2891,"num_object_clones":0,"num_object_copies":8673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23128,"num_write_kb":185024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"48'23064","reported_seq":23127,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.243034+0000","last_change":"2026-02-24T08:23:50.046655+0000","last_active":"2026-02-24T08:23:55.243034+0000","last_peered":"2026-02-24T08:23:55.243034+0000","last_clean":"2026-02-24T08:23:55.243034+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:55.243034+0000","last_undegraded":"2026-02-24T08:23:55.243034+0000","last_fullsized":"2026-02-24T08:23:55.243034+0000","mapping_epoch":39,"log_start":"41'13000","ondisk_log_start":"41'13000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'22024","last_scrub_stamp":"2026-02-24T08:23:50.046592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:50.046592+0000","objects_scrubbed":2743,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.450660+0000","scrub_duration":561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188940288,"num_objects":2883,"num_object_clones":0,"num_object_copies":8649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23064,"num_write_kb":184512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"48'23726","reported_seq":23783,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:54.956646+0000","last_change":"2026-02-24T08:23:44.128672+0000","last_active":"2026-02-24T08:23:54.956646+0000","last_peered":"2026-02-24T08:23:54.956646+0000","last_clean":"2026-02-24T08:23:54.956646+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:54.956646+0000","last_undegraded":"2026-02-24T08:23:54.956646+0000","last_fullsized":"2026-02-24T08:23:54.956646+0000","mapping_epoch":39,"log_start":"43'13700","ondisk_log_start":"43'13700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21088","last_scrub_stamp":"2026-02-24T08:23:44.128612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:44.128612+0000","objects_scrubbed":2631,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:08.319563+0000","scrub_duration":570,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194363392,"num_objects":2966,"num_object_clones":0,"num_object_copies":8898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23726,"num_write_kb":189808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"48'22700","reported_seq":22728,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.065309+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:55.065309+0000","last_peered":"2026-02-24T08:23:55.065309+0000","last_clean":"2026-02-24T08:23:55.065309+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:55.065309+0000","last_undegraded":"2026-02-24T08:23:55.065309+0000","last_fullsized":"2026-02-24T08:23:55.065309+0000","mapping_epoch":39,"log_start":"41'12600","ondisk_log_start":"41'12600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185958400,"num_objects":2838,"num_object_clones":0,"num_object_copies":8514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2838,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22700,"num_write_kb":181600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"48'23016","reported_seq":23044,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.318105+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:55.318105+0000","last_peered":"2026-02-24T08:23:55.318105+0000","last_clean":"2026-02-24T08:23:55.318105+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:55.318105+0000","last_undegraded":"2026-02-24T08:23:55.318105+0000","last_fullsized":"2026-02-24T08:23:55.318105+0000","mapping_epoch":39,"log_start":"41'13000","ondisk_log_start":"41'13000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188547072,"num_objects":2877,"num_object_clones":0,"num_object_copies":8631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23016,"num_write_kb":184128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"48'22856","reported_seq":22916,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.029530+0000","last_change":"2026-02-24T08:23:39.137696+0000","last_active":"2026-02-24T08:23:55.029530+0000","last_peered":"2026-02-24T08:23:55.029530+0000","last_clean":"2026-02-24T08:23:55.029530+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:55.029530+0000","last_undegraded":"2026-02-24T08:23:55.029530+0000","last_fullsized":"2026-02-24T08:23:55.029530+0000","mapping_epoch":39,"log_start":"43'12800","ondisk_log_start":"43'12800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19008","last_scrub_stamp":"2026-02-24T08:23:39.137654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:39.137654+0000","objects_scrubbed":2373,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:46.178505+0000","scrub_duration":464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187236352,"num_objects":2857,"num_object_clones":0,"num_object_copies":8571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22856,"num_write_kb":182848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"48'22560","reported_seq":22618,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:54.875438+0000","last_change":"2026-02-24T08:23:34.668724+0000","last_active":"2026-02-24T08:23:54.875438+0000","last_peered":"2026-02-24T08:23:54.875438+0000","last_clean":"2026-02-24T08:23:54.875438+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:54.875438+0000","last_undegraded":"2026-02-24T08:23:54.875438+0000","last_fullsized":"2026-02-24T08:23:54.875438+0000","mapping_epoch":39,"log_start":"41'12500","ondisk_log_start":"41'12500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'18240","last_scrub_stamp":"2026-02-24T08:23:34.668671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:34.668671+0000","objects_scrubbed":2275,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:37.815374+0000","scrub_duration":966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184811520,"num_objects":2820,"num_object_clones":0,"num_object_copies":8460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22560,"num_write_kb":180480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"48'22949","reported_seq":22979,"reported_epoch":48,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:23:55.295297+0000","last_change":"2026-02-24T08:23:54.408548+0000","last_active":"2026-02-24T08:23:55.295297+0000","last_peered":"2026-02-24T08:23:55.295297+0000","last_clean":"2026-02-24T08:23:55.295297+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:55.295297+0000","last_undegraded":"2026-02-24T08:23:55.295297+0000","last_fullsized":"2026-02-24T08:23:55.295297+0000","mapping_epoch":39,"log_start":"41'12900","ondisk_log_start":"41'12900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":1050,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187998208,"num_objects":2869,"num_object_clones":0,"num_object_copies":8607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2869,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22949,"num_write_kb":183592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'23114","reported_seq":23174,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.333727+0000","last_change":"2026-02-24T08:23:41.042420+0000","last_active":"2026-02-24T08:23:55.333727+0000","last_peered":"2026-02-24T08:23:55.333727+0000","last_clean":"2026-02-24T08:23:55.333727+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:55.333727+0000","last_undegraded":"2026-02-24T08:23:55.333727+0000","last_fullsized":"2026-02-24T08:23:55.333727+0000","mapping_epoch":39,"log_start":"41'13100","ondisk_log_start":"41'13100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20238","last_scrub_stamp":"2026-02-24T08:23:41.042354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:41.042354+0000","objects_scrubbed":2526,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:02.398622+0000","scrub_duration":573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189349888,"num_objects":2890,"num_object_clones":0,"num_object_copies":8670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23114,"num_write_kb":184912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":106,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:54.804953+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:54.804953+0000","last_peered":"2026-02-24T08:23:54.804953+0000","last_clean":"2026-02-24T08:23:54.804953+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:54.804953+0000","last_undegraded":"2026-02-24T08:23:54.804953+0000","last_fullsized":"2026-02-24T08:23:54.804953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3011207168,"num_objects":45950,"num_object_clones":0,"num_object_copies":137850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367579,"num_write_kb":2940632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9029705728,"data_stored":9029705728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160879,"ondisk_log_size":160879,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9536,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2930192,"kb_used_data":1831804,"kb_used_omap":21,"kb_used_meta":1098346,"kb_avail":731073008,"statfs":{"total":751619276800,"available":748618760192,"internally_reserved":0,"allocated":1875767296,"data_stored":1875447522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21887,"internal_metadata":1124706945},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444079,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3647916,"kb_used_data":2565848,"kb_used_omap":25,"kb_used_meta":1082022,"kb_avail":730355284,"statfs":{"total":751619276800,"available":747883810816,"internally_reserved":0,"allocated":2627428352,"data_stored":2627116457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":1107991440},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3050440,"kb_used_data":2005108,"kb_used_omap":27,"kb_used_meta":1045284,"kb_avail":730952760,"statfs":{"total":751619276800,"available":748495626240,"internally_reserved":0,"allocated":2053230592,"data_stored":2052922249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27665,"internal_metadata":1070371823},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,13,8,8,0,20],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3423652,"kb_used_data":2377488,"kb_used_omap":29,"kb_used_meta":1046114,"kb_avail":730579548,"statfs":{"total":751619276800,"available":748113457152,"internally_reserved":0,"allocated":2434547712,"data_stored":2434235817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30269,"internal_metadata":1071221187},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9536,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2442674176,"data_stored":2442674176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2071183360,"data_stored":2071183360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2636029952,"data_stored":2636029952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1879818240,"data_stored":1879818240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:56.861 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:23:56.861 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:23:56.861 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T08:23:56.862 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:23:56.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 85 127 373617 373490 34.3251 26.1875 0.0328575 0.0291226 2026-02-24T08:23:57.015 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:57.075 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4254214396' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:23:57.075 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:56 trial105 ceph-mon[39442]: osdmap e49: 4 total, 4 up, 4 in 2026-02-24T08:23:57.075 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:56 trial105 ceph-mon[39442]: 3.0 scrub ok 2026-02-24T08:23:57.154 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:57.152+0000 7ff6b3122640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:57.154 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:57.152+0000 7ff6b3122640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:57.307 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:23:57.307 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:23:57.355 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2026-02-24T08:23:56.714673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3011797536,"num_objects":45952,"num_object_clones":0,"num_object_copies":137856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45952,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":367714,"num_write_kb":2942782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160978,"ondisk_log_size":160978,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13052200,"kb_used_data":8780248,"kb_used_omap":103,"kb_used_meta":4271768,"kb_avail":2922960600,"statfs":{"total":3006477107200,"available":2993111654400,"internally_reserved":0,"allocated":8990973952,"data_stored":8989722045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":105533,"internal_metadata":4374291395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,13,8,8,0,20],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":134586368,"num_objects":2055,"num_object_clones":0,"num_object_copies":6165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16429,"num_write_kb":131432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.918791"},"pg_stats":[{"pgid":"3.f","version":"48'23003","reported_seq":23062,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.080051+0000","last_change":"2026-02-24T08:23:53.395926+0000","last_active":"2026-02-24T08:23:55.080051+0000","last_peered":"2026-02-24T08:23:55.080051+0000","last_clean":"2026-02-24T08:23:55.080051+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:23:55.080051+0000","last_undegraded":"2026-02-24T08:23:55.080051+0000","last_fullsized":"2026-02-24T08:23:55.080051+0000","mapping_epoch":39,"log_start":"42'13000","ondisk_log_start":"42'13000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22656","last_scrub_stamp":"2026-02-24T08:23:53.395879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:53.395879+0000","objects_scrubbed":2828,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.122475+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188440576,"num_objects":2876,"num_object_clones":0,"num_object_copies":8628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23003,"num_write_kb":184024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'22792","reported_seq":22854,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.076293+0000","last_change":"2026-02-24T08:23:48.485242+0000","last_active":"2026-02-24T08:23:55.076293+0000","last_peered":"2026-02-24T08:23:55.076293+0000","last_clean":"2026-02-24T08:23:55.076293+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:23:55.076293+0000","last_undegraded":"2026-02-24T08:23:55.076293+0000","last_fullsized":"2026-02-24T08:23:55.076293+0000","mapping_epoch":39,"log_start":"41'12700","ondisk_log_start":"41'12700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21369","last_scrub_stamp":"2026-02-24T08:23:48.485131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:48.485131+0000","objects_scrubbed":2663,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:49.324274+0000","scrub_duration":801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186712064,"num_objects":2849,"num_object_clones":0,"num_object_copies":8547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2849,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22792,"num_write_kb":182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"48'22927","reported_seq":22987,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.195476+0000","last_change":"2026-02-24T08:23:52.409060+0000","last_active":"2026-02-24T08:23:55.195476+0000","last_peered":"2026-02-24T08:23:55.195476+0000","last_clean":"2026-02-24T08:23:55.195476+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:23:55.195476+0000","last_undegraded":"2026-02-24T08:23:55.195476+0000","last_fullsized":"2026-02-24T08:23:55.195476+0000","mapping_epoch":39,"log_start":"41'12900","ondisk_log_start":"41'12900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22408","last_scrub_stamp":"2026-02-24T08:23:52.408922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.408922+0000","objects_scrubbed":2777,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.952734+0000","scrub_duration":1473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187817984,"num_objects":2866,"num_object_clones":0,"num_object_copies":8598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2866,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22927,"num_write_kb":183416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"48'22480","reported_seq":22545,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.185233+0000","last_change":"2026-02-24T08:23:55.156896+0000","last_active":"2026-02-24T08:23:55.185233+0000","last_peered":"2026-02-24T08:23:55.185233+0000","last_clean":"2026-02-24T08:23:55.185233+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:23:55.185233+0000","last_undegraded":"2026-02-24T08:23:55.185233+0000","last_fullsized":"2026-02-24T08:23:55.185233+0000","mapping_epoch":39,"log_start":"42'12400","ondisk_log_start":"42'12400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'22472","last_scrub_stamp":"2026-02-24T08:23:55.156822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:55.156822+0000","objects_scrubbed":2797,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:16.905128+0000","scrub_duration":1274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184156160,"num_objects":2810,"num_object_clones":0,"num_object_copies":8430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22480,"num_write_kb":179840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"48'22784","reported_seq":22841,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.337950+0000","last_change":"2026-02-24T08:23:46.810453+0000","last_active":"2026-02-24T08:23:55.337950+0000","last_peered":"2026-02-24T08:23:55.337950+0000","last_clean":"2026-02-24T08:23:55.337950+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:23:55.337950+0000","last_undegraded":"2026-02-24T08:23:55.337950+0000","last_fullsized":"2026-02-24T08:23:55.337950+0000","mapping_epoch":39,"log_start":"41'12700","ondisk_log_start":"41'12700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21080","last_scrub_stamp":"2026-02-24T08:23:46.810392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:46.810392+0000","objects_scrubbed":2607,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:01.823881+0000","scrub_duration":1259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186646528,"num_objects":2848,"num_object_clones":0,"num_object_copies":8544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22784,"num_write_kb":182272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"48'22896","reported_seq":22960,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.171737+0000","last_change":"2026-02-24T08:23:52.943894+0000","last_active":"2026-02-24T08:23:55.171737+0000","last_peered":"2026-02-24T08:23:55.171737+0000","last_clean":"2026-02-24T08:23:55.171737+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:23:55.171737+0000","last_undegraded":"2026-02-24T08:23:55.171737+0000","last_fullsized":"2026-02-24T08:23:55.171737+0000","mapping_epoch":39,"log_start":"42'12800","ondisk_log_start":"42'12800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22488","last_scrub_stamp":"2026-02-24T08:23:52.943848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.943848+0000","objects_scrubbed":2804,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:06.784781+0000","scrub_duration":1056,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187564032,"num_objects":2862,"num_object_clones":0,"num_object_copies":8586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22896,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"48'23584","reported_seq":23643,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.200123+0000","last_change":"2026-02-24T08:23:40.659816+0000","last_active":"2026-02-24T08:23:55.200123+0000","last_peered":"2026-02-24T08:23:55.200123+0000","last_clean":"2026-02-24T08:23:55.200123+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:23:55.200123+0000","last_undegraded":"2026-02-24T08:23:55.200123+0000","last_fullsized":"2026-02-24T08:23:55.200123+0000","mapping_epoch":39,"log_start":"43'13500","ondisk_log_start":"43'13500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20376","last_scrub_stamp":"2026-02-24T08:23:40.659760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:40.659760+0000","objects_scrubbed":2535,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:44.100357+0000","scrub_duration":636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193200128,"num_objects":2948,"num_object_clones":0,"num_object_copies":8844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23584,"num_write_kb":188672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"48'23128","reported_seq":23187,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.336913+0000","last_change":"2026-02-24T08:23:38.342118+0000","last_active":"2026-02-24T08:23:55.336913+0000","last_peered":"2026-02-24T08:23:55.336913+0000","last_clean":"2026-02-24T08:23:55.336913+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:23:55.336913+0000","last_undegraded":"2026-02-24T08:23:55.336913+0000","last_fullsized":"2026-02-24T08:23:55.336913+0000","mapping_epoch":39,"log_start":"42'13100","ondisk_log_start":"42'13100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19184","last_scrub_stamp":"2026-02-24T08:23:38.342009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:38.342009+0000","objects_scrubbed":2388,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.378916+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189464576,"num_objects":2891,"num_object_clones":0,"num_object_copies":8673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2891,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23128,"num_write_kb":185024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"48'23064","reported_seq":23127,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.243034+0000","last_change":"2026-02-24T08:23:50.046655+0000","last_active":"2026-02-24T08:23:55.243034+0000","last_peered":"2026-02-24T08:23:55.243034+0000","last_clean":"2026-02-24T08:23:55.243034+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:23:55.243034+0000","last_undegraded":"2026-02-24T08:23:55.243034+0000","last_fullsized":"2026-02-24T08:23:55.243034+0000","mapping_epoch":39,"log_start":"41'13000","ondisk_log_start":"41'13000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'22024","last_scrub_stamp":"2026-02-24T08:23:50.046592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:50.046592+0000","objects_scrubbed":2743,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.450660+0000","scrub_duration":561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188940288,"num_objects":2883,"num_object_clones":0,"num_object_copies":8649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23064,"num_write_kb":184512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"48'23726","reported_seq":23783,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:54.956646+0000","last_change":"2026-02-24T08:23:44.128672+0000","last_active":"2026-02-24T08:23:54.956646+0000","last_peered":"2026-02-24T08:23:54.956646+0000","last_clean":"2026-02-24T08:23:54.956646+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:54.956646+0000","last_undegraded":"2026-02-24T08:23:54.956646+0000","last_fullsized":"2026-02-24T08:23:54.956646+0000","mapping_epoch":39,"log_start":"43'13700","ondisk_log_start":"43'13700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21088","last_scrub_stamp":"2026-02-24T08:23:44.128612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:44.128612+0000","objects_scrubbed":2631,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:08.319563+0000","scrub_duration":570,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194363392,"num_objects":2966,"num_object_clones":0,"num_object_copies":8898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23726,"num_write_kb":189808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"48'22700","reported_seq":22728,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.065309+0000","last_change":"2026-02-24T08:22:30.845964+0000","last_active":"2026-02-24T08:23:55.065309+0000","last_peered":"2026-02-24T08:23:55.065309+0000","last_clean":"2026-02-24T08:23:55.065309+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:23:55.065309+0000","last_undegraded":"2026-02-24T08:23:55.065309+0000","last_fullsized":"2026-02-24T08:23:55.065309+0000","mapping_epoch":39,"log_start":"41'12600","ondisk_log_start":"41'12600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185958400,"num_objects":2838,"num_object_clones":0,"num_object_copies":8514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2838,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22700,"num_write_kb":181600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"48'23016","reported_seq":23044,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.318105+0000","last_change":"2026-02-24T08:22:30.844739+0000","last_active":"2026-02-24T08:23:55.318105+0000","last_peered":"2026-02-24T08:23:55.318105+0000","last_clean":"2026-02-24T08:23:55.318105+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:23:55.318105+0000","last_undegraded":"2026-02-24T08:23:55.318105+0000","last_fullsized":"2026-02-24T08:23:55.318105+0000","mapping_epoch":39,"log_start":"41'13000","ondisk_log_start":"41'13000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188547072,"num_objects":2877,"num_object_clones":0,"num_object_copies":8631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23016,"num_write_kb":184128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"48'22856","reported_seq":22916,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.029530+0000","last_change":"2026-02-24T08:23:39.137696+0000","last_active":"2026-02-24T08:23:55.029530+0000","last_peered":"2026-02-24T08:23:55.029530+0000","last_clean":"2026-02-24T08:23:55.029530+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:23:55.029530+0000","last_undegraded":"2026-02-24T08:23:55.029530+0000","last_fullsized":"2026-02-24T08:23:55.029530+0000","mapping_epoch":39,"log_start":"43'12800","ondisk_log_start":"43'12800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19008","last_scrub_stamp":"2026-02-24T08:23:39.137654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:39.137654+0000","objects_scrubbed":2373,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:46.178505+0000","scrub_duration":464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187236352,"num_objects":2857,"num_object_clones":0,"num_object_copies":8571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22856,"num_write_kb":182848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"48'22560","reported_seq":22618,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:54.875438+0000","last_change":"2026-02-24T08:23:34.668724+0000","last_active":"2026-02-24T08:23:54.875438+0000","last_peered":"2026-02-24T08:23:54.875438+0000","last_clean":"2026-02-24T08:23:54.875438+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:54.875438+0000","last_undegraded":"2026-02-24T08:23:54.875438+0000","last_fullsized":"2026-02-24T08:23:54.875438+0000","mapping_epoch":39,"log_start":"41'12500","ondisk_log_start":"41'12500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'18240","last_scrub_stamp":"2026-02-24T08:23:34.668671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:34.668671+0000","objects_scrubbed":2275,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:37.815374+0000","scrub_duration":966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184811520,"num_objects":2820,"num_object_clones":0,"num_object_copies":8460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22560,"num_write_kb":180480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"48'22949","reported_seq":22979,"reported_epoch":48,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:23:55.295297+0000","last_change":"2026-02-24T08:23:54.408548+0000","last_active":"2026-02-24T08:23:55.295297+0000","last_peered":"2026-02-24T08:23:55.295297+0000","last_clean":"2026-02-24T08:23:55.295297+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:23:55.295297+0000","last_undegraded":"2026-02-24T08:23:55.295297+0000","last_fullsized":"2026-02-24T08:23:55.295297+0000","mapping_epoch":39,"log_start":"41'12900","ondisk_log_start":"41'12900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":1050,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187998208,"num_objects":2869,"num_object_clones":0,"num_object_copies":8607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2869,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22949,"num_write_kb":183592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'23114","reported_seq":23174,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.333727+0000","last_change":"2026-02-24T08:23:41.042420+0000","last_active":"2026-02-24T08:23:55.333727+0000","last_peered":"2026-02-24T08:23:55.333727+0000","last_clean":"2026-02-24T08:23:55.333727+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:23:55.333727+0000","last_undegraded":"2026-02-24T08:23:55.333727+0000","last_fullsized":"2026-02-24T08:23:55.333727+0000","mapping_epoch":39,"log_start":"41'13100","ondisk_log_start":"41'13100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20238","last_scrub_stamp":"2026-02-24T08:23:41.042354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:41.042354+0000","objects_scrubbed":2526,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:02.398622+0000","scrub_duration":573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189349888,"num_objects":2890,"num_object_clones":0,"num_object_copies":8670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2890,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23114,"num_write_kb":184912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":106,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-24T08:23:54.804953+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:54.804953+0000","last_peered":"2026-02-24T08:23:54.804953+0000","last_clean":"2026-02-24T08:23:54.804953+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:54.804953+0000","last_undegraded":"2026-02-24T08:23:54.804953+0000","last_fullsized":"2026-02-24T08:23:54.804953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3011207168,"num_objects":45950,"num_object_clones":0,"num_object_copies":137850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367579,"num_write_kb":2940632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9029705728,"data_stored":9029705728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160879,"ondisk_log_size":160879,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9536,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247853,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2930192,"kb_used_data":1831804,"kb_used_omap":21,"kb_used_meta":1098346,"kb_avail":731073008,"statfs":{"total":751619276800,"available":748618760192,"internally_reserved":0,"allocated":1875767296,"data_stored":1875447522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21887,"internal_metadata":1124706945},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444079,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3647916,"kb_used_data":2565848,"kb_used_omap":25,"kb_used_meta":1082022,"kb_avail":730355284,"statfs":{"total":751619276800,"available":747883810816,"internally_reserved":0,"allocated":2627428352,"data_stored":2627116457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25712,"internal_metadata":1107991440},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3050440,"kb_used_data":2005108,"kb_used_omap":27,"kb_used_meta":1045284,"kb_avail":730952760,"statfs":{"total":751619276800,"available":748495626240,"internally_reserved":0,"allocated":2053230592,"data_stored":2052922249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27665,"internal_metadata":1070371823},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,13,8,8,0,20],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3423652,"kb_used_data":2377488,"kb_used_omap":29,"kb_used_meta":1046114,"kb_avail":730579548,"statfs":{"total":751619276800,"available":748113457152,"internally_reserved":0,"allocated":2434547712,"data_stored":2434235817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30269,"internal_metadata":1071221187},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9536,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2442674176,"data_stored":2442674176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2071183360,"data_stored":2071183360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2636029952,"data_stored":2636029952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1879818240,"data_stored":1879818240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:23:57.356 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:23:57.356 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 56 2026-02-24T08:23:57.501 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:57.644 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:57.641+0000 7f7cf8c3f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:57.644 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:57.641+0000 7f7cf8c3f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:57.741 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:23:57.788 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:23:57.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:23:57.883 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:23:57.910 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:57 trial105 ceph-mon[39442]: from='client.14671 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:57.910 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:57 trial105 ceph-mon[39442]: pgmap v130: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.34k op/s 2026-02-24T08:23:57.910 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:57 trial105 ceph-mon[39442]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:57.910 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:57 trial105 ceph-mon[39442]: 3.4 scrub ok 2026-02-24T08:23:57.910 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/959148244' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T08:23:57.938 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 86 128 376876 376748 34.2219 25.4531 0.052603 0.0292048 2026-02-24T08:23:58.002 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:57.999+0000 7f411bedd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:58.002 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:23:58.000+0000 7f411bedd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:23:58.016 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:23:58.016 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:23:58.031 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:23:58.031 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:23:58.043 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:23:58.043 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:23:58.055 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:23:58.055 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:23:58.938 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 87 128 380444 380316 34.1489 27.875 0.0209657 0.0292745 2026-02-24T08:23:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:58 trial105 ceph-mon[39442]: from='client.14675 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:23:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1440451116' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:23:59.813 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:23:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:23:59] "GET /metrics HTTP/1.1" 200 4213 "" "Prometheus/3.6.0" 2026-02-24T08:23:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:23:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:23:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:23:59.938 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 88 128 384117 383989 34.0869 28.6953 0.0186748 0.0293257 2026-02-24T08:24:00.105 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:00.132 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:59 trial105 ceph-mon[39442]: pgmap v131: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.74k op/s 2026-02-24T08:24:00.132 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:23:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:24:00.264 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:00.386 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:00.383+0000 7fc53f592640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:00.387 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:00.384+0000 7fc53f592640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:00.403 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:00.403 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:00.418 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:00.419 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:00.433 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:00.434 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:00.448 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:00.449 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:00.938 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 89 128 387675 387547 34.0162 27.7969 0.00835354 0.0293883 2026-02-24T08:24:01.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:00 trial105 ceph-mon[39442]: 3.5 scrub starts 2026-02-24T08:24:01.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1219537574' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:01.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:00 trial105 ceph-mon[39442]: 3.5 scrub ok 2026-02-24T08:24:01.938 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 90 86 391054 390968 33.9352 26.7266 0.0268279 0.0294563 2026-02-24T08:24:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:01 trial105 ceph-mon[39442]: pgmap v132: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.9 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 38 MiB/s wr, 4.88k op/s 2026-02-24T08:24:02.504 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:02.622 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:02.719 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:02.716+0000 7f88705c7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:02.719 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:02.717+0000 7f88705c7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:02.731 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:02.732 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:02.742 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:02.742 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:02.753 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:02.753 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:02.763 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:02.763 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:02.829 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:24:02.829 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:24:02.830 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:24:02.830 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:24:02.938 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total time run: 90.0462 2026-02-24T08:24:02.939 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total writes made: 391054 2026-02-24T08:24:02.939 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Write size: 8192 2026-02-24T08:24:02.939 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object size: 65536 2026-02-24T08:24:02.939 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Bandwidth (MB/sec): 33.9282 2026-02-24T08:24:02.939 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Bandwidth: 13.7861 2026-02-24T08:24:02.939 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max bandwidth (MB/sec): 83.6406 2026-02-24T08:24:02.939 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min bandwidth (MB/sec): 21.125 2026-02-24T08:24:02.939 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average IOPS: 4342 2026-02-24T08:24:02.939 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev IOPS: 1764.62 2026-02-24T08:24:02.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max IOPS: 10706 2026-02-24T08:24:02.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min IOPS: 2704 2026-02-24T08:24:02.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average Latency(s): 0.0294636 2026-02-24T08:24:02.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Latency(s): 0.0228752 2026-02-24T08:24:02.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max latency(s): 0.242938 2026-02-24T08:24:02.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min latency(s): 0.000724324 2026-02-24T08:24:02.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:24:02.945 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:03.037 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2022776714' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:03.094 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:03.089+0000 7fd2f1ea5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:03.096 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:03.093+0000 7fd2f1ea5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:03.273 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:24:03.273 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:24:03.322 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2026-02-24T08:24:02.715461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3153953312,"num_objects":48121,"num_object_clones":0,"num_object_copies":144363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48121,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":385067,"num_write_kb":3081606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160831,"ondisk_log_size":160831,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13504132,"kb_used_data":9196084,"kb_used_omap":107,"kb_used_meta":4307860,"kb_avail":2922508668,"statfs":{"total":3006477107200,"available":2992648876032,"internally_reserved":0,"allocated":9416790016,"data_stored":9415482956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":110105,"internal_metadata":4411249127},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":276742144,"num_objects":4224,"num_object_clones":0,"num_object_copies":12672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4224,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33782,"num_write_kb":270256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001048"},"pg_stats":[{"pgid":"3.f","version":"49'24012","reported_seq":24072,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.080765+0000","last_change":"2026-02-24T08:23:53.395926+0000","last_active":"2026-02-24T08:24:00.080765+0000","last_peered":"2026-02-24T08:24:00.080765+0000","last_clean":"2026-02-24T08:24:00.080765+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:24:00.080765+0000","last_undegraded":"2026-02-24T08:24:00.080765+0000","last_fullsized":"2026-02-24T08:24:00.080765+0000","mapping_epoch":39,"log_start":"45'14000","ondisk_log_start":"45'14000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22656","last_scrub_stamp":"2026-02-24T08:23:53.395879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:53.395879+0000","objects_scrubbed":2828,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.122475+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196706304,"num_objects":3002,"num_object_clones":0,"num_object_copies":9006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24012,"num_write_kb":192096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'23864","reported_seq":23928,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.073587+0000","last_change":"2026-02-24T08:23:48.485242+0000","last_active":"2026-02-24T08:24:00.073587+0000","last_peered":"2026-02-24T08:24:00.073587+0000","last_clean":"2026-02-24T08:24:00.073587+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:24:00.073587+0000","last_undegraded":"2026-02-24T08:24:00.073587+0000","last_fullsized":"2026-02-24T08:24:00.073587+0000","mapping_epoch":39,"log_start":"44'13800","ondisk_log_start":"44'13800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21369","last_scrub_stamp":"2026-02-24T08:23:48.485131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:48.485131+0000","objects_scrubbed":2663,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:49.324274+0000","scrub_duration":801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195493888,"num_objects":2983,"num_object_clones":0,"num_object_copies":8949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2983,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23864,"num_write_kb":190912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'24064","reported_seq":24130,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.171984+0000","last_change":"2026-02-24T08:23:52.409060+0000","last_active":"2026-02-24T08:24:00.171984+0000","last_peered":"2026-02-24T08:24:00.171984+0000","last_clean":"2026-02-24T08:24:00.171984+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:24:00.171984+0000","last_undegraded":"2026-02-24T08:24:00.171984+0000","last_fullsized":"2026-02-24T08:24:00.171984+0000","mapping_epoch":39,"log_start":"45'14000","ondisk_log_start":"45'14000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22408","last_scrub_stamp":"2026-02-24T08:23:52.408922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.408922+0000","objects_scrubbed":2777,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.952734+0000","scrub_duration":1473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":3008,"num_object_clones":0,"num_object_copies":9024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24064,"num_write_kb":192512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'23616","reported_seq":23682,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.206569+0000","last_change":"2026-02-24T08:23:55.156896+0000","last_active":"2026-02-24T08:24:00.206569+0000","last_peered":"2026-02-24T08:24:00.206569+0000","last_clean":"2026-02-24T08:24:00.206569+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:24:00.206569+0000","last_undegraded":"2026-02-24T08:24:00.206569+0000","last_fullsized":"2026-02-24T08:24:00.206569+0000","mapping_epoch":39,"log_start":"45'13600","ondisk_log_start":"45'13600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'22472","last_scrub_stamp":"2026-02-24T08:23:55.156822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:55.156822+0000","objects_scrubbed":2797,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:16.905128+0000","scrub_duration":1274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193462272,"num_objects":2952,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23616,"num_write_kb":188928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'23736","reported_seq":23801,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.228661+0000","last_change":"2026-02-24T08:23:46.810453+0000","last_active":"2026-02-24T08:24:00.228661+0000","last_peered":"2026-02-24T08:24:00.228661+0000","last_clean":"2026-02-24T08:24:00.228661+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:24:00.228661+0000","last_undegraded":"2026-02-24T08:24:00.228661+0000","last_fullsized":"2026-02-24T08:24:00.228661+0000","mapping_epoch":39,"log_start":"45'13700","ondisk_log_start":"45'13700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21080","last_scrub_stamp":"2026-02-24T08:23:46.810392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:46.810392+0000","objects_scrubbed":2607,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:01.823881+0000","scrub_duration":1259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194445312,"num_objects":2967,"num_object_clones":0,"num_object_copies":8901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23736,"num_write_kb":189888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'23904","reported_seq":23969,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.204055+0000","last_change":"2026-02-24T08:23:52.943894+0000","last_active":"2026-02-24T08:24:00.204055+0000","last_peered":"2026-02-24T08:24:00.204055+0000","last_clean":"2026-02-24T08:24:00.204055+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:24:00.204055+0000","last_undegraded":"2026-02-24T08:24:00.204055+0000","last_fullsized":"2026-02-24T08:24:00.204055+0000","mapping_epoch":39,"log_start":"45'13900","ondisk_log_start":"45'13900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22488","last_scrub_stamp":"2026-02-24T08:23:52.943848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.943848+0000","objects_scrubbed":2804,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:06.784781+0000","scrub_duration":1056,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195821568,"num_objects":2988,"num_object_clones":0,"num_object_copies":8964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2988,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23904,"num_write_kb":191232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'24712","reported_seq":24771,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.206066+0000","last_change":"2026-02-24T08:23:40.659816+0000","last_active":"2026-02-24T08:24:00.206066+0000","last_peered":"2026-02-24T08:24:00.206066+0000","last_clean":"2026-02-24T08:24:00.206066+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:24:00.206066+0000","last_undegraded":"2026-02-24T08:24:00.206066+0000","last_fullsized":"2026-02-24T08:24:00.206066+0000","mapping_epoch":39,"log_start":"45'14700","ondisk_log_start":"45'14700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20376","last_scrub_stamp":"2026-02-24T08:23:40.659760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:40.659760+0000","objects_scrubbed":2535,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:44.100357+0000","scrub_duration":636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202440704,"num_objects":3089,"num_object_clones":0,"num_object_copies":9267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3089,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24712,"num_write_kb":197696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'24136","reported_seq":24197,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.311346+0000","last_change":"2026-02-24T08:23:38.342118+0000","last_active":"2026-02-24T08:24:00.311346+0000","last_peered":"2026-02-24T08:24:00.311346+0000","last_clean":"2026-02-24T08:24:00.311346+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:24:00.311346+0000","last_undegraded":"2026-02-24T08:24:00.311346+0000","last_fullsized":"2026-02-24T08:24:00.311346+0000","mapping_epoch":39,"log_start":"45'14100","ondisk_log_start":"45'14100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19184","last_scrub_stamp":"2026-02-24T08:23:38.342009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:38.342009+0000","objects_scrubbed":2388,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.378916+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197722112,"num_objects":3017,"num_object_clones":0,"num_object_copies":9051,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24136,"num_write_kb":193088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'24320","reported_seq":24385,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.337101+0000","last_change":"2026-02-24T08:23:50.046655+0000","last_active":"2026-02-24T08:24:00.337101+0000","last_peered":"2026-02-24T08:24:00.337101+0000","last_clean":"2026-02-24T08:24:00.337101+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:24:00.337101+0000","last_undegraded":"2026-02-24T08:24:00.337101+0000","last_fullsized":"2026-02-24T08:24:00.337101+0000","mapping_epoch":39,"log_start":"45'14300","ondisk_log_start":"45'14300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'22024","last_scrub_stamp":"2026-02-24T08:23:50.046592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:50.046592+0000","objects_scrubbed":2743,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.450660+0000","scrub_duration":561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199229440,"num_objects":3040,"num_object_clones":0,"num_object_copies":9120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3040,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24320,"num_write_kb":194560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'24768","reported_seq":24832,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:23:59.867729+0000","last_change":"2026-02-24T08:23:44.128672+0000","last_active":"2026-02-24T08:23:59.867729+0000","last_peered":"2026-02-24T08:23:59.867729+0000","last_clean":"2026-02-24T08:23:59.867729+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:23:59.867729+0000","last_undegraded":"2026-02-24T08:23:59.867729+0000","last_fullsized":"2026-02-24T08:23:59.867729+0000","mapping_epoch":39,"log_start":"45'14700","ondisk_log_start":"45'14700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21088","last_scrub_stamp":"2026-02-24T08:23:44.128612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:44.128612+0000","objects_scrubbed":2631,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:08.319563+0000","scrub_duration":570,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202899456,"num_objects":3096,"num_object_clones":0,"num_object_copies":9288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24768,"num_write_kb":198144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'23908","reported_seq":23955,"reported_epoch":49,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:24:00.089585+0000","last_change":"2026-02-24T08:23:59.739387+0000","last_active":"2026-02-24T08:24:00.089585+0000","last_peered":"2026-02-24T08:24:00.089585+0000","last_clean":"2026-02-24T08:24:00.089585+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:24:00.089585+0000","last_undegraded":"2026-02-24T08:24:00.089585+0000","last_fullsized":"2026-02-24T08:24:00.089585+0000","mapping_epoch":39,"log_start":"45'13900","ondisk_log_start":"45'13900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:22:29.830158+0000","objects_scrubbed":1599,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195854336,"num_objects":2989,"num_object_clones":0,"num_object_copies":8967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2989,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23908,"num_write_kb":191264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'24228","reported_seq":24293,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.342658+0000","last_change":"2026-02-24T08:23:57.257940+0000","last_active":"2026-02-24T08:24:00.342658+0000","last_peered":"2026-02-24T08:24:00.342658+0000","last_clean":"2026-02-24T08:24:00.342658+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:24:00.342658+0000","last_undegraded":"2026-02-24T08:24:00.342658+0000","last_fullsized":"2026-02-24T08:24:00.342658+0000","mapping_epoch":39,"log_start":"45'14200","ondisk_log_start":"45'14200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'23496","last_scrub_stamp":"2026-02-24T08:23:57.257894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:57.257894+0000","objects_scrubbed":2901,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:57.850098+0000","scrub_duration":1891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198475776,"num_objects":3029,"num_object_clones":0,"num_object_copies":9087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3029,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24228,"num_write_kb":193824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'23975","reported_seq":24033,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.089863+0000","last_change":"2026-02-24T08:23:39.137696+0000","last_active":"2026-02-24T08:24:00.089863+0000","last_peered":"2026-02-24T08:24:00.089863+0000","last_clean":"2026-02-24T08:24:00.089863+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:24:00.089863+0000","last_undegraded":"2026-02-24T08:24:00.089863+0000","last_fullsized":"2026-02-24T08:24:00.089863+0000","mapping_epoch":39,"log_start":"45'13900","ondisk_log_start":"45'13900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19008","last_scrub_stamp":"2026-02-24T08:23:39.137654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:39.137654+0000","objects_scrubbed":2373,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:46.178505+0000","scrub_duration":464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196403200,"num_objects":2997,"num_object_clones":0,"num_object_copies":8991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2997,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23975,"num_write_kb":191800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'23595","reported_seq":23648,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:23:59.957395+0000","last_change":"2026-02-24T08:23:34.668724+0000","last_active":"2026-02-24T08:23:59.957395+0000","last_peered":"2026-02-24T08:23:59.957395+0000","last_clean":"2026-02-24T08:23:59.957395+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:23:59.957395+0000","last_undegraded":"2026-02-24T08:23:59.957395+0000","last_fullsized":"2026-02-24T08:23:59.957395+0000","mapping_epoch":39,"log_start":"44'13500","ondisk_log_start":"44'13500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'18240","last_scrub_stamp":"2026-02-24T08:23:34.668671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:34.668671+0000","objects_scrubbed":2275,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:37.815374+0000","scrub_duration":966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193290240,"num_objects":2950,"num_object_clones":0,"num_object_copies":8850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23595,"num_write_kb":188760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'23998","reported_seq":24064,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.341084+0000","last_change":"2026-02-24T08:23:55.959470+0000","last_active":"2026-02-24T08:24:00.341084+0000","last_peered":"2026-02-24T08:24:00.341084+0000","last_clean":"2026-02-24T08:24:00.341084+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:24:00.341084+0000","last_undegraded":"2026-02-24T08:24:00.341084+0000","last_fullsized":"2026-02-24T08:24:00.341084+0000","mapping_epoch":39,"log_start":"45'13900","ondisk_log_start":"45'13900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'23056","last_scrub_stamp":"2026-02-24T08:23:55.959401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:55.959401+0000","objects_scrubbed":2869,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:05.293185+0000","scrub_duration":1547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196591616,"num_objects":3000,"num_object_clones":0,"num_object_copies":9000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3000,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23998,"num_write_kb":191984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'24096","reported_seq":24157,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:00.341911+0000","last_change":"2026-02-24T08:23:41.042420+0000","last_active":"2026-02-24T08:24:00.341911+0000","last_peered":"2026-02-24T08:24:00.341911+0000","last_clean":"2026-02-24T08:24:00.341911+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:24:00.341911+0000","last_undegraded":"2026-02-24T08:24:00.341911+0000","last_fullsized":"2026-02-24T08:24:00.341911+0000","mapping_epoch":39,"log_start":"44'14000","ondisk_log_start":"44'14000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20238","last_scrub_stamp":"2026-02-24T08:23:41.042354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:41.042354+0000","objects_scrubbed":2526,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:02.398622+0000","scrub_duration":573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197394432,"num_objects":3012,"num_object_clones":0,"num_object_copies":9036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24096,"num_write_kb":192768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":108,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:23:55.805801+0000","last_change":"2026-02-24T08:22:46.030099+0000","last_active":"2026-02-24T08:23:55.805801+0000","last_peered":"2026-02-24T08:23:55.805801+0000","last_clean":"2026-02-24T08:23:55.805801+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:23:55.805801+0000","last_undegraded":"2026-02-24T08:23:55.805801+0000","last_fullsized":"2026-02-24T08:23:55.805801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:22:46.030067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:22:46.030067+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:01.196976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3153362944,"num_objects":48119,"num_object_clones":0,"num_object_copies":144357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384932,"num_write_kb":3079456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9455337472,"data_stored":9455337472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160732,"ondisk_log_size":160732,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3035188,"kb_used_data":1918752,"kb_used_omap":22,"kb_used_meta":1116393,"kb_avail":730968012,"statfs":{"total":751619276800,"available":748511244288,"internally_reserved":0,"allocated":1964802048,"data_stored":1964474395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22553,"internal_metadata":1143187431},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444080,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3786396,"kb_used_data":2686280,"kb_used_omap":26,"kb_used_meta":1100069,"kb_avail":730216804,"statfs":{"total":751619276800,"available":747742007296,"internally_reserved":0,"allocated":2750750720,"data_stored":2750423067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27014,"internal_metadata":1126471290},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3142656,"kb_used_data":2097324,"kb_used_omap":28,"kb_used_meta":1045283,"kb_avail":730860544,"statfs":{"total":751619276800,"available":748401197056,"internally_reserved":0,"allocated":2147659776,"data_stored":2147335675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28967,"internal_metadata":1070370521},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3539892,"kb_used_data":2493728,"kb_used_omap":30,"kb_used_meta":1046113,"kb_avail":730463308,"statfs":{"total":751619276800,"available":747994427392,"internally_reserved":0,"allocated":2553577472,"data_stored":2553249819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31571,"internal_metadata":1071219885},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2558967808,"data_stored":2558967808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2167603200,"data_stored":2167603200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2758582272,"data_stored":2758582272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1970184192,"data_stored":1970184192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:24:03.324 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 81 2026-02-24T08:24:03.469 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:03.600 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:03.597+0000 7f9d4cf48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:03.601 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:03.599+0000 7f9d4cf48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:03.763 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:24:04.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:03 trial105 ceph-mon[39442]: pgmap v133: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.9 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.22k op/s 2026-02-24T08:24:04.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1685911744' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "81"} : dispatch 2026-02-24T08:24:04.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:24:04.798 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:04.961 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:05.078 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:04 trial105 ceph-mon[39442]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:24:05.088 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:05.085+0000 7efdb2e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:05.093 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:05.089+0000 7efdb2e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:05.115 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:05.115 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:05.134 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:05.134 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:05.152 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:05.152 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:05.168 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:05.168 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:06.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:05 trial105 ceph-mon[39442]: pgmap v134: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.9 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.41k op/s 2026-02-24T08:24:06.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:05 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:24:06.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:05 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:24:06.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:05 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2887757138' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:07.225 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:07.378 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:07.511 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:07.506+0000 7f33cab61640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:07.511 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:07.506+0000 7f33cab61640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:07.530 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:07.530 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:07.545 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:07.545 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:07.562 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:07.562 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:07.579 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:07.579 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:08.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:07 trial105 ceph-mon[39442]: pgmap v135: 17 pgs: 17 active+clean; 2.5 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 93 B/s rd, 17 MiB/s wr, 2.82k op/s 2026-02-24T08:24:08.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3857884887' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:09.471 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:24:09.472 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:24:09.472 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:24:09.472 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:24:09.625 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:09.633 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:09.758 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:09.754+0000 7fd1eed14640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:09.758 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:24:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:24:09] "GET /metrics HTTP/1.1" 200 4213 "" "Prometheus/3.6.0" 2026-02-24T08:24:09.766 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:09.763+0000 7fd1eed14640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:09.788 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:09.840 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:24:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:24:09.553Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:24:09.933 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:24:09.934 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:24:10.015 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:09 trial105 ceph-mon[39442]: pgmap v136: 17 pgs: 17 active+clean; 2.5 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 15 MiB/s wr, 2.56k op/s 2026-02-24T08:24:10.288 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:10.257+0000 7f1fe678f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:10.288 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:10.258+0000 7f1fe678f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:10.289 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:10.289 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:10.296 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:10.296 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:10.312 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:10.312 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:10.327 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:10.328 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:10.630 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2026-02-24T08:24:08.716303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2724905528,"num_objects":41573,"num_object_clones":0,"num_object_copies":124719,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41573,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":398502,"num_write_kb":3130583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161066,"ondisk_log_size":161066,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12718376,"kb_used_data":8355800,"kb_used_omap":107,"kb_used_meta":4362004,"kb_avail":2923294424,"statfs":{"total":3006477107200,"available":2993453490176,"internally_reserved":0,"allocated":8556339200,"data_stored":8555019924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":110105,"internal_metadata":4466692583},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,2,3,5,0,8],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-286892008,"num_objects":-4379,"num_object_clones":0,"num_object_copies":-13137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4379,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30788,"num_write_kb":187801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001630"},"pg_stats":[{"pgid":"3.f","version":"49'24816","reported_seq":24878,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.108719+0000","last_change":"2026-02-24T08:23:53.395926+0000","last_active":"2026-02-24T08:24:05.108719+0000","last_peered":"2026-02-24T08:24:05.108719+0000","last_clean":"2026-02-24T08:24:05.108719+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:24:05.108719+0000","last_undegraded":"2026-02-24T08:24:05.108719+0000","last_fullsized":"2026-02-24T08:24:05.108719+0000","mapping_epoch":39,"log_start":"45'14800","ondisk_log_start":"45'14800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22656","last_scrub_stamp":"2026-02-24T08:23:53.395879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:53.395879+0000","objects_scrubbed":2828,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.122475+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171442176,"num_objects":2616,"num_object_clones":0,"num_object_copies":7848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2616,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24816,"num_write_kb":195072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'24698","reported_seq":24762,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.096251+0000","last_change":"2026-02-24T08:23:48.485242+0000","last_active":"2026-02-24T08:24:05.096251+0000","last_peered":"2026-02-24T08:24:05.096251+0000","last_clean":"2026-02-24T08:24:05.096251+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:24:05.096251+0000","last_undegraded":"2026-02-24T08:24:05.096251+0000","last_fullsized":"2026-02-24T08:24:05.096251+0000","mapping_epoch":39,"log_start":"45'14600","ondisk_log_start":"45'14600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21369","last_scrub_stamp":"2026-02-24T08:23:48.485131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:48.485131+0000","objects_scrubbed":2663,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:49.324274+0000","scrub_duration":801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170917888,"num_objects":2608,"num_object_clones":0,"num_object_copies":7824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24698,"num_write_kb":194176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'24789","reported_seq":24851,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.222800+0000","last_change":"2026-02-24T08:23:52.409060+0000","last_active":"2026-02-24T08:24:05.222800+0000","last_peered":"2026-02-24T08:24:05.222800+0000","last_clean":"2026-02-24T08:24:05.222800+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:24:05.222800+0000","last_undegraded":"2026-02-24T08:24:05.222800+0000","last_fullsized":"2026-02-24T08:24:05.222800+0000","mapping_epoch":39,"log_start":"45'14700","ondisk_log_start":"45'14700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22408","last_scrub_stamp":"2026-02-24T08:23:52.408922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.408922+0000","objects_scrubbed":2777,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.952734+0000","scrub_duration":1473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169148440,"num_objects":2582,"num_object_clones":0,"num_object_copies":7746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2582,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24789,"num_write_kb":194625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'24396","reported_seq":24462,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.208416+0000","last_change":"2026-02-24T08:23:55.156896+0000","last_active":"2026-02-24T08:24:05.208416+0000","last_peered":"2026-02-24T08:24:05.208416+0000","last_clean":"2026-02-24T08:24:05.208416+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:24:05.208416+0000","last_undegraded":"2026-02-24T08:24:05.208416+0000","last_fullsized":"2026-02-24T08:24:05.208416+0000","mapping_epoch":39,"log_start":"45'14300","ondisk_log_start":"45'14300","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'22472","last_scrub_stamp":"2026-02-24T08:23:55.156822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:55.156822+0000","objects_scrubbed":2797,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:16.905128+0000","scrub_duration":1274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167706624,"num_objects":2559,"num_object_clones":0,"num_object_copies":7677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24396,"num_write_kb":191680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'24637","reported_seq":24702,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.372184+0000","last_change":"2026-02-24T08:23:46.810453+0000","last_active":"2026-02-24T08:24:05.372184+0000","last_peered":"2026-02-24T08:24:05.372184+0000","last_clean":"2026-02-24T08:24:05.372184+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:24:05.372184+0000","last_undegraded":"2026-02-24T08:24:05.372184+0000","last_fullsized":"2026-02-24T08:24:05.372184+0000","mapping_epoch":39,"log_start":"45'14600","ondisk_log_start":"45'14600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21080","last_scrub_stamp":"2026-02-24T08:23:46.810392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:46.810392+0000","objects_scrubbed":2607,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:01.823881+0000","scrub_duration":1259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165478400,"num_objects":2525,"num_object_clones":0,"num_object_copies":7575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24637,"num_write_kb":193152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'24725","reported_seq":24789,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.203737+0000","last_change":"2026-02-24T08:23:52.943894+0000","last_active":"2026-02-24T08:24:05.203737+0000","last_peered":"2026-02-24T08:24:05.203737+0000","last_clean":"2026-02-24T08:24:05.203737+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:24:05.203737+0000","last_undegraded":"2026-02-24T08:24:05.203737+0000","last_fullsized":"2026-02-24T08:24:05.203737+0000","mapping_epoch":39,"log_start":"45'14700","ondisk_log_start":"45'14700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22488","last_scrub_stamp":"2026-02-24T08:23:52.943848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.943848+0000","objects_scrubbed":2804,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:06.784781+0000","scrub_duration":1056,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170328064,"num_objects":2599,"num_object_clones":0,"num_object_copies":7797,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2599,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24725,"num_write_kb":194304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'25564","reported_seq":25627,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.219887+0000","last_change":"2026-02-24T08:23:40.659816+0000","last_active":"2026-02-24T08:24:05.219887+0000","last_peered":"2026-02-24T08:24:05.219887+0000","last_clean":"2026-02-24T08:24:05.219887+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:24:05.219887+0000","last_undegraded":"2026-02-24T08:24:05.219887+0000","last_fullsized":"2026-02-24T08:24:05.219887+0000","mapping_epoch":39,"log_start":"45'15500","ondisk_log_start":"45'15500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20376","last_scrub_stamp":"2026-02-24T08:23:40.659760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:40.659760+0000","objects_scrubbed":2535,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:44.100357+0000","scrub_duration":636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172556288,"num_objects":2633,"num_object_clones":0,"num_object_copies":7899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25564,"num_write_kb":200512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'25067","reported_seq":25122,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.364817+0000","last_change":"2026-02-24T08:23:38.342118+0000","last_active":"2026-02-24T08:24:05.364817+0000","last_peered":"2026-02-24T08:24:05.364817+0000","last_clean":"2026-02-24T08:24:05.364817+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:24:05.364817+0000","last_undegraded":"2026-02-24T08:24:05.364817+0000","last_fullsized":"2026-02-24T08:24:05.364817+0000","mapping_epoch":39,"log_start":"45'15000","ondisk_log_start":"45'15000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19184","last_scrub_stamp":"2026-02-24T08:23:38.342009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:38.342009+0000","objects_scrubbed":2388,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.378916+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169148416,"num_objects":2581,"num_object_clones":0,"num_object_copies":7743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2581,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25067,"num_write_kb":196608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'25191","reported_seq":25253,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.383340+0000","last_change":"2026-02-24T08:23:50.046655+0000","last_active":"2026-02-24T08:24:05.383340+0000","last_peered":"2026-02-24T08:24:05.383340+0000","last_clean":"2026-02-24T08:24:05.383340+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:24:05.383340+0000","last_undegraded":"2026-02-24T08:24:05.383340+0000","last_fullsized":"2026-02-24T08:24:05.383340+0000","mapping_epoch":39,"log_start":"45'15100","ondisk_log_start":"45'15100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'22024","last_scrub_stamp":"2026-02-24T08:23:50.046592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:50.046592+0000","objects_scrubbed":2743,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.450660+0000","scrub_duration":561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169869312,"num_objects":2592,"num_object_clones":0,"num_object_copies":7776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25191,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'25639","reported_seq":25701,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.011571+0000","last_change":"2026-02-24T08:23:44.128672+0000","last_active":"2026-02-24T08:24:05.011571+0000","last_peered":"2026-02-24T08:24:05.011571+0000","last_clean":"2026-02-24T08:24:05.011571+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:24:05.011571+0000","last_undegraded":"2026-02-24T08:24:05.011571+0000","last_fullsized":"2026-02-24T08:24:05.011571+0000","mapping_epoch":39,"log_start":"45'15600","ondisk_log_start":"45'15600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21088","last_scrub_stamp":"2026-02-24T08:23:44.128612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:44.128612+0000","objects_scrubbed":2631,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:08.319563+0000","scrub_duration":570,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180027392,"num_objects":2747,"num_object_clones":0,"num_object_copies":8241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25639,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'24766","reported_seq":24833,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.105969+0000","last_change":"2026-02-24T08:24:00.607619+0000","last_active":"2026-02-24T08:24:05.105969+0000","last_peered":"2026-02-24T08:24:05.105969+0000","last_clean":"2026-02-24T08:24:05.105969+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:24:05.105969+0000","last_undegraded":"2026-02-24T08:24:05.105969+0000","last_fullsized":"2026-02-24T08:24:05.105969+0000","mapping_epoch":39,"log_start":"45'14700","ondisk_log_start":"45'14700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'24048","last_scrub_stamp":"2026-02-24T08:24:00.607575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:24:00.607575+0000","objects_scrubbed":2995,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:25.304021+0000","scrub_duration":814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170000384,"num_objects":2594,"num_object_clones":0,"num_object_copies":7782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24766,"num_write_kb":194560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'25037","reported_seq":25103,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.387667+0000","last_change":"2026-02-24T08:23:57.257940+0000","last_active":"2026-02-24T08:24:05.387667+0000","last_peered":"2026-02-24T08:24:05.387667+0000","last_clean":"2026-02-24T08:24:05.387667+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:24:05.387667+0000","last_undegraded":"2026-02-24T08:24:05.387667+0000","last_fullsized":"2026-02-24T08:24:05.387667+0000","mapping_epoch":39,"log_start":"45'15000","ondisk_log_start":"45'15000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'23496","last_scrub_stamp":"2026-02-24T08:23:57.257894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:57.257894+0000","objects_scrubbed":2901,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:57.850098+0000","scrub_duration":1891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171114496,"num_objects":2611,"num_object_clones":0,"num_object_copies":7833,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2611,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25037,"num_write_kb":196608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'24786","reported_seq":24844,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.096747+0000","last_change":"2026-02-24T08:23:39.137696+0000","last_active":"2026-02-24T08:24:05.096747+0000","last_peered":"2026-02-24T08:24:05.096747+0000","last_clean":"2026-02-24T08:24:05.096747+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:24:05.096747+0000","last_undegraded":"2026-02-24T08:24:05.096747+0000","last_fullsized":"2026-02-24T08:24:05.096747+0000","mapping_epoch":39,"log_start":"45'14700","ondisk_log_start":"45'14700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19008","last_scrub_stamp":"2026-02-24T08:23:39.137654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:39.137654+0000","objects_scrubbed":2373,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:46.178505+0000","scrub_duration":464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172228608,"num_objects":2628,"num_object_clones":0,"num_object_copies":7884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2628,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24786,"num_write_kb":194944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'24485","reported_seq":24541,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.003542+0000","last_change":"2026-02-24T08:23:34.668724+0000","last_active":"2026-02-24T08:24:05.003542+0000","last_peered":"2026-02-24T08:24:05.003542+0000","last_clean":"2026-02-24T08:24:05.003542+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:24:05.003542+0000","last_undegraded":"2026-02-24T08:24:05.003542+0000","last_fullsized":"2026-02-24T08:24:05.003542+0000","mapping_epoch":39,"log_start":"45'14400","ondisk_log_start":"45'14400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'18240","last_scrub_stamp":"2026-02-24T08:23:34.668671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:34.668671+0000","objects_scrubbed":2275,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:37.815374+0000","scrub_duration":966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169541632,"num_objects":2587,"num_object_clones":0,"num_object_copies":7761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24485,"num_write_kb":192512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'24836","reported_seq":24900,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.377834+0000","last_change":"2026-02-24T08:23:55.959470+0000","last_active":"2026-02-24T08:24:05.377834+0000","last_peered":"2026-02-24T08:24:05.377834+0000","last_clean":"2026-02-24T08:24:05.377834+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:24:05.377834+0000","last_undegraded":"2026-02-24T08:24:05.377834+0000","last_fullsized":"2026-02-24T08:24:05.377834+0000","mapping_epoch":39,"log_start":"45'14800","ondisk_log_start":"45'14800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'23056","last_scrub_stamp":"2026-02-24T08:23:55.959401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:55.959401+0000","objects_scrubbed":2869,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:05.293185+0000","scrub_duration":1547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168804352,"num_objects":2576,"num_object_clones":0,"num_object_copies":7728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24836,"num_write_kb":194928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'24935","reported_seq":24993,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.373218+0000","last_change":"2026-02-24T08:23:41.042420+0000","last_active":"2026-02-24T08:24:05.373218+0000","last_peered":"2026-02-24T08:24:05.373218+0000","last_clean":"2026-02-24T08:24:05.373218+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:24:05.373218+0000","last_undegraded":"2026-02-24T08:24:05.373218+0000","last_fullsized":"2026-02-24T08:24:05.373218+0000","mapping_epoch":39,"log_start":"45'14900","ondisk_log_start":"45'14900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20238","last_scrub_stamp":"2026-02-24T08:23:41.042354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:41.042354+0000","objects_scrubbed":2526,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:02.398622+0000","scrub_duration":573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166002688,"num_objects":2533,"num_object_clones":0,"num_object_copies":7599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24935,"num_write_kb":195328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":116,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.009833+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:24:05.009833+0000","last_peered":"2026-02-24T08:24:05.009833+0000","last_clean":"2026-02-24T08:24:05.009833+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:24:05.009833+0000","last_undegraded":"2026-02-24T08:24:05.009833+0000","last_fullsized":"2026-02-24T08:24:05.009833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2724315160,"num_objects":41571,"num_object_clones":0,"num_object_copies":124713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41571,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":398367,"num_write_kb":3128433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8211034112,"data_stored":8211021896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160967,"ondisk_log_size":160967,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9072,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2819208,"kb_used_data":1702644,"kb_used_omap":22,"kb_used_meta":1116393,"kb_avail":731183992,"statfs":{"total":751619276800,"available":748732407808,"internally_reserved":0,"allocated":1743507456,"data_stored":1743175731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22553,"internal_metadata":1143187431},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444081,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3562616,"kb_used_data":2444324,"kb_used_omap":26,"kb_used_meta":1118117,"kb_avail":730440584,"statfs":{"total":751619276800,"available":747971158016,"internally_reserved":0,"allocated":2502987776,"data_stored":2502656051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27014,"internal_metadata":1144952442},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3014704,"kb_used_data":1951324,"kb_used_omap":28,"kb_used_meta":1063331,"kb_avail":730988496,"statfs":{"total":751619276800,"available":748532219904,"internally_reserved":0,"allocated":1998155776,"data_stored":1997831675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28967,"internal_metadata":1088851673},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3321848,"kb_used_data":2257508,"kb_used_omap":30,"kb_used_meta":1064161,"kb_avail":730681352,"statfs":{"total":751619276800,"available":748217704448,"internally_reserved":0,"allocated":2311688192,"data_stored":2311356467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31571,"internal_metadata":1089701037},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,2,3,5,0,8],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9072,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2255081472,"data_stored":2255077400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1849278464,"data_stored":1849278464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2406273024,"data_stored":2406268952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1700401152,"data_stored":1700397080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:24:10.632 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 81 2026-02-24T08:24:10.781 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:10.902 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1361552220' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:10.907 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:10.904+0000 7f9682aa5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:10.908 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:10.904+0000 7f9682aa5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:11.066 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:24:11.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:24:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:11 trial105 ceph-mon[39442]: from='client.14693 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:24:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:11 trial105 ceph-mon[39442]: pgmap v137: 17 pgs: 17 active+clean; 1.5 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 15 MiB/s wr, 4.00k op/s 2026-02-24T08:24:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3829674974' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "81"} : dispatch 2026-02-24T08:24:12.711 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:12.862 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:12.983 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:12.980+0000 7f0621c02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:12.983 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:12.980+0000 7f0621c02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:13.000 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:13.000 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:13.012 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:13.012 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:13.025 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:13.026 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:13.040 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:13.041 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:13 trial105 ceph-mon[39442]: pgmap v138: 17 pgs: 17 active+clean; 1.5 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 4.0 MiB/s wr, 2.55k op/s 2026-02-24T08:24:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2612817712' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:15.089 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:15.117 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:24:15.244 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:15.376 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:15.373+0000 7f28162a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:15.376 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:15.374+0000 7f28162a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:15.400 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:15.400 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:15.418 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:15.418 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:15.434 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:15.434 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:15.451 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:15.451 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:16.111 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:24:16.112 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:24:16.112 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_1 2026-02-24T08:24:16.112 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:24:16.140 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:15 trial105 ceph-mon[39442]: pgmap v139: 17 pgs: 17 active+clean; 1.5 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 4.0 MiB/s wr, 2.55k op/s 2026-02-24T08:24:16.140 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:15 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/500984835' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:16.267 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:16.392 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:16.389+0000 7f69b0fcf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:16.392 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:16.389+0000 7f69b0fcf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:16.559 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:24:16.559 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:24:16.611 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2026-02-24T08:24:14.717078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1599259192,"num_objects":24397,"num_object_clones":0,"num_object_copies":73191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24397,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":415678,"num_write_kb":3130583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160942,"ondisk_log_size":160942,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9285864,"kb_used_data":4869016,"kb_used_omap":107,"kb_used_meta":4416148,"kb_avail":2926726936,"statfs":{"total":3006477107200,"available":2996968382464,"internally_reserved":0,"allocated":4985872384,"data_stored":4984553108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":110154,"internal_metadata":4522135990},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,6,10,20,19,25,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1554694120,"num_objects":-23724,"num_object_clones":0,"num_object_copies":-71172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23724,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30611,"num_write_kb":48977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001617"},"pg_stats":[{"pgid":"3.f","version":"49'25892","reported_seq":25950,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.116278+0000","last_change":"2026-02-24T08:23:53.395926+0000","last_active":"2026-02-24T08:24:10.116278+0000","last_peered":"2026-02-24T08:24:10.116278+0000","last_clean":"2026-02-24T08:24:10.116278+0000","last_became_active":"2026-02-24T08:22:30.845377+0000","last_became_peered":"2026-02-24T08:22:30.845377+0000","last_unstale":"2026-02-24T08:24:10.116278+0000","last_undegraded":"2026-02-24T08:24:10.116278+0000","last_fullsized":"2026-02-24T08:24:10.116278+0000","mapping_epoch":39,"log_start":"45'15800","ondisk_log_start":"45'15800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22656","last_scrub_stamp":"2026-02-24T08:23:53.395879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:53.395879+0000","objects_scrubbed":2828,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.122475+0000","scrub_duration":670,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100925440,"num_objects":1540,"num_object_clones":0,"num_object_copies":4620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1540,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25892,"num_write_kb":195072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"49'25791","reported_seq":25854,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.120853+0000","last_change":"2026-02-24T08:23:48.485242+0000","last_active":"2026-02-24T08:24:10.120853+0000","last_peered":"2026-02-24T08:24:10.120853+0000","last_clean":"2026-02-24T08:24:10.120853+0000","last_became_active":"2026-02-24T08:22:30.844049+0000","last_became_peered":"2026-02-24T08:22:30.844049+0000","last_unstale":"2026-02-24T08:24:10.120853+0000","last_undegraded":"2026-02-24T08:24:10.120853+0000","last_fullsized":"2026-02-24T08:24:10.120853+0000","mapping_epoch":39,"log_start":"45'15700","ondisk_log_start":"45'15700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21369","last_scrub_stamp":"2026-02-24T08:23:48.485131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:48.485131+0000","objects_scrubbed":2663,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:49.324274+0000","scrub_duration":801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99287040,"num_objects":1515,"num_object_clones":0,"num_object_copies":4545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1515,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25791,"num_write_kb":194176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"49'25869","reported_seq":25935,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.228265+0000","last_change":"2026-02-24T08:23:52.409060+0000","last_active":"2026-02-24T08:24:10.228265+0000","last_peered":"2026-02-24T08:24:10.228265+0000","last_clean":"2026-02-24T08:24:10.228265+0000","last_became_active":"2026-02-24T08:22:30.845043+0000","last_became_peered":"2026-02-24T08:22:30.845043+0000","last_unstale":"2026-02-24T08:24:10.228265+0000","last_undegraded":"2026-02-24T08:24:10.228265+0000","last_fullsized":"2026-02-24T08:24:10.228265+0000","mapping_epoch":39,"log_start":"45'15800","ondisk_log_start":"45'15800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22408","last_scrub_stamp":"2026-02-24T08:23:52.408922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.408922+0000","objects_scrubbed":2777,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:19.952734+0000","scrub_duration":1473,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98369560,"num_objects":1502,"num_object_clones":0,"num_object_copies":4506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1502,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25869,"num_write_kb":194625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'25417","reported_seq":25479,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.213774+0000","last_change":"2026-02-24T08:23:55.156896+0000","last_active":"2026-02-24T08:24:10.213774+0000","last_peered":"2026-02-24T08:24:10.213774+0000","last_clean":"2026-02-24T08:24:10.213774+0000","last_became_active":"2026-02-24T08:22:30.844010+0000","last_became_peered":"2026-02-24T08:22:30.844010+0000","last_unstale":"2026-02-24T08:24:10.213774+0000","last_undegraded":"2026-02-24T08:24:10.213774+0000","last_fullsized":"2026-02-24T08:24:10.213774+0000","mapping_epoch":39,"log_start":"45'15400","ondisk_log_start":"45'15400","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'22472","last_scrub_stamp":"2026-02-24T08:23:55.156822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:55.156822+0000","objects_scrubbed":2797,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:16.905128+0000","scrub_duration":1274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100794368,"num_objects":1538,"num_object_clones":0,"num_object_copies":4614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25417,"num_write_kb":191680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"49'25690","reported_seq":25755,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.421906+0000","last_change":"2026-02-24T08:23:46.810453+0000","last_active":"2026-02-24T08:24:10.421906+0000","last_peered":"2026-02-24T08:24:10.421906+0000","last_clean":"2026-02-24T08:24:10.421906+0000","last_became_active":"2026-02-24T08:22:30.845258+0000","last_became_peered":"2026-02-24T08:22:30.845258+0000","last_unstale":"2026-02-24T08:24:10.421906+0000","last_undegraded":"2026-02-24T08:24:10.421906+0000","last_fullsized":"2026-02-24T08:24:10.421906+0000","mapping_epoch":39,"log_start":"45'15600","ondisk_log_start":"45'15600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21080","last_scrub_stamp":"2026-02-24T08:23:46.810392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:46.810392+0000","objects_scrubbed":2607,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:01.823881+0000","scrub_duration":1259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":1472,"num_object_clones":0,"num_object_copies":4416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25690,"num_write_kb":193152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"49'25792","reported_seq":25856,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.233814+0000","last_change":"2026-02-24T08:23:52.943894+0000","last_active":"2026-02-24T08:24:10.233814+0000","last_peered":"2026-02-24T08:24:10.233814+0000","last_clean":"2026-02-24T08:24:10.233814+0000","last_became_active":"2026-02-24T08:22:30.845300+0000","last_became_peered":"2026-02-24T08:22:30.845300+0000","last_unstale":"2026-02-24T08:24:10.233814+0000","last_undegraded":"2026-02-24T08:24:10.233814+0000","last_fullsized":"2026-02-24T08:24:10.233814+0000","mapping_epoch":39,"log_start":"45'15700","ondisk_log_start":"45'15700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'22488","last_scrub_stamp":"2026-02-24T08:23:52.943848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:52.943848+0000","objects_scrubbed":2804,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:06.784781+0000","scrub_duration":1056,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100401152,"num_objects":1532,"num_object_clones":0,"num_object_copies":4596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25792,"num_write_kb":194304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'26615","reported_seq":26679,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.217766+0000","last_change":"2026-02-24T08:23:40.659816+0000","last_active":"2026-02-24T08:24:10.217766+0000","last_peered":"2026-02-24T08:24:10.217766+0000","last_clean":"2026-02-24T08:24:10.217766+0000","last_became_active":"2026-02-24T08:22:30.845573+0000","last_became_peered":"2026-02-24T08:22:30.845573+0000","last_unstale":"2026-02-24T08:24:10.217766+0000","last_undegraded":"2026-02-24T08:24:10.217766+0000","last_fullsized":"2026-02-24T08:24:10.217766+0000","mapping_epoch":39,"log_start":"45'16600","ondisk_log_start":"45'16600","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20376","last_scrub_stamp":"2026-02-24T08:23:40.659760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:40.659760+0000","objects_scrubbed":2535,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:44.100357+0000","scrub_duration":636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103677952,"num_objects":1582,"num_object_clones":0,"num_object_copies":4746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1582,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26615,"num_write_kb":200512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"49'26149","reported_seq":26193,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.411899+0000","last_change":"2026-02-24T08:23:38.342118+0000","last_active":"2026-02-24T08:24:10.411899+0000","last_peered":"2026-02-24T08:24:10.411899+0000","last_clean":"2026-02-24T08:24:10.411899+0000","last_became_active":"2026-02-24T08:22:30.844523+0000","last_became_peered":"2026-02-24T08:22:30.844523+0000","last_unstale":"2026-02-24T08:24:10.411899+0000","last_undegraded":"2026-02-24T08:24:10.411899+0000","last_fullsized":"2026-02-24T08:24:10.411899+0000","mapping_epoch":39,"log_start":"45'16100","ondisk_log_start":"45'16100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19184","last_scrub_stamp":"2026-02-24T08:23:38.342009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:38.342009+0000","objects_scrubbed":2388,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.378916+0000","scrub_duration":850,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98238464,"num_objects":1499,"num_object_clones":0,"num_object_copies":4497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26149,"num_write_kb":196608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"49'26291","reported_seq":26352,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.434900+0000","last_change":"2026-02-24T08:23:50.046655+0000","last_active":"2026-02-24T08:24:10.434900+0000","last_peered":"2026-02-24T08:24:10.434900+0000","last_clean":"2026-02-24T08:24:10.434900+0000","last_became_active":"2026-02-24T08:22:30.843627+0000","last_became_peered":"2026-02-24T08:22:30.843627+0000","last_unstale":"2026-02-24T08:24:10.434900+0000","last_undegraded":"2026-02-24T08:24:10.434900+0000","last_fullsized":"2026-02-24T08:24:10.434900+0000","mapping_epoch":39,"log_start":"45'16200","ondisk_log_start":"45'16200","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'22024","last_scrub_stamp":"2026-02-24T08:23:50.046592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:50.046592+0000","objects_scrubbed":2743,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:56.450660+0000","scrub_duration":561,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97779712,"num_objects":1492,"num_object_clones":0,"num_object_copies":4476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26291,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"49'26782","reported_seq":26844,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.040326+0000","last_change":"2026-02-24T08:23:44.128672+0000","last_active":"2026-02-24T08:24:10.040326+0000","last_peered":"2026-02-24T08:24:10.040326+0000","last_clean":"2026-02-24T08:24:10.040326+0000","last_became_active":"2026-02-24T08:22:30.844757+0000","last_became_peered":"2026-02-24T08:22:30.844757+0000","last_unstale":"2026-02-24T08:24:10.040326+0000","last_undegraded":"2026-02-24T08:24:10.040326+0000","last_fullsized":"2026-02-24T08:24:10.040326+0000","mapping_epoch":39,"log_start":"45'16700","ondisk_log_start":"45'16700","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'21088","last_scrub_stamp":"2026-02-24T08:23:44.128612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:44.128612+0000","objects_scrubbed":2631,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:08.319563+0000","scrub_duration":570,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105119744,"num_objects":1604,"num_object_clones":0,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26782,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"49'25830","reported_seq":25892,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.131193+0000","last_change":"2026-02-24T08:24:00.607619+0000","last_active":"2026-02-24T08:24:10.131193+0000","last_peered":"2026-02-24T08:24:10.131193+0000","last_clean":"2026-02-24T08:24:10.131193+0000","last_became_active":"2026-02-24T08:22:30.845702+0000","last_became_peered":"2026-02-24T08:22:30.845702+0000","last_unstale":"2026-02-24T08:24:10.131193+0000","last_undegraded":"2026-02-24T08:24:10.131193+0000","last_fullsized":"2026-02-24T08:24:10.131193+0000","mapping_epoch":39,"log_start":"45'15800","ondisk_log_start":"45'15800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'24048","last_scrub_stamp":"2026-02-24T08:24:00.607575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:24:00.607575+0000","objects_scrubbed":2995,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:25.304021+0000","scrub_duration":814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100270080,"num_objects":1530,"num_object_clones":0,"num_object_copies":4590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25830,"num_write_kb":194560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"49'26135","reported_seq":26199,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.415151+0000","last_change":"2026-02-24T08:23:57.257940+0000","last_active":"2026-02-24T08:24:10.415151+0000","last_peered":"2026-02-24T08:24:10.415151+0000","last_clean":"2026-02-24T08:24:10.415151+0000","last_became_active":"2026-02-24T08:22:30.844473+0000","last_became_peered":"2026-02-24T08:22:30.844473+0000","last_unstale":"2026-02-24T08:24:10.415151+0000","last_undegraded":"2026-02-24T08:24:10.415151+0000","last_fullsized":"2026-02-24T08:24:10.415151+0000","mapping_epoch":39,"log_start":"45'16100","ondisk_log_start":"45'16100","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'23496","last_scrub_stamp":"2026-02-24T08:23:57.257894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:57.257894+0000","objects_scrubbed":2901,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:57.850098+0000","scrub_duration":1891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99155968,"num_objects":1513,"num_object_clones":0,"num_object_copies":4539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26135,"num_write_kb":196608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"49'25814","reported_seq":25870,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.130024+0000","last_change":"2026-02-24T08:23:39.137696+0000","last_active":"2026-02-24T08:24:10.130024+0000","last_peered":"2026-02-24T08:24:10.130024+0000","last_clean":"2026-02-24T08:24:10.130024+0000","last_became_active":"2026-02-24T08:22:30.845244+0000","last_became_peered":"2026-02-24T08:22:30.845244+0000","last_unstale":"2026-02-24T08:24:10.130024+0000","last_undegraded":"2026-02-24T08:24:10.130024+0000","last_fullsized":"2026-02-24T08:24:10.130024+0000","mapping_epoch":39,"log_start":"45'15800","ondisk_log_start":"45'15800","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'19008","last_scrub_stamp":"2026-02-24T08:23:39.137654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:39.137654+0000","objects_scrubbed":2373,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:46.178505+0000","scrub_duration":464,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":1600,"num_object_clones":0,"num_object_copies":4800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1600,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25814,"num_write_kb":194944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"49'25526","reported_seq":25577,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.034415+0000","last_change":"2026-02-24T08:23:34.668724+0000","last_active":"2026-02-24T08:24:10.034415+0000","last_peered":"2026-02-24T08:24:10.034415+0000","last_clean":"2026-02-24T08:24:10.034415+0000","last_became_active":"2026-02-24T08:22:30.846177+0000","last_became_peered":"2026-02-24T08:22:30.846177+0000","last_unstale":"2026-02-24T08:24:10.034415+0000","last_undegraded":"2026-02-24T08:24:10.034415+0000","last_fullsized":"2026-02-24T08:24:10.034415+0000","mapping_epoch":39,"log_start":"45'15500","ondisk_log_start":"45'15500","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'18240","last_scrub_stamp":"2026-02-24T08:23:34.668671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:34.668671+0000","objects_scrubbed":2275,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:24:37.815374+0000","scrub_duration":966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101318656,"num_objects":1546,"num_object_clones":0,"num_object_copies":4638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25526,"num_write_kb":192512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'25933","reported_seq":25983,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.411796+0000","last_change":"2026-02-24T08:23:55.959470+0000","last_active":"2026-02-24T08:24:10.411796+0000","last_peered":"2026-02-24T08:24:10.411796+0000","last_clean":"2026-02-24T08:24:10.411796+0000","last_became_active":"2026-02-24T08:22:30.844288+0000","last_became_peered":"2026-02-24T08:22:30.844288+0000","last_unstale":"2026-02-24T08:24:10.411796+0000","last_undegraded":"2026-02-24T08:24:10.411796+0000","last_fullsized":"2026-02-24T08:24:10.411796+0000","mapping_epoch":39,"log_start":"45'15900","ondisk_log_start":"45'15900","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'23056","last_scrub_stamp":"2026-02-24T08:23:55.959401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:55.959401+0000","objects_scrubbed":2869,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:05.293185+0000","scrub_duration":1547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96911360,"num_objects":1479,"num_object_clones":0,"num_object_copies":4437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25933,"num_write_kb":194928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"49'26017","reported_seq":26078,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:10.417291+0000","last_change":"2026-02-24T08:23:41.042420+0000","last_active":"2026-02-24T08:24:10.417291+0000","last_peered":"2026-02-24T08:24:10.417291+0000","last_clean":"2026-02-24T08:24:10.417291+0000","last_became_active":"2026-02-24T08:22:30.843839+0000","last_became_peered":"2026-02-24T08:22:30.843839+0000","last_unstale":"2026-02-24T08:24:10.417291+0000","last_undegraded":"2026-02-24T08:24:10.417291+0000","last_fullsized":"2026-02-24T08:24:10.417291+0000","mapping_epoch":39,"log_start":"45'16000","ondisk_log_start":"45'16000","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'20238","last_scrub_stamp":"2026-02-24T08:23:41.042354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:22:29.830158+0000","last_clean_scrub_stamp":"2026-02-24T08:23:41.042354+0000","objects_scrubbed":2526,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:02.398622+0000","scrub_duration":573,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95092736,"num_objects":1451,"num_object_clones":0,"num_object_copies":4353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26017,"num_write_kb":195328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":116,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-24T08:24:05.009833+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:24:05.009833+0000","last_peered":"2026-02-24T08:24:05.009833+0000","last_clean":"2026-02-24T08:24:05.009833+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:24:05.009833+0000","last_undegraded":"2026-02-24T08:24:05.009833+0000","last_fullsized":"2026-02-24T08:24:05.009833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1598668824,"num_objects":24395,"num_object_clones":0,"num_object_copies":73185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24395,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":415543,"num_write_kb":3128433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4828459008,"data_stored":4828446792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160843,"ondisk_log_size":160843,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9072,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2138120,"kb_used_data":1003636,"kb_used_omap":22,"kb_used_meta":1134441,"kb_avail":731865080,"statfs":{"total":751619276800,"available":749429841920,"internally_reserved":0,"allocated":1027723264,"data_stored":1027391539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22602,"internal_metadata":1161668534},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444082,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2595192,"kb_used_data":1458980,"kb_used_omap":26,"kb_used_meta":1136165,"kb_avail":731408008,"statfs":{"total":751619276800,"available":748961800192,"internally_reserved":0,"allocated":1493995520,"data_stored":1493663795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27014,"internal_metadata":1163433594},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2124976,"kb_used_data":1061340,"kb_used_omap":28,"kb_used_meta":1063331,"kb_avail":731878224,"statfs":{"total":751619276800,"available":749443301376,"internally_reserved":0,"allocated":1086812160,"data_stored":1086488059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28967,"internal_metadata":1088851673},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,9,9,10,15,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2427576,"kb_used_data":1345060,"kb_used_omap":30,"kb_used_meta":1082209,"kb_avail":731575624,"statfs":{"total":751619276800,"available":749133438976,"internally_reserved":0,"allocated":1377341440,"data_stored":1377009715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31571,"internal_metadata":1108182189},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,1,11,9,10],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9072,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1334366208,"data_stored":1334362136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1074970624,"data_stored":1074970624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1416810496,"data_stored":1416806424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1002311680,"data_stored":1002307608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:24:16.613 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:24:16.613 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_1 pg_num 66 2026-02-24T08:24:16.807 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:16.947 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:16.944+0000 7fa52891f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:16.947 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:16.944+0000 7fa52891f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:17.107 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:24:17.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:24:17.307 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Removed 48882 objects 2026-02-24T08:24:17.307 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Clean up completed and total clean up time :14.3633 2026-02-24T08:24:17.503 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:17.623 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:17.724 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:17.722+0000 7fe94abe8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:17.725 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:17.722+0000 7fe94abe8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:17.737 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:17.737 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:17.748 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:17.748 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:17.759 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:17.759 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:17.770 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:17.770 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:17 trial105 ceph-mon[39442]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:24:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:17 trial105 ceph-mon[39442]: pgmap v140: 17 pgs: 17 active+clean; 425 MiB data, 5.8 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 4.0 MiB/s wr, 4.02k op/s 2026-02-24T08:24:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/98866570' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_1", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T08:24:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3486898937' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:19.805 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:19.830 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:24:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:24:19] "GET /metrics HTTP/1.1" 200 4223 "" "Prometheus/3.6.0" 2026-02-24T08:24:19.921 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:19.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:24:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:24:19.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:24:20.023 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:20.020+0000 7f4b6829d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:20.023 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:20.021+0000 7f4b6829d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:20.035 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:20.035 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:20.045 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:20.046 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:20.056 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:20.056 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:20.066 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:20.067 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:20.082 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:19 trial105 ceph-mon[39442]: pgmap v141: 17 pgs: 17 active+clean; 425 MiB data, 5.8 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.90k op/s 2026-02-24T08:24:21.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:20 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4147153102' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:21.706 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_1 2026-02-24T08:24:21.707 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2026-02-24T08:24:21.821 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:21.918 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:21.915+0000 7f22f5dae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:21.918 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:21.916+0000 7f22f5dae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:22.103 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:22.127 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:21 trial105 ceph-mon[39442]: pgmap v142: 17 pgs: 17 active+clean; 577 KiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 3.46k op/s 2026-02-24T08:24:22.154 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:24:22.154 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:24:22.218 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:22.320 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:22.317+0000 7feb8d688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:22.320 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:22.317+0000 7feb8d688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:22.332 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:22.332 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:22.342 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:22.342 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:22.354 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:22.354 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:22.365 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:22.365 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:22.840 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_1' removed 2026-02-24T08:24:22.892 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T08:24:22.893 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T08:24:22.893 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_2 2026-02-24T08:24:22.893 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool create unique_pool_2 16 2026-02-24T08:24:23.012 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:23.113 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:23.111+0000 7fa8c668d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:23.114 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:22 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1537446584' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:24:23.114 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:22 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2725380553' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:23.114 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:23.111+0000 7fa8c668d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:23.844 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_2' created 2026-02-24T08:24:23.881 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2026-02-24T08:24:23.996 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:24.104 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:24.101+0000 7f9b051c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:24.104 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:24.102+0000 7f9b051c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:24.105 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:23 trial105 ceph-mon[39442]: pgmap v143: 17 pgs: 17 active+clean; 577 KiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.03k op/s 2026-02-24T08:24:24.105 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1537446584' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_1", "pool2": "unique_pool_1", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:24:24.105 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:23 trial105 ceph-mon[39442]: osdmap e50: 4 total, 4 up, 4 in 2026-02-24T08:24:24.105 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3088274195' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16} : dispatch 2026-02-24T08:24:24.400 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:24.517 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:24.615 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:24.612+0000 7f1a253d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:24.615 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:24.612+0000 7f1a253d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:24.627 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:24.627 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:24.637 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:24.637 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:24.649 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:24.649 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:24.660 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:24.661 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:24.847 INFO:teuthology.orchestra.run.trial105.stderr:enabled application 'rados' on pool 'unique_pool_2' 2026-02-24T08:24:24.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3088274195' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_2", "pg_num": 16}]': finished 2026-02-24T08:24:24.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:24 trial105 ceph-mon[39442]: osdmap e51: 4 total, 4 up, 4 in 2026-02-24T08:24:24.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1804207340' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:24:24.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1082017647' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:25.889 DEBUG:teuthology.orchestra.run.trial105:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_2 bench 90 write' 2026-02-24T08:24:25.890 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-24T08:24:25.890 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:24:25.892 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T08:24:25.893 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T08:24:25.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout:hints = 1 2026-02-24T08:24:25.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T08:24:25.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object prefix: benchmark_data_trial105_100764 2026-02-24T08:24:25.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:24:25.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 0 0 0 0 0 0 - 0 2026-02-24T08:24:26.033 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:26.104 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:25 trial105 ceph-mon[39442]: pgmap v146: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:24:26.104 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1804207340' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_2", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:24:26.104 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:25 trial105 ceph-mon[39442]: osdmap e52: 4 total, 4 up, 4 in 2026-02-24T08:24:26.161 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:26.158+0000 7fb079408640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:26.162 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:26.159+0000 7fb079408640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:26.323 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:24:26.324 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:24:26.690 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2026-02-24T08:24:25.846381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4510404,"kb_used_data":3828,"kb_used_omap":112,"kb_used_meta":4506383,"kb_avail":2931502396,"statfs":{"total":3006477107200,"available":3001858453504,"internally_reserved":0,"allocated":3919872,"data_stored":2536172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":114933,"internal_metadata":4614536971},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-439938,"num_write_kb":-3128433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.128426"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.850711+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:24:24.850711+0000","last_peered":"2026-02-24T08:24:24.850711+0000","last_clean":"2026-02-24T08:24:24.850711+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:24:24.850711+0000","last_undegraded":"2026-02-24T08:24:24.850711+0000","last_fullsized":"2026-02-24T08:24:24.850711+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:26.631687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.852499+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:24:24.852499+0000","last_peered":"2026-02-24T08:24:24.852499+0000","last_clean":"2026-02-24T08:24:24.852499+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:24:24.852499+0000","last_undegraded":"2026-02-24T08:24:24.852499+0000","last_fullsized":"2026-02-24T08:24:24.852499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:52.317134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.852104+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:24:24.852104+0000","last_peered":"2026-02-24T08:24:24.852104+0000","last_clean":"2026-02-24T08:24:24.852104+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:24:24.852104+0000","last_undegraded":"2026-02-24T08:24:24.852104+0000","last_fullsized":"2026-02-24T08:24:24.852104+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:52.661454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.852132+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:24:24.852132+0000","last_peered":"2026-02-24T08:24:24.852132+0000","last_clean":"2026-02-24T08:24:24.852132+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:24:24.852132+0000","last_undegraded":"2026-02-24T08:24:24.852132+0000","last_fullsized":"2026-02-24T08:24:24.852132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:25.213281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.850604+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:24:24.850604+0000","last_peered":"2026-02-24T08:24:24.850604+0000","last_clean":"2026-02-24T08:24:24.850604+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:24:24.850604+0000","last_undegraded":"2026-02-24T08:24:24.850604+0000","last_fullsized":"2026-02-24T08:24:24.850604+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:26.463105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.852799+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:24:24.852799+0000","last_peered":"2026-02-24T08:24:24.852799+0000","last_clean":"2026-02-24T08:24:24.852799+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:24:24.852799+0000","last_undegraded":"2026-02-24T08:24:24.852799+0000","last_fullsized":"2026-02-24T08:24:24.852799+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:41.470808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.850771+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:24:24.850771+0000","last_peered":"2026-02-24T08:24:24.850771+0000","last_clean":"2026-02-24T08:24:24.850771+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:24:24.850771+0000","last_undegraded":"2026-02-24T08:24:24.850771+0000","last_fullsized":"2026-02-24T08:24:24.850771+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.173591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.851928+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:24:24.851928+0000","last_peered":"2026-02-24T08:24:24.851928+0000","last_clean":"2026-02-24T08:24:24.851928+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:24:24.851928+0000","last_undegraded":"2026-02-24T08:24:24.851928+0000","last_fullsized":"2026-02-24T08:24:24.851928+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.850776+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:24:24.850776+0000","last_peered":"2026-02-24T08:24:24.850776+0000","last_clean":"2026-02-24T08:24:24.850776+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:24:24.850776+0000","last_undegraded":"2026-02-24T08:24:24.850776+0000","last_fullsized":"2026-02-24T08:24:24.850776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:52.947955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.849944+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:24:24.849944+0000","last_peered":"2026-02-24T08:24:24.849944+0000","last_clean":"2026-02-24T08:24:24.849944+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:24:24.849944+0000","last_undegraded":"2026-02-24T08:24:24.849944+0000","last_fullsized":"2026-02-24T08:24:24.849944+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:30.966975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.849602+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:24:24.849602+0000","last_peered":"2026-02-24T08:24:24.849602+0000","last_clean":"2026-02-24T08:24:24.849602+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:24:24.849602+0000","last_undegraded":"2026-02-24T08:24:24.849602+0000","last_fullsized":"2026-02-24T08:24:24.849602+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:27.120698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.850548+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:24:24.850548+0000","last_peered":"2026-02-24T08:24:24.850548+0000","last_clean":"2026-02-24T08:24:24.850548+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:24:24.850548+0000","last_undegraded":"2026-02-24T08:24:24.850548+0000","last_fullsized":"2026-02-24T08:24:24.850548+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.050018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.849510+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:24:24.849510+0000","last_peered":"2026-02-24T08:24:24.849510+0000","last_clean":"2026-02-24T08:24:24.849510+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:24:24.849510+0000","last_undegraded":"2026-02-24T08:24:24.849510+0000","last_fullsized":"2026-02-24T08:24:24.849510+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.216068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.852497+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:24:24.852497+0000","last_peered":"2026-02-24T08:24:24.852497+0000","last_clean":"2026-02-24T08:24:24.852497+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:24:24.852497+0000","last_undegraded":"2026-02-24T08:24:24.852497+0000","last_fullsized":"2026-02-24T08:24:24.852497+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:27.246426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.850564+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:24:24.850564+0000","last_peered":"2026-02-24T08:24:24.850564+0000","last_clean":"2026-02-24T08:24:24.850564+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:24:24.850564+0000","last_undegraded":"2026-02-24T08:24:24.850564+0000","last_fullsized":"2026-02-24T08:24:24.850564+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.357978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.852157+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:24:24.852157+0000","last_peered":"2026-02-24T08:24:24.852157+0000","last_clean":"2026-02-24T08:24:24.852157+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:24:24.852157+0000","last_undegraded":"2026-02-24T08:24:24.852157+0000","last_fullsized":"2026-02-24T08:24:24.852157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.159437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-24T08:24:24.846345+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:24:24.846345+0000","last_peered":"2026-02-24T08:24:24.846345+0000","last_clean":"2026-02-24T08:24:24.846345+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:24:24.846345+0000","last_undegraded":"2026-02-24T08:24:24.846345+0000","last_fullsized":"2026-02-24T08:24:24.846345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9168,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247859,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1153640,"kb_used_data":1108,"kb_used_omap":22,"kb_used_meta":1152489,"kb_avail":732849560,"statfs":{"total":751619276800,"available":750437949440,"internally_reserved":0,"allocated":1134592,"data_stored":784023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22824,"internal_metadata":1180149464},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444085,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1155356,"kb_used_data":1096,"kb_used_omap":27,"kb_used_meta":1154212,"kb_avail":732847844,"statfs":{"total":751619276800,"available":750436192256,"internally_reserved":0,"allocated":1122304,"data_stored":779247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28316,"internal_metadata":1181913444},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1100004,"kb_used_data":528,"kb_used_omap":30,"kb_used_meta":1099425,"kb_avail":732903196,"statfs":{"total":751619276800,"available":750492872704,"internally_reserved":0,"allocated":540672,"data_stored":193655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30920,"internal_metadata":1125812024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1101404,"kb_used_data":1096,"kb_used_omap":32,"kb_used_meta":1100255,"kb_avail":732901796,"statfs":{"total":751619276800,"available":750491439104,"internally_reserved":0,"allocated":1122304,"data_stored":779247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32873,"internal_metadata":1126662039},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9168,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:24:26.692 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:24:26.693 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 26 2026-02-24T08:24:26.694 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:26.847 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:26.852 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:26.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 1 127 10091 9964 77.8371 77.8438 0.00585409 0.0127486 2026-02-24T08:24:26.971 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:26 trial105 ceph-mon[39442]: osdmap e53: 4 total, 4 up, 4 in 2026-02-24T08:24:26.994 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:26.991+0000 7f8b26608640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:26.994 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:26.992+0000 7f8b26608640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:26.998 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:26.995+0000 7f61b85f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:26.998 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:26.996+0000 7f61b85f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:27.013 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:27.013 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:27.027 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:27.027 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:27.041 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:27.042 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:27.057 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:27.057 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:27.151 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:24:27.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:24:27.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 2 128 20977 20849 81.4346 85.0391 0.00586992 0.0122308 2026-02-24T08:24:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:27 trial105 ceph-mon[39442]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:24:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:27 trial105 ceph-mon[39442]: pgmap v149: 17 pgs: 17 active+clean; 577 KiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:24:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2363574258' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2320544317' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T08:24:28.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 3 128 32265 32137 83.6832 88.1875 0.0161781 0.0119109 2026-02-24T08:24:29.104 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:29.267 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:29.400 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:29.397+0000 7ff76168a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:29.400 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:29.397+0000 7ff76168a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:29.417 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:29.417 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:29.431 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:29.431 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:29.444 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:29.444 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:29.459 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:29.459 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:29.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:24:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:24:29] "GET /metrics HTTP/1.1" 200 4157 "" "Prometheus/3.6.0" 2026-02-24T08:24:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:24:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:24:29.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:24:29.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 4 128 42514 42386 82.7785 80.0703 0.0425903 0.0120351 2026-02-24T08:24:30.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:29 trial105 ceph-mon[39442]: pgmap v150: 17 pgs: 17 active+clean; 577 KiB data, 4.3 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:24:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:24:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1587669137' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:30.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 5 128 51658 51530 80.5091 71.4375 0.025672 0.0123945 2026-02-24T08:24:31.509 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:31.666 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:31.797 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:31.794+0000 7fcc33992640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:31.797 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:31.794+0000 7fcc33992640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:31.813 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:31.813 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:31.828 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:31.828 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:31.839 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:31.839 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:31.853 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:31.853 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:31.940 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 6 127 59609 59482 77.4444 62.125 0.00451251 0.0128513 2026-02-24T08:24:32.066 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:31 trial105 ceph-mon[39442]: pgmap v151: 17 pgs: 17 active+clean; 354 MiB data, 5.5 GiB used, 2.7 TiB / 2.7 TiB avail; 51 MiB/s wr, 6.58k op/s 2026-02-24T08:24:32.066 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:31 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1939817853' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:32.198 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:24:32.198 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:24:32.198 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:24:32.199 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:24:32.443 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:32.866 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:32.859+0000 7f0927a89640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:32.866 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:32.859+0000 7f0927a89640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:32.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 7 128 65425 65297 72.8703 45.4297 0.0291987 0.013698 2026-02-24T08:24:33.038 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:24:33.038 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:24:33.086 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2026-02-24T08:24:32.719660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":371442208,"num_objects":5663,"num_object_clones":0,"num_object_copies":16989,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5663,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":45405,"num_write_kb":364310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45369,"ondisk_log_size":45369,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5745540,"kb_used_data":1004340,"kb_used_omap":115,"kb_used_meta":4741004,"kb_avail":2930267260,"statfs":{"total":3006477107200,"available":3000593674240,"internally_reserved":0,"allocated":1028444160,"data_stored":1027015260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":118262,"internal_metadata":4854788618},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,4,4,36,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":370851840,"num_objects":5661,"num_object_clones":0,"num_object_copies":16983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45270,"num_write_kb":362160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001147"},"pg_stats":[{"pgid":"4.f","version":"53'3096","reported_seq":3110,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.454026+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:24:30.454026+0000","last_peered":"2026-02-24T08:24:30.454026+0000","last_clean":"2026-02-24T08:24:30.454026+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:24:30.454026+0000","last_undegraded":"2026-02-24T08:24:30.454026+0000","last_fullsized":"2026-02-24T08:24:30.454026+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":3096,"log_dups_size":0,"ondisk_log_size":3096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25362432,"num_objects":387,"num_object_clones":0,"num_object_copies":1161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3096,"num_write_kb":24768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"53'2704","reported_seq":2718,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.167245+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:24:30.167245+0000","last_peered":"2026-02-24T08:24:30.167245+0000","last_clean":"2026-02-24T08:24:30.167245+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:24:30.167245+0000","last_undegraded":"2026-02-24T08:24:30.167245+0000","last_fullsized":"2026-02-24T08:24:30.167245+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2704,"log_dups_size":0,"ondisk_log_size":2704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2704,"num_write_kb":21632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"53'2647","reported_seq":2658,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.248406+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:24:30.248406+0000","last_peered":"2026-02-24T08:24:30.248406+0000","last_clean":"2026-02-24T08:24:30.248406+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:24:30.248406+0000","last_undegraded":"2026-02-24T08:24:30.248406+0000","last_fullsized":"2026-02-24T08:24:30.248406+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2647,"log_dups_size":0,"ondisk_log_size":2647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21684224,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2647,"num_write_kb":21176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"53'2792","reported_seq":2806,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.246183+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:24:30.246183+0000","last_peered":"2026-02-24T08:24:30.246183+0000","last_clean":"2026-02-24T08:24:30.246183+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:24:30.246183+0000","last_undegraded":"2026-02-24T08:24:30.246183+0000","last_fullsized":"2026-02-24T08:24:30.246183+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2792,"log_dups_size":0,"ondisk_log_size":2792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2792,"num_write_kb":22336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"53'2952","reported_seq":2966,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.064500+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:24:30.064500+0000","last_peered":"2026-02-24T08:24:30.064500+0000","last_clean":"2026-02-24T08:24:30.064500+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:24:30.064500+0000","last_undegraded":"2026-02-24T08:24:30.064500+0000","last_fullsized":"2026-02-24T08:24:30.064500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2952,"log_dups_size":0,"ondisk_log_size":2952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182784,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":369,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2952,"num_write_kb":23616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"53'2704","reported_seq":2718,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.159794+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:24:30.159794+0000","last_peered":"2026-02-24T08:24:30.159794+0000","last_clean":"2026-02-24T08:24:30.159794+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:24:30.159794+0000","last_undegraded":"2026-02-24T08:24:30.159794+0000","last_fullsized":"2026-02-24T08:24:30.159794+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2704,"log_dups_size":0,"ondisk_log_size":2704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2704,"num_write_kb":21632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"53'2912","reported_seq":2920,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.169029+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:24:30.169029+0000","last_peered":"2026-02-24T08:24:30.169029+0000","last_clean":"2026-02-24T08:24:30.169029+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:24:30.169029+0000","last_undegraded":"2026-02-24T08:24:30.169029+0000","last_fullsized":"2026-02-24T08:24:30.169029+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2912,"log_dups_size":0,"ondisk_log_size":2912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2912,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"53'2864","reported_seq":2878,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.237452+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:24:30.237452+0000","last_peered":"2026-02-24T08:24:30.237452+0000","last_clean":"2026-02-24T08:24:30.237452+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:24:30.237452+0000","last_undegraded":"2026-02-24T08:24:30.237452+0000","last_fullsized":"2026-02-24T08:24:30.237452+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2864,"log_dups_size":0,"ondisk_log_size":2864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2864,"num_write_kb":22912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"53'2848","reported_seq":2862,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.430174+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:24:30.430174+0000","last_peered":"2026-02-24T08:24:30.430174+0000","last_clean":"2026-02-24T08:24:30.430174+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:24:30.430174+0000","last_undegraded":"2026-02-24T08:24:30.430174+0000","last_fullsized":"2026-02-24T08:24:30.430174+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2848,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"53'2734","reported_seq":2745,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.069624+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:24:30.069624+0000","last_peered":"2026-02-24T08:24:30.069624+0000","last_clean":"2026-02-24T08:24:30.069624+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:24:30.069624+0000","last_undegraded":"2026-02-24T08:24:30.069624+0000","last_fullsized":"2026-02-24T08:24:30.069624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2734,"log_dups_size":0,"ondisk_log_size":2734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22396928,"num_objects":342,"num_object_clones":0,"num_object_copies":1026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2734,"num_write_kb":21872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"53'2920","reported_seq":2934,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.422586+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:24:30.422586+0000","last_peered":"2026-02-24T08:24:30.422586+0000","last_clean":"2026-02-24T08:24:30.422586+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:24:30.422586+0000","last_undegraded":"2026-02-24T08:24:30.422586+0000","last_fullsized":"2026-02-24T08:24:30.422586+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2920,"log_dups_size":0,"ondisk_log_size":2920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2920,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"53'2677","reported_seq":2687,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.054299+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:24:30.054299+0000","last_peered":"2026-02-24T08:24:30.054299+0000","last_clean":"2026-02-24T08:24:30.054299+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:24:30.054299+0000","last_undegraded":"2026-02-24T08:24:30.054299+0000","last_fullsized":"2026-02-24T08:24:30.054299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2677,"log_dups_size":0,"ondisk_log_size":2677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21929984,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":335,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2677,"num_write_kb":21416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"53'3153","reported_seq":3161,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.463942+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:24:30.463942+0000","last_peered":"2026-02-24T08:24:30.463942+0000","last_clean":"2026-02-24T08:24:30.463942+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:24:30.463942+0000","last_undegraded":"2026-02-24T08:24:30.463942+0000","last_fullsized":"2026-02-24T08:24:30.463942+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":3153,"log_dups_size":0,"ondisk_log_size":3153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25829376,"num_objects":395,"num_object_clones":0,"num_object_copies":1185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3153,"num_write_kb":25224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'2832","reported_seq":2846,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.141847+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:24:30.141847+0000","last_peered":"2026-02-24T08:24:30.141847+0000","last_clean":"2026-02-24T08:24:30.141847+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:24:30.141847+0000","last_undegraded":"2026-02-24T08:24:30.141847+0000","last_fullsized":"2026-02-24T08:24:30.141847+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2832,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'2667","reported_seq":2679,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.066463+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:24:30.066463+0000","last_peered":"2026-02-24T08:24:30.066463+0000","last_clean":"2026-02-24T08:24:30.066463+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:24:30.066463+0000","last_undegraded":"2026-02-24T08:24:30.066463+0000","last_fullsized":"2026-02-24T08:24:30.066463+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2667,"log_dups_size":0,"ondisk_log_size":2667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21848064,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":334,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2667,"num_write_kb":21336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"53'2768","reported_seq":2782,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:30.239778+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:24:30.239778+0000","last_peered":"2026-02-24T08:24:30.239778+0000","last_clean":"2026-02-24T08:24:30.239778+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:24:30.239778+0000","last_undegraded":"2026-02-24T08:24:30.239778+0000","last_fullsized":"2026-02-24T08:24:30.239778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":2768,"log_dups_size":0,"ondisk_log_size":2768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22675456,"num_objects":346,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2768,"num_write_kb":22144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:25.941762+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:24:25.941762+0000","last_peered":"2026-02-24T08:24:25.941762+0000","last_clean":"2026-02-24T08:24:25.941762+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:24:25.941762+0000","last_undegraded":"2026-02-24T08:24:25.941762+0000","last_fullsized":"2026-02-24T08:24:25.941762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":370851840,"num_objects":5661,"num_object_clones":0,"num_object_copies":16983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45270,"num_write_kb":362160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1109139456,"data_stored":1109139456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45270,"ondisk_log_size":45270,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9200,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247860,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1466012,"kb_used_data":259336,"kb_used_omap":22,"kb_used_meta":1206633,"kb_avail":732537188,"statfs":{"total":751619276800,"available":750118080512,"internally_reserved":0,"allocated":265560064,"data_stored":265201951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22898,"internal_metadata":1235592846},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444086,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1499220,"kb_used_data":254720,"kb_used_omap":28,"kb_used_meta":1244451,"kb_avail":732503980,"statfs":{"total":751619276800,"available":750084075520,"internally_reserved":0,"allocated":260833280,"data_stored":260475167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29618,"internal_metadata":1274317902},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,4,4,24,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1372352,"kb_used_data":236780,"kb_used_omap":30,"kb_used_meta":1135521,"kb_avail":732630848,"statfs":{"total":751619276800,"available":750213988352,"internally_reserved":0,"allocated":242462720,"data_stored":242108159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31571,"internal_metadata":1162773677},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1407956,"kb_used_data":253504,"kb_used_omap":33,"kb_used_meta":1154398,"kb_avail":732595244,"statfs":{"total":751619276800,"available":750177529856,"internally_reserved":0,"allocated":259588096,"data_stored":259229983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34175,"internal_metadata":1182104193},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,12],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9200,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":268869632,"data_stored":268869632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":244916224,"data_stored":244916224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":319102976,"data_stored":319102976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":276250624,"data_stored":276250624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:24:33.087 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:24:33.087 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 91 2026-02-24T08:24:33.289 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:33.422 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:33.419+0000 7fead3f2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:33.422 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:33.420+0000 7fead3f2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:33.590 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:24:33.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:24:33.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 8 128 72886 72758 71.0471 58.2891 0.0209174 0.014053 2026-02-24T08:24:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:33 trial105 ceph-mon[39442]: pgmap v152: 17 pgs: 17 active+clean; 354 MiB data, 5.5 GiB used, 2.7 TiB / 2.7 TiB avail; 44 MiB/s wr, 5.66k op/s 2026-02-24T08:24:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/842355044' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "91"} : dispatch 2026-02-24T08:24:34.443 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:34.585 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:34.714 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:34.712+0000 7f646b738640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:34.714 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:34.712+0000 7f646b738640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:34.731 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:34.731 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:34.746 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:34.746 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:34.761 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:34.761 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:34.775 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:34.776 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:34.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 9 128 79960 79832 69.2931 55.2656 0.0317731 0.0144084 2026-02-24T08:24:35.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:34 trial105 ceph-mon[39442]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:24:35.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:34 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:24:35.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:34 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:24:35.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/182816605' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:35.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 10 128 86763 86635 67.6782 53.1484 0.0516321 0.014748 2026-02-24T08:24:36.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:35 trial105 ceph-mon[39442]: pgmap v153: 17 pgs: 17 active+clean; 354 MiB data, 5.5 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.58k op/s 2026-02-24T08:24:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:35 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:24:36.821 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:36.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 11 128 92939 92811 65.9117 48.25 0.0132708 0.015153 2026-02-24T08:24:36.967 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:37.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:24:37.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:24:37.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:24:37.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:24:37.439 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:37.439 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:37.439 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:37.440 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:37.375+0000 7f582a155640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:37.440 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:37.375+0000 7f582a155640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:37.440 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:37.440 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:37.440 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:37.453 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:37.454 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:37.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 12 128 97707 97579 63.523 37.25 0.0108506 0.0157196 2026-02-24T08:24:38.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:37 trial105 ceph-mon[39442]: pgmap v154: 17 pgs: 17 active+clean; 641 MiB data, 6.5 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.54k op/s 2026-02-24T08:24:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:37 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:24:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:37 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:24:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1035708407' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:38.635 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:24:38.635 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:24:38.635 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:24:38.635 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:24:38.782 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:38.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 13 127 103251 103124 61.9687 43.3203 0.0784222 0.0161079 2026-02-24T08:24:39.404 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:39.331+0000 7f5e08ce8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:39.404 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:39.331+0000 7f5e08ce8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:39.481 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:24:39.481 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:24:39.528 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2026-02-24T08:24:38.720453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671973920,"num_objects":10248,"num_object_clones":0,"num_object_copies":30744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10248,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":82091,"num_write_kb":657798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82055,"ondisk_log_size":82055,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6861532,"kb_used_data":1903756,"kb_used_omap":116,"kb_used_meta":4957579,"kb_avail":2929151268,"statfs":{"total":3006477107200,"available":2999450898432,"internally_reserved":0,"allocated":1949446144,"data_stored":1948017244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":118913,"internal_metadata":5076561791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,3,13,9,12,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":671383552,"num_objects":10246,"num_object_clones":0,"num_object_copies":30738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10246,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81956,"num_write_kb":655648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001666"},"pg_stats":[{"pgid":"4.f","version":"53'5200","reported_seq":5214,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.429980+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:24:35.429980+0000","last_peered":"2026-02-24T08:24:35.429980+0000","last_clean":"2026-02-24T08:24:35.429980+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:24:35.429980+0000","last_undegraded":"2026-02-24T08:24:35.429980+0000","last_fullsized":"2026-02-24T08:24:35.429980+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5200,"log_dups_size":0,"ondisk_log_size":5200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42598400,"num_objects":650,"num_object_clones":0,"num_object_copies":1950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":650,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5200,"num_write_kb":41600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"53'4759","reported_seq":4772,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.171959+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:24:35.171959+0000","last_peered":"2026-02-24T08:24:35.171959+0000","last_clean":"2026-02-24T08:24:35.171959+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:24:35.171959+0000","last_undegraded":"2026-02-24T08:24:35.171959+0000","last_fullsized":"2026-02-24T08:24:35.171959+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":4759,"log_dups_size":0,"ondisk_log_size":4759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38985728,"num_objects":595,"num_object_clones":0,"num_object_copies":1785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":595,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4759,"num_write_kb":38072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"53'4800","reported_seq":4814,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.241055+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:24:35.241055+0000","last_peered":"2026-02-24T08:24:35.241055+0000","last_clean":"2026-02-24T08:24:35.241055+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:24:35.241055+0000","last_undegraded":"2026-02-24T08:24:35.241055+0000","last_fullsized":"2026-02-24T08:24:35.241055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39321600,"num_objects":600,"num_object_clones":0,"num_object_copies":1800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":600,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4800,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"53'5288","reported_seq":5299,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.251363+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:24:35.251363+0000","last_peered":"2026-02-24T08:24:35.251363+0000","last_clean":"2026-02-24T08:24:35.251363+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:24:35.251363+0000","last_undegraded":"2026-02-24T08:24:35.251363+0000","last_fullsized":"2026-02-24T08:24:35.251363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5288,"log_dups_size":0,"ondisk_log_size":5288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5288,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"53'5320","reported_seq":5334,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.056365+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:24:35.056365+0000","last_peered":"2026-02-24T08:24:35.056365+0000","last_clean":"2026-02-24T08:24:35.056365+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:24:35.056365+0000","last_undegraded":"2026-02-24T08:24:35.056365+0000","last_fullsized":"2026-02-24T08:24:35.056365+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5320,"log_dups_size":0,"ondisk_log_size":5320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43581440,"num_objects":665,"num_object_clones":0,"num_object_copies":1995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5320,"num_write_kb":42560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"53'4968","reported_seq":4982,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.166469+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:24:35.166469+0000","last_peered":"2026-02-24T08:24:35.166469+0000","last_clean":"2026-02-24T08:24:35.166469+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:24:35.166469+0000","last_undegraded":"2026-02-24T08:24:35.166469+0000","last_fullsized":"2026-02-24T08:24:35.166469+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":4968,"log_dups_size":0,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40697856,"num_objects":621,"num_object_clones":0,"num_object_copies":1863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4968,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"53'5158","reported_seq":5170,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.172248+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:24:35.172248+0000","last_peered":"2026-02-24T08:24:35.172248+0000","last_clean":"2026-02-24T08:24:35.172248+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:24:35.172248+0000","last_undegraded":"2026-02-24T08:24:35.172248+0000","last_fullsized":"2026-02-24T08:24:35.172248+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5158,"log_dups_size":0,"ondisk_log_size":5158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42254336,"num_objects":645,"num_object_clones":0,"num_object_copies":1935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":645,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5158,"num_write_kb":41264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"53'5256","reported_seq":5270,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.184584+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:24:35.184584+0000","last_peered":"2026-02-24T08:24:35.184584+0000","last_clean":"2026-02-24T08:24:35.184584+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:24:35.184584+0000","last_undegraded":"2026-02-24T08:24:35.184584+0000","last_fullsized":"2026-02-24T08:24:35.184584+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5256,"log_dups_size":0,"ondisk_log_size":5256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43057152,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5256,"num_write_kb":42048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"53'5059","reported_seq":5072,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.471727+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:24:35.471727+0000","last_peered":"2026-02-24T08:24:35.471727+0000","last_clean":"2026-02-24T08:24:35.471727+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:24:35.471727+0000","last_undegraded":"2026-02-24T08:24:35.471727+0000","last_fullsized":"2026-02-24T08:24:35.471727+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5059,"log_dups_size":0,"ondisk_log_size":5059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41443328,"num_objects":633,"num_object_clones":0,"num_object_copies":1899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":633,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5059,"num_write_kb":40472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"53'4976","reported_seq":4989,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.075174+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:24:35.075174+0000","last_peered":"2026-02-24T08:24:35.075174+0000","last_clean":"2026-02-24T08:24:35.075174+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:24:35.075174+0000","last_undegraded":"2026-02-24T08:24:35.075174+0000","last_fullsized":"2026-02-24T08:24:35.075174+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":4976,"log_dups_size":0,"ondisk_log_size":4976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":622,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4976,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"53'5296","reported_seq":5308,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.470283+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:24:35.470283+0000","last_peered":"2026-02-24T08:24:35.470283+0000","last_clean":"2026-02-24T08:24:35.470283+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:24:35.470283+0000","last_undegraded":"2026-02-24T08:24:35.470283+0000","last_fullsized":"2026-02-24T08:24:35.470283+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5296,"log_dups_size":0,"ondisk_log_size":5296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43384832,"num_objects":662,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5296,"num_write_kb":42368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"53'5152","reported_seq":5166,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.069466+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:24:35.069466+0000","last_peered":"2026-02-24T08:24:35.069466+0000","last_clean":"2026-02-24T08:24:35.069466+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:24:35.069466+0000","last_undegraded":"2026-02-24T08:24:35.069466+0000","last_fullsized":"2026-02-24T08:24:35.069466+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5152,"log_dups_size":0,"ondisk_log_size":5152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42205184,"num_objects":644,"num_object_clones":0,"num_object_copies":1932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5152,"num_write_kb":41216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"53'5328","reported_seq":5342,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.446224+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:24:35.446224+0000","last_peered":"2026-02-24T08:24:35.446224+0000","last_clean":"2026-02-24T08:24:35.446224+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:24:35.446224+0000","last_undegraded":"2026-02-24T08:24:35.446224+0000","last_fullsized":"2026-02-24T08:24:35.446224+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5328,"log_dups_size":0,"ondisk_log_size":5328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43646976,"num_objects":666,"num_object_clones":0,"num_object_copies":1998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":666,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5328,"num_write_kb":42624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'5224","reported_seq":5238,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.158018+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:24:35.158018+0000","last_peered":"2026-02-24T08:24:35.158018+0000","last_clean":"2026-02-24T08:24:35.158018+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:24:35.158018+0000","last_undegraded":"2026-02-24T08:24:35.158018+0000","last_fullsized":"2026-02-24T08:24:35.158018+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42795008,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":653,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5224,"num_write_kb":41792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'5072","reported_seq":5086,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.014495+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:24:35.014495+0000","last_peered":"2026-02-24T08:24:35.014495+0000","last_clean":"2026-02-24T08:24:35.014495+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:24:35.014495+0000","last_undegraded":"2026-02-24T08:24:35.014495+0000","last_fullsized":"2026-02-24T08:24:35.014495+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5072,"log_dups_size":0,"ondisk_log_size":5072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41549824,"num_objects":634,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5072,"num_write_kb":40576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"53'5100","reported_seq":5112,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:35.250763+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:24:35.250763+0000","last_peered":"2026-02-24T08:24:35.250763+0000","last_clean":"2026-02-24T08:24:35.250763+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:24:35.250763+0000","last_undegraded":"2026-02-24T08:24:35.250763+0000","last_fullsized":"2026-02-24T08:24:35.250763+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":5100,"log_dups_size":0,"ondisk_log_size":5100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41779200,"num_objects":638,"num_object_clones":0,"num_object_copies":1914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5100,"num_write_kb":40800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:25.941762+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:24:25.941762+0000","last_peered":"2026-02-24T08:24:25.941762+0000","last_clean":"2026-02-24T08:24:25.941762+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:24:25.941762+0000","last_undegraded":"2026-02-24T08:24:25.941762+0000","last_fullsized":"2026-02-24T08:24:25.941762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":671383552,"num_objects":10246,"num_object_clones":0,"num_object_copies":30738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10246,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81956,"num_write_kb":655648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2011848704,"data_stored":2011848704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81956,"ondisk_log_size":81956,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9200,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247861,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1761756,"kb_used_data":482888,"kb_used_omap":22,"kb_used_meta":1278825,"kb_avail":732241444,"statfs":{"total":751619276800,"available":749815238656,"internally_reserved":0,"allocated":494477312,"data_stored":494119199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22898,"internal_metadata":1309517454},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444087,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1804564,"kb_used_data":523968,"kb_used_omap":28,"kb_used_meta":1280547,"kb_avail":732198636,"statfs":{"total":751619276800,"available":749771403264,"internally_reserved":0,"allocated":536543232,"data_stored":536185119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29618,"internal_metadata":1311280206},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1587240,"kb_used_data":415572,"kb_used_omap":30,"kb_used_meta":1171617,"kb_avail":732415960,"statfs":{"total":751619276800,"available":749993943040,"internally_reserved":0,"allocated":425545728,"data_stored":425191167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31571,"internal_metadata":1199735981},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1707972,"kb_used_data":481328,"kb_used_omap":34,"kb_used_meta":1226589,"kb_avail":732295228,"statfs":{"total":751619276800,"available":749870313472,"internally_reserved":0,"allocated":492879872,"data_stored":492521759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34826,"internal_metadata":1256028150},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,3,13,9,12,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9200,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":498966528,"data_stored":498966528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":428015616,"data_stored":428015616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":582139904,"data_stored":582139904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":502726656,"data_stored":502726656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:24:39.529 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 91 2026-02-24T08:24:39.681 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:39.813 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:39.810+0000 7f7293fb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:39.813 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:24:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:24:39] "GET /metrics HTTP/1.1" 200 4157 "" "Prometheus/3.6.0" 2026-02-24T08:24:39.814 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:39.812+0000 7f7293fb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:39.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:24:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:24:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:24:39.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 14 128 108227 108099 60.3184 38.8672 0.0353883 0.0165553 2026-02-24T08:24:39.965 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:24:40.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:24:40.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:39 trial105 ceph-mon[39442]: pgmap v155: 17 pgs: 17 active+clean; 641 MiB data, 6.5 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.83k op/s 2026-02-24T08:24:40.222 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:40.376 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:40.509 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:40.507+0000 7f9c9ad5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:40.510 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:40.507+0000 7f9c9ad5e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:40.524 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:40.524 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:40.536 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:40.536 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:40.550 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:40.550 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:40.565 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:40.566 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:40.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 15 128 113431 113303 59.0073 40.6562 0.0107975 0.0169098 2026-02-24T08:24:41.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:40 trial105 ceph-mon[39442]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:24:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2163412766' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "91"} : dispatch 2026-02-24T08:24:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3938187110' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:41.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 16 128 118476 118348 57.7826 39.4141 0.0208519 0.0172786 2026-02-24T08:24:42.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:41 trial105 ceph-mon[39442]: pgmap v156: 17 pgs: 17 active+clean; 858 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 71 MiB/s wr, 9.15k op/s 2026-02-24T08:24:42.613 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:42.764 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:42.892 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:42.889+0000 7f5fde083640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:42.892 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:42.890+0000 7f5fde083640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:42.910 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:42.911 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:42.924 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:42.924 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:42.939 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:42.939 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:42.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 17 128 123407 123279 56.6495 38.5234 0.0134433 0.0176324 2026-02-24T08:24:42.954 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:42.954 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:43.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 18 128 127957 127829 55.477 35.5469 0.00704525 0.018002 2026-02-24T08:24:44.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:43 trial105 ceph-mon[39442]: pgmap v157: 17 pgs: 17 active+clean; 858 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 42 MiB/s wr, 5.37k op/s 2026-02-24T08:24:44.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2888767199' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:44.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:43 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:24:44.941 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 19 128 132427 132299 54.395 34.9219 0.0146039 0.018366 2026-02-24T08:24:45.000 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:45.007 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:24:45.008 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:24:45.008 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:24:45.008 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:24:45.153 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:45.195 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:45.296 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:45.293+0000 7fed5a76b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:45.297 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:45.293+0000 7fed5a76b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:45.307 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:45.304+0000 7f05429f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:45.308 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:45.305+0000 7f05429f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:45.313 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:45.313 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:45.327 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:45.327 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:45.333 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:24:45.333 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:24:45.333 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:24:45.333 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:24:45.333 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:24:45.333 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:24:45.333 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:24:45.333 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:24:45.334 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:24:45.334 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:24:45.334 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:24:45.334 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:24:45.343 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:45.343 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:45.358 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:45.358 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:45.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:24:45.371 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:24:45.371 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:24:45.519 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:45.641 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:45.637+0000 7fbeeade9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:45.641 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:45.638+0000 7fbeeade9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:45.658 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:24:45.658 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:24:45.658 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:24:45.659 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:24:45.659 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:24:45.659 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:24:45.659 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:24:45.659 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:24:45.659 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:24:45.659 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:24:45.659 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:24:45.659 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:24:45.689 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:24:45.690 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:24:45.690 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:24:45.838 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:45.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:24:45.940728+0000 min lat: 0.00104395 max lat: 0.145716 avg lat: 0.0187461 2026-02-24T08:24:45.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:24:45.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 20 128 136573 136445 53.2947 32.3906 0.0255305 0.0187461 2026-02-24T08:24:45.957 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:45.953+0000 7fb7ea66a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:45.957 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:45.954+0000 7fb7ea66a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:45.982 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:24:45.982 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:24:45.982 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:24:45.982 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:24:45.982 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:24:45.982 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:24:45.982 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:24:45.982 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:24:45.983 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:24:45.983 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:24:45.983 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:24:45.983 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:24:46.018 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:24:46.019 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:24:46.019 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:24:46.173 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:46.186 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:45 trial105 ceph-mon[39442]: pgmap v158: 17 pgs: 17 active+clean; 858 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 42 MiB/s wr, 5.37k op/s 2026-02-24T08:24:46.186 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1510439287' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:46.290 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:46.286+0000 7f4d2dfd0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:46.290 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:46.287+0000 7f4d2dfd0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:46.316 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:24:46.316 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:24:46.317 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:24:46.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:24:46.359 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:24:46.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 21 127 140746 140619 52.3086 32.6094 0.0332635 0.0190976 2026-02-24T08:24:47.404 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:47.545 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:47.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:47.663+0000 7f9962283640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:47.667 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:47.663+0000 7f9962283640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:47.685 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:47.685 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:47.699 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:47.700 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:47.713 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:47.713 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:47.728 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:47.728 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:47.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:47 trial105 ceph-mon[39442]: pgmap v159: 17 pgs: 17 active+clean; 1.0 GiB data, 8.0 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.38k op/s 2026-02-24T08:24:47.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:47 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1782595625' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:47.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 22 128 144927 144799 51.4152 32.6562 0.02061 0.0194294 2026-02-24T08:24:48.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 23 128 148784 148656 50.4898 30.1328 0.0596916 0.0197831 2026-02-24T08:24:49.778 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:49.802 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:24:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:24:49] "GET /metrics HTTP/1.1" 200 4213 "" "Prometheus/3.6.0" 2026-02-24T08:24:49.915 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:24:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:24:49.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:24:49.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 24 128 152874 152746 49.7174 31.9531 0.0141312 0.0200921 2026-02-24T08:24:50.040 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:50.036+0000 7fb2296db640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:50.040 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:50.036+0000 7fb2296db640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:50.055 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:50.055 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:50.056 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:49 trial105 ceph-mon[39442]: pgmap v160: 17 pgs: 17 active+clean; 1.0 GiB data, 8.0 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.32k op/s 2026-02-24T08:24:50.068 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:50.068 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:50.081 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:50.081 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:50.095 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:50.096 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:50.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 25 128 156636 156508 48.9042 29.3906 0.02182 0.020431 2026-02-24T08:24:51.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3423033994' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:51.359 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:24:51.360 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:24:51.360 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_2 2026-02-24T08:24:51.360 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:24:51.504 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:51.629 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:51.625+0000 7fa4f5d29640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:51.629 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:51.625+0000 7fa4f5d29640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:51.785 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:24:51.786 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:24:51.830 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2026-02-24T08:24:50.722015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1262019104,"num_objects":19251,"num_object_clones":0,"num_object_copies":57753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19251,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":154118,"num_write_kb":1234014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154082,"ondisk_log_size":154082,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8967532,"kb_used_data":3666844,"kb_used_omap":116,"kb_used_meta":5300491,"kb_avail":2927045268,"statfs":{"total":3006477107200,"available":2997294354432,"internally_reserved":0,"allocated":3754848256,"data_stored":3753419356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":118987,"internal_metadata":5427703605},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":590045184,"num_objects":9003,"num_object_clones":0,"num_object_copies":27009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9003,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72027,"num_write_kb":576216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001562"},"pg_stats":[{"pgid":"4.f","version":"53'9536","reported_seq":9543,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.455728+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:24:50.455728+0000","last_peered":"2026-02-24T08:24:50.455728+0000","last_clean":"2026-02-24T08:24:50.455728+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:24:50.455728+0000","last_undegraded":"2026-02-24T08:24:50.455728+0000","last_fullsized":"2026-02-24T08:24:50.455728+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9536,"log_dups_size":0,"ondisk_log_size":9536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78118912,"num_objects":1192,"num_object_clones":0,"num_object_copies":3576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9536,"num_write_kb":76288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"53'9080","reported_seq":9094,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.209570+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:24:50.209570+0000","last_peered":"2026-02-24T08:24:50.209570+0000","last_clean":"2026-02-24T08:24:50.209570+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:24:50.209570+0000","last_undegraded":"2026-02-24T08:24:50.209570+0000","last_fullsized":"2026-02-24T08:24:50.209570+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9080,"log_dups_size":0,"ondisk_log_size":9080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74383360,"num_objects":1135,"num_object_clones":0,"num_object_copies":3405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1135,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9080,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"53'9400","reported_seq":9414,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.255383+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:24:50.255383+0000","last_peered":"2026-02-24T08:24:50.255383+0000","last_clean":"2026-02-24T08:24:50.255383+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:24:50.255383+0000","last_undegraded":"2026-02-24T08:24:50.255383+0000","last_fullsized":"2026-02-24T08:24:50.255383+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9400,"log_dups_size":0,"ondisk_log_size":9400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77004800,"num_objects":1175,"num_object_clones":0,"num_object_copies":3525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9400,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"53'9928","reported_seq":9942,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.249183+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:24:50.249183+0000","last_peered":"2026-02-24T08:24:50.249183+0000","last_clean":"2026-02-24T08:24:50.249183+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:24:50.249183+0000","last_undegraded":"2026-02-24T08:24:50.249183+0000","last_fullsized":"2026-02-24T08:24:50.249183+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9928,"log_dups_size":0,"ondisk_log_size":9928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81330176,"num_objects":1241,"num_object_clones":0,"num_object_copies":3723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9928,"num_write_kb":79424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"53'9776","reported_seq":9790,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.074691+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:24:50.074691+0000","last_peered":"2026-02-24T08:24:50.074691+0000","last_clean":"2026-02-24T08:24:50.074691+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:24:50.074691+0000","last_undegraded":"2026-02-24T08:24:50.074691+0000","last_fullsized":"2026-02-24T08:24:50.074691+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9776,"log_dups_size":0,"ondisk_log_size":9776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80084992,"num_objects":1222,"num_object_clones":0,"num_object_copies":3666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9776,"num_write_kb":78208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"53'9680","reported_seq":9692,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.207196+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:24:50.207196+0000","last_peered":"2026-02-24T08:24:50.207196+0000","last_clean":"2026-02-24T08:24:50.207196+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:24:50.207196+0000","last_undegraded":"2026-02-24T08:24:50.207196+0000","last_fullsized":"2026-02-24T08:24:50.207196+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9680,"log_dups_size":0,"ondisk_log_size":9680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79298560,"num_objects":1210,"num_object_clones":0,"num_object_copies":3630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9680,"num_write_kb":77440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"53'9832","reported_seq":9846,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.192472+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:24:50.192472+0000","last_peered":"2026-02-24T08:24:50.192472+0000","last_clean":"2026-02-24T08:24:50.192472+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:24:50.192472+0000","last_undegraded":"2026-02-24T08:24:50.192472+0000","last_fullsized":"2026-02-24T08:24:50.192472+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9832,"log_dups_size":0,"ondisk_log_size":9832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80543744,"num_objects":1229,"num_object_clones":0,"num_object_copies":3687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9832,"num_write_kb":78656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"53'9720","reported_seq":9734,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.227318+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:24:50.227318+0000","last_peered":"2026-02-24T08:24:50.227318+0000","last_clean":"2026-02-24T08:24:50.227318+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:24:50.227318+0000","last_undegraded":"2026-02-24T08:24:50.227318+0000","last_fullsized":"2026-02-24T08:24:50.227318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9720,"log_dups_size":0,"ondisk_log_size":9720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79626240,"num_objects":1215,"num_object_clones":0,"num_object_copies":3645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9720,"num_write_kb":77760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"53'9760","reported_seq":9774,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.479079+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:24:50.479079+0000","last_peered":"2026-02-24T08:24:50.479079+0000","last_clean":"2026-02-24T08:24:50.479079+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:24:50.479079+0000","last_undegraded":"2026-02-24T08:24:50.479079+0000","last_fullsized":"2026-02-24T08:24:50.479079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9760,"log_dups_size":0,"ondisk_log_size":9760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79953920,"num_objects":1220,"num_object_clones":0,"num_object_copies":3660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9760,"num_write_kb":78080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"53'9544","reported_seq":9558,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.054550+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:24:50.054550+0000","last_peered":"2026-02-24T08:24:50.054550+0000","last_clean":"2026-02-24T08:24:50.054550+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:24:50.054550+0000","last_undegraded":"2026-02-24T08:24:50.054550+0000","last_fullsized":"2026-02-24T08:24:50.054550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9544,"log_dups_size":0,"ondisk_log_size":9544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78184448,"num_objects":1193,"num_object_clones":0,"num_object_copies":3579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9544,"num_write_kb":76352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"53'9496","reported_seq":9510,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.441066+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:24:50.441066+0000","last_peered":"2026-02-24T08:24:50.441066+0000","last_clean":"2026-02-24T08:24:50.441066+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:24:50.441066+0000","last_undegraded":"2026-02-24T08:24:50.441066+0000","last_fullsized":"2026-02-24T08:24:50.441066+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9496,"log_dups_size":0,"ondisk_log_size":9496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77791232,"num_objects":1187,"num_object_clones":0,"num_object_copies":3561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9496,"num_write_kb":75968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"53'9936","reported_seq":9942,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.106474+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:24:50.106474+0000","last_peered":"2026-02-24T08:24:50.106474+0000","last_clean":"2026-02-24T08:24:50.106474+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:24:50.106474+0000","last_undegraded":"2026-02-24T08:24:50.106474+0000","last_fullsized":"2026-02-24T08:24:50.106474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9936,"log_dups_size":0,"ondisk_log_size":9936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81395712,"num_objects":1242,"num_object_clones":0,"num_object_copies":3726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9936,"num_write_kb":79488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"53'9848","reported_seq":9862,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.460300+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:24:50.460300+0000","last_peered":"2026-02-24T08:24:50.460300+0000","last_clean":"2026-02-24T08:24:50.460300+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:24:50.460300+0000","last_undegraded":"2026-02-24T08:24:50.460300+0000","last_fullsized":"2026-02-24T08:24:50.460300+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9848,"log_dups_size":0,"ondisk_log_size":9848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80674816,"num_objects":1231,"num_object_clones":0,"num_object_copies":3693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1231,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9848,"num_write_kb":78784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'9734","reported_seq":9746,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.204254+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:24:50.204254+0000","last_peered":"2026-02-24T08:24:50.204254+0000","last_clean":"2026-02-24T08:24:50.204254+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:24:50.204254+0000","last_undegraded":"2026-02-24T08:24:50.204254+0000","last_fullsized":"2026-02-24T08:24:50.204254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9734,"log_dups_size":0,"ondisk_log_size":9734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79740928,"num_objects":1217,"num_object_clones":0,"num_object_copies":3651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9734,"num_write_kb":77872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'9424","reported_seq":9432,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.100820+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:24:50.100820+0000","last_peered":"2026-02-24T08:24:50.100820+0000","last_clean":"2026-02-24T08:24:50.100820+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:24:50.100820+0000","last_undegraded":"2026-02-24T08:24:50.100820+0000","last_fullsized":"2026-02-24T08:24:50.100820+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9424,"log_dups_size":0,"ondisk_log_size":9424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77201408,"num_objects":1178,"num_object_clones":0,"num_object_copies":3534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9424,"num_write_kb":75392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"53'9289","reported_seq":9295,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:50.274442+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:24:50.274442+0000","last_peered":"2026-02-24T08:24:50.274442+0000","last_clean":"2026-02-24T08:24:50.274442+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:24:50.274442+0000","last_undegraded":"2026-02-24T08:24:50.274442+0000","last_fullsized":"2026-02-24T08:24:50.274442+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":9289,"log_dups_size":0,"ondisk_log_size":9289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76095488,"num_objects":1162,"num_object_clones":0,"num_object_copies":3486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9289,"num_write_kb":74312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:25.941762+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:24:25.941762+0000","last_peered":"2026-02-24T08:24:25.941762+0000","last_clean":"2026-02-24T08:24:25.941762+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:24:25.941762+0000","last_undegraded":"2026-02-24T08:24:25.941762+0000","last_fullsized":"2026-02-24T08:24:25.941762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1261428736,"num_objects":19249,"num_object_clones":0,"num_object_copies":57747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153983,"num_write_kb":1231864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3783753728,"data_stored":3783753728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153983,"ondisk_log_size":153983,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9232,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2265652,"kb_used_data":914592,"kb_used_omap":22,"kb_used_meta":1351017,"kb_avail":731737548,"statfs":{"total":751619276800,"available":749299249152,"internally_reserved":0,"allocated":936542208,"data_stored":936184095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22972,"internal_metadata":1383441988},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444090,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2465204,"kb_used_data":1076320,"kb_used_omap":28,"kb_used_meta":1388835,"kb_avail":731537996,"statfs":{"total":751619276800,"available":749094907904,"internally_reserved":0,"allocated":1102151680,"data_stored":1101793567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29618,"internal_metadata":1422167118},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2018880,"kb_used_data":756972,"kb_used_omap":30,"kb_used_meta":1261857,"kb_avail":731984320,"statfs":{"total":751619276800,"available":749551943680,"internally_reserved":0,"allocated":775139328,"data_stored":774784767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31571,"internal_metadata":1292141741},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2217796,"kb_used_data":918960,"kb_used_omap":34,"kb_used_meta":1298781,"kb_avail":731785404,"statfs":{"total":751619276800,"available":749348253696,"internally_reserved":0,"allocated":941015040,"data_stored":940656927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34826,"internal_metadata":1329952758},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9232,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":944955392,"data_stored":944955392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":793952256,"data_stored":793952256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1102307328,"data_stored":1102307328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":942538752,"data_stored":942538752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:24:51.833 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_2 pgp_num 26 2026-02-24T08:24:51.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 26 127 160304 160177 48.1257 28.6641 0.0646871 0.020755 2026-02-24T08:24:51.977 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:52.037 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:51 trial105 ceph-mon[39442]: pgmap v161: 17 pgs: 17 active+clean; 1.2 GiB data, 8.6 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s wr, 6.00k op/s 2026-02-24T08:24:52.112 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:52.108+0000 7f5a07d71640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:52.115 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:52.111+0000 7f5a07d71640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:52.140 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:52.260 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:24:52.289 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:52.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:24:52.415 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:52.411+0000 7f6f1ab02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:52.415 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:52.411+0000 7f6f1ab02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:52.429 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:52.430 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:52.444 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:52.444 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:52.458 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:52.458 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:52.472 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:52.473 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:52.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 27 128 163816 163688 47.3591 27.4297 0.0557865 0.0210883 2026-02-24T08:24:53.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:52 trial105 ceph-mon[39442]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:24:53.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3700346172' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "26"} : dispatch 2026-02-24T08:24:53.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/340631574' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:53.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 28 128 167457 167329 46.6835 28.4453 0.051776 0.0214003 2026-02-24T08:24:54.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:53 trial105 ceph-mon[39442]: pgmap v162: 17 pgs: 17 active+clean; 1.2 GiB data, 8.6 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.68k op/s 2026-02-24T08:24:54.516 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:54.657 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:54.794 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:54.791+0000 7f1a40e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:54.794 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:54.791+0000 7f1a40e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:54.810 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:54.810 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:54.823 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:54.823 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:54.837 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:54.837 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:54.851 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:54.851 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:54.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 29 128 171072 170944 46.0476 28.2422 0.10224 0.0216931 2026-02-24T08:24:55.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:54 trial105 ceph-mon[39442]: pgmap v163: 17 pgs: 17 active+clean; 1.2 GiB data, 8.6 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.68k op/s 2026-02-24T08:24:55.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/857996252' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:55.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 30 128 174696 174568 45.4563 28.3125 0.00898599 0.0219802 2026-02-24T08:24:56.925 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:24:56.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 31 128 178438 178310 44.933 29.2344 0.0114742 0.0222357 2026-02-24T08:24:57.073 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:57.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:56 trial105 ceph-mon[39442]: osdmap e54: 4 total, 4 up, 4 in 2026-02-24T08:24:57.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:56 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:24:57.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:56 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:24:57.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:56 trial105 ceph-mon[39442]: pgmap v165: 17 pgs: 17 active+clean; 1.3 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.84k op/s 2026-02-24T08:24:57.191 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:57.188+0000 7fd05bbae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:57.191 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:57.189+0000 7fd05bbae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:57.208 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:57.209 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:57.221 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:57.222 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:57.236 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:57.236 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:57.250 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:57.250 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:57.305 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:24:57.305 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:24:57.305 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:24:57.306 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:24:57.481 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:57.603 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:57.600+0000 7fa15d88e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:57.603 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:57.600+0000 7fa15d88e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:57.753 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:24:57.754 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:24:57.801 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2026-02-24T08:24:56.722806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1411695136,"num_objects":21538,"num_object_clones":0,"num_object_copies":64614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21538,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":172389,"num_write_kb":1380182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160853,"ondisk_log_size":160853,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9549676,"kb_used_data":4122652,"kb_used_omap":116,"kb_used_meta":5426827,"kb_avail":2926463124,"statfs":{"total":3006477107200,"available":2996698238976,"internally_reserved":0,"allocated":4221595648,"data_stored":4220166748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":118987,"internal_metadata":5557071669},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,11,3,1,0,22],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":314949632,"num_objects":4809,"num_object_clones":0,"num_object_copies":14427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4809,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38446,"num_write_kb":307568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001309"},"pg_stats":[{"pgid":"4.f","version":"53'10720","reported_seq":10734,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.470038+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:24:55.470038+0000","last_peered":"2026-02-24T08:24:55.470038+0000","last_clean":"2026-02-24T08:24:55.470038+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:24:55.470038+0000","last_undegraded":"2026-02-24T08:24:55.470038+0000","last_fullsized":"2026-02-24T08:24:55.470038+0000","mapping_epoch":51,"log_start":"53'700","ondisk_log_start":"53'700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87818240,"num_objects":1340,"num_object_clones":0,"num_object_copies":4020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10720,"num_write_kb":85760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"53'10210","reported_seq":10222,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.218883+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:24:55.218883+0000","last_peered":"2026-02-24T08:24:55.218883+0000","last_clean":"2026-02-24T08:24:55.218883+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:24:55.218883+0000","last_undegraded":"2026-02-24T08:24:55.218883+0000","last_fullsized":"2026-02-24T08:24:55.218883+0000","mapping_epoch":51,"log_start":"53'200","ondisk_log_start":"53'200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83640320,"num_objects":1277,"num_object_clones":0,"num_object_copies":3831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10210,"num_write_kb":81680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"53'10632","reported_seq":10644,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.289221+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:24:55.289221+0000","last_peered":"2026-02-24T08:24:55.289221+0000","last_clean":"2026-02-24T08:24:55.289221+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:24:55.289221+0000","last_undegraded":"2026-02-24T08:24:55.289221+0000","last_fullsized":"2026-02-24T08:24:55.289221+0000","mapping_epoch":51,"log_start":"53'600","ondisk_log_start":"53'600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87097344,"num_objects":1329,"num_object_clones":0,"num_object_copies":3987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10632,"num_write_kb":85056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"53'11227","reported_seq":11234,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.284750+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:24:55.284750+0000","last_peered":"2026-02-24T08:24:55.284750+0000","last_clean":"2026-02-24T08:24:55.284750+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:24:55.284750+0000","last_undegraded":"2026-02-24T08:24:55.284750+0000","last_fullsized":"2026-02-24T08:24:55.284750+0000","mapping_epoch":51,"log_start":"53'1200","ondisk_log_start":"53'1200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91971584,"num_objects":1404,"num_object_clones":0,"num_object_copies":4212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11227,"num_write_kb":89816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"53'10932","reported_seq":10937,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.124490+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:24:55.124490+0000","last_peered":"2026-02-24T08:24:55.124490+0000","last_clean":"2026-02-24T08:24:55.124490+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:24:55.124490+0000","last_undegraded":"2026-02-24T08:24:55.124490+0000","last_fullsized":"2026-02-24T08:24:55.124490+0000","mapping_epoch":51,"log_start":"53'900","ondisk_log_start":"53'900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89554944,"num_objects":1367,"num_object_clones":0,"num_object_copies":4101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10932,"num_write_kb":87456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"53'10876","reported_seq":10887,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.188527+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:24:55.188527+0000","last_peered":"2026-02-24T08:24:55.188527+0000","last_clean":"2026-02-24T08:24:55.188527+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:24:55.188527+0000","last_undegraded":"2026-02-24T08:24:55.188527+0000","last_fullsized":"2026-02-24T08:24:55.188527+0000","mapping_epoch":51,"log_start":"53'800","ondisk_log_start":"53'800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89096192,"num_objects":1360,"num_object_clones":0,"num_object_copies":4080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10876,"num_write_kb":87008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"53'10928","reported_seq":10942,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.201660+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:24:55.201660+0000","last_peered":"2026-02-24T08:24:55.201660+0000","last_clean":"2026-02-24T08:24:55.201660+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:24:55.201660+0000","last_undegraded":"2026-02-24T08:24:55.201660+0000","last_fullsized":"2026-02-24T08:24:55.201660+0000","mapping_epoch":51,"log_start":"53'900","ondisk_log_start":"53'900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89522176,"num_objects":1366,"num_object_clones":0,"num_object_copies":4098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1366,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10928,"num_write_kb":87424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"53'10584","reported_seq":10598,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.270321+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:24:55.270321+0000","last_peered":"2026-02-24T08:24:55.270321+0000","last_clean":"2026-02-24T08:24:55.270321+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:24:55.270321+0000","last_undegraded":"2026-02-24T08:24:55.270321+0000","last_fullsized":"2026-02-24T08:24:55.270321+0000","mapping_epoch":51,"log_start":"53'500","ondisk_log_start":"53'500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86704128,"num_objects":1323,"num_object_clones":0,"num_object_copies":3969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10584,"num_write_kb":84672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"53'10792","reported_seq":10806,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.479007+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:24:55.479007+0000","last_peered":"2026-02-24T08:24:55.479007+0000","last_clean":"2026-02-24T08:24:55.479007+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:24:55.479007+0000","last_undegraded":"2026-02-24T08:24:55.479007+0000","last_fullsized":"2026-02-24T08:24:55.479007+0000","mapping_epoch":51,"log_start":"53'700","ondisk_log_start":"53'700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88408064,"num_objects":1349,"num_object_clones":0,"num_object_copies":4047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10792,"num_write_kb":86336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"53'10725","reported_seq":10736,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.123693+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:24:55.123693+0000","last_peered":"2026-02-24T08:24:55.123693+0000","last_clean":"2026-02-24T08:24:55.123693+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:24:55.123693+0000","last_undegraded":"2026-02-24T08:24:55.123693+0000","last_fullsized":"2026-02-24T08:24:55.123693+0000","mapping_epoch":51,"log_start":"53'700","ondisk_log_start":"53'700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87859200,"num_objects":1341,"num_object_clones":0,"num_object_copies":4023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10725,"num_write_kb":85800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"53'10720","reported_seq":10734,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.444228+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:24:55.444228+0000","last_peered":"2026-02-24T08:24:55.444228+0000","last_clean":"2026-02-24T08:24:55.444228+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:24:55.444228+0000","last_undegraded":"2026-02-24T08:24:55.444228+0000","last_fullsized":"2026-02-24T08:24:55.444228+0000","mapping_epoch":51,"log_start":"53'700","ondisk_log_start":"53'700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87818240,"num_objects":1340,"num_object_clones":0,"num_object_copies":4020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10720,"num_write_kb":85760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"53'11264","reported_seq":11278,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.117477+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:24:55.117477+0000","last_peered":"2026-02-24T08:24:55.117477+0000","last_clean":"2026-02-24T08:24:55.117477+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:24:55.117477+0000","last_undegraded":"2026-02-24T08:24:55.117477+0000","last_fullsized":"2026-02-24T08:24:55.117477+0000","mapping_epoch":51,"log_start":"53'1200","ondisk_log_start":"53'1200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11264,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"53'10995","reported_seq":11005,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.495630+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:24:55.495630+0000","last_peered":"2026-02-24T08:24:55.495630+0000","last_clean":"2026-02-24T08:24:55.495630+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:24:55.495630+0000","last_undegraded":"2026-02-24T08:24:55.495630+0000","last_fullsized":"2026-02-24T08:24:55.495630+0000","mapping_epoch":51,"log_start":"53'900","ondisk_log_start":"53'900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90071040,"num_objects":1375,"num_object_clones":0,"num_object_copies":4125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1375,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10995,"num_write_kb":87960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'10808","reported_seq":10822,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.086048+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:24:55.086048+0000","last_peered":"2026-02-24T08:24:55.086048+0000","last_clean":"2026-02-24T08:24:55.086048+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:24:55.086048+0000","last_undegraded":"2026-02-24T08:24:55.086048+0000","last_fullsized":"2026-02-24T08:24:55.086048+0000","mapping_epoch":51,"log_start":"53'800","ondisk_log_start":"53'800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88539136,"num_objects":1351,"num_object_clones":0,"num_object_copies":4053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10808,"num_write_kb":86464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'10593","reported_seq":10600,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.120312+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:24:55.120312+0000","last_peered":"2026-02-24T08:24:55.120312+0000","last_clean":"2026-02-24T08:24:55.120312+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:24:55.120312+0000","last_undegraded":"2026-02-24T08:24:55.120312+0000","last_fullsized":"2026-02-24T08:24:55.120312+0000","mapping_epoch":51,"log_start":"53'500","ondisk_log_start":"53'500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86777856,"num_objects":1325,"num_object_clones":0,"num_object_copies":3975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10593,"num_write_kb":84744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"53'10248","reported_seq":10262,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.276026+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:24:55.276026+0000","last_peered":"2026-02-24T08:24:55.276026+0000","last_clean":"2026-02-24T08:24:55.276026+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:24:55.276026+0000","last_undegraded":"2026-02-24T08:24:55.276026+0000","last_fullsized":"2026-02-24T08:24:55.276026+0000","mapping_epoch":51,"log_start":"53'200","ondisk_log_start":"53'200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83951616,"num_objects":1281,"num_object_clones":0,"num_object_copies":3843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1281,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10248,"num_write_kb":81984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-24T08:24:25.941762+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:24:25.941762+0000","last_peered":"2026-02-24T08:24:25.941762+0000","last_clean":"2026-02-24T08:24:25.941762+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:24:25.941762+0000","last_undegraded":"2026-02-24T08:24:25.941762+0000","last_fullsized":"2026-02-24T08:24:25.941762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1411104768,"num_objects":21536,"num_object_clones":0,"num_object_copies":64608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172254,"num_write_kb":1378032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4232347648,"data_stored":4232347648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160754,"ondisk_log_size":160754,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9232,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2431660,"kb_used_data":1026456,"kb_used_omap":22,"kb_used_meta":1405161,"kb_avail":731571540,"statfs":{"total":751619276800,"available":749129256960,"internally_reserved":0,"allocated":1051090944,"data_stored":1050732831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22972,"internal_metadata":1438885444},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,11,3,1,0,22],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444091,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2628524,"kb_used_data":1203544,"kb_used_omap":28,"kb_used_meta":1424931,"kb_avail":731374676,"statfs":{"total":751619276800,"available":748927668224,"internally_reserved":0,"allocated":1232429056,"data_stored":1232070943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29618,"internal_metadata":1459129422},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2128536,"kb_used_data":866628,"kb_used_omap":30,"kb_used_meta":1261857,"kb_avail":731874664,"statfs":{"total":751619276800,"available":749439655936,"internally_reserved":0,"allocated":887427072,"data_stored":887072511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31571,"internal_metadata":1292141741},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2360956,"kb_used_data":1026024,"kb_used_omap":34,"kb_used_meta":1334877,"kb_avail":731642244,"statfs":{"total":751619276800,"available":749201657856,"internally_reserved":0,"allocated":1050648576,"data_stored":1050290463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34826,"internal_metadata":1366915062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9232,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1055105024,"data_stored":1055105024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":889446400,"data_stored":889446400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1232289792,"data_stored":1232289792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1055506432,"data_stored":1055506432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:24:57.803 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 91 2026-02-24T08:24:57.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 32 128 181950 181822 44.3862 27.4375 0.0206396 0.0225111 2026-02-24T08:24:57.944 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:58.015 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1031473462' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:24:58.015 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:57 trial105 ceph-mon[39442]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:24:58.071 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:58.068+0000 7ff87a703640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:58.071 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:58.068+0000 7ff87a703640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:58.220 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:24:58.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:24:58.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 33 128 185509 185381 43.8836 27.8047 0.0221273 0.0227674 2026-02-24T08:24:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3183660890' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "91"} : dispatch 2026-02-24T08:24:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:58 trial105 ceph-mon[39442]: pgmap v166: 17 pgs: 17 active+clean; 1.3 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.84k op/s 2026-02-24T08:24:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:58 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:24:59.294 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:24:59.425 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:24:59.556 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:59.554+0000 7f631a62a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:59.557 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:24:59.554+0000 7f631a62a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:24:59.573 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:24:59.573 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:24:59.573 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:24:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:24:59] "GET /metrics HTTP/1.1" 200 4222 "" "Prometheus/3.6.0" 2026-02-24T08:24:59.586 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:24:59.586 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:24:59.600 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:24:59.600 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:24:59.614 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:24:59.614 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:24:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:24:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:24:59.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:24:59.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 34 128 189137 189009 43.4265 28.3438 0.0871611 0.0230071 2026-02-24T08:25:00.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:24:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4178006857' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:00.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 35 127 192776 192649 42.9982 28.4375 0.0137193 0.0232392 2026-02-24T08:25:01.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:00 trial105 ceph-mon[39442]: pgmap v167: 17 pgs: 17 active+clean; 1.5 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.63k op/s 2026-02-24T08:25:01.661 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:01.799 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:01.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 36 128 196047 195919 42.5134 25.5469 0.101126 0.0234988 2026-02-24T08:25:01.982 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:01.979+0000 7f91cd420640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:01.982 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:01.980+0000 7f91cd420640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:01.997 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:01.998 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:02.011 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:02.011 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:02.024 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:02.025 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:02.039 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:02.039 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:02.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2208719327' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:02.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 37 128 199752 199624 42.1466 28.9453 0.0336921 0.0237075 2026-02-24T08:25:03.258 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:25:03.259 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:25:03.259 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-24T08:25:03.259 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:03.287 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:03 trial105 ceph-mon[39442]: pgmap v168: 17 pgs: 17 active+clean; 1.5 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.63k op/s 2026-02-24T08:25:03.411 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:03.542 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:03.539+0000 7f58fb587640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:03.542 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:03.539+0000 7f58fb587640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:03.686 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:03.687 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:03.733 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2026-02-24T08:25:02.723645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1559896608,"num_objects":23797,"num_object_clones":0,"num_object_copies":71391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23797,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":190480,"num_write_kb":1524910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160944,"ondisk_log_size":160944,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10053732,"kb_used_data":4554516,"kb_used_omap":118,"kb_used_meta":5499017,"kb_avail":2925959068,"statfs":{"total":3006477107200,"available":2996182085632,"internally_reserved":0,"allocated":4663824384,"data_stored":4662364136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":121665,"internal_metadata":5630993599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,11,11,11,0,16,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":297877504,"num_objects":4546,"num_object_clones":0,"num_object_copies":13638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36362,"num_write_kb":290896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001337"},"pg_stats":[{"pgid":"4.f","version":"54'11728","reported_seq":11744,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.505393+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:00.505393+0000","last_peered":"2026-02-24T08:25:00.505393+0000","last_clean":"2026-02-24T08:25:00.505393+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:00.505393+0000","last_undegraded":"2026-02-24T08:25:00.505393+0000","last_fullsized":"2026-02-24T08:25:00.505393+0000","mapping_epoch":51,"log_start":"53'1700","ondisk_log_start":"53'1700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96075776,"num_objects":1466,"num_object_clones":0,"num_object_copies":4398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11728,"num_write_kb":93824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"54'11264","reported_seq":11280,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.237034+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:00.237034+0000","last_peered":"2026-02-24T08:25:00.237034+0000","last_clean":"2026-02-24T08:25:00.237034+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:00.237034+0000","last_undegraded":"2026-02-24T08:25:00.237034+0000","last_fullsized":"2026-02-24T08:25:00.237034+0000","mapping_epoch":51,"log_start":"53'1200","ondisk_log_start":"53'1200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1408,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11264,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"54'11888","reported_seq":11904,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.292137+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:00.292137+0000","last_peered":"2026-02-24T08:25:00.292137+0000","last_clean":"2026-02-24T08:25:00.292137+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:00.292137+0000","last_undegraded":"2026-02-24T08:25:00.292137+0000","last_fullsized":"2026-02-24T08:25:00.292137+0000","mapping_epoch":51,"log_start":"53'1800","ondisk_log_start":"53'1800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97386496,"num_objects":1486,"num_object_clones":0,"num_object_copies":4458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11888,"num_write_kb":95104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"54'12504","reported_seq":12520,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.301914+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:00.301914+0000","last_peered":"2026-02-24T08:25:00.301914+0000","last_clean":"2026-02-24T08:25:00.301914+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:00.301914+0000","last_undegraded":"2026-02-24T08:25:00.301914+0000","last_fullsized":"2026-02-24T08:25:00.301914+0000","mapping_epoch":51,"log_start":"53'2500","ondisk_log_start":"53'2500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102432768,"num_objects":1563,"num_object_clones":0,"num_object_copies":4689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1563,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12504,"num_write_kb":100032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"54'11984","reported_seq":12000,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.116944+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:25:00.116944+0000","last_peered":"2026-02-24T08:25:00.116944+0000","last_clean":"2026-02-24T08:25:00.116944+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:00.116944+0000","last_undegraded":"2026-02-24T08:25:00.116944+0000","last_fullsized":"2026-02-24T08:25:00.116944+0000","mapping_epoch":51,"log_start":"53'1900","ondisk_log_start":"53'1900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98172928,"num_objects":1498,"num_object_clones":0,"num_object_copies":4494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11984,"num_write_kb":95872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"54'11984","reported_seq":12000,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.180283+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:00.180283+0000","last_peered":"2026-02-24T08:25:00.180283+0000","last_clean":"2026-02-24T08:25:00.180283+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:00.180283+0000","last_undegraded":"2026-02-24T08:25:00.180283+0000","last_fullsized":"2026-02-24T08:25:00.180283+0000","mapping_epoch":51,"log_start":"53'1900","ondisk_log_start":"53'1900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98172928,"num_objects":1498,"num_object_clones":0,"num_object_copies":4494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11984,"num_write_kb":95872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"54'12224","reported_seq":12240,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.142760+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:25:00.142760+0000","last_peered":"2026-02-24T08:25:00.142760+0000","last_clean":"2026-02-24T08:25:00.142760+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:00.142760+0000","last_undegraded":"2026-02-24T08:25:00.142760+0000","last_fullsized":"2026-02-24T08:25:00.142760+0000","mapping_epoch":51,"log_start":"53'2200","ondisk_log_start":"53'2200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100139008,"num_objects":1528,"num_object_clones":0,"num_object_copies":4584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1528,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12224,"num_write_kb":97792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"54'11848","reported_seq":11864,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.269577+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:25:00.269577+0000","last_peered":"2026-02-24T08:25:00.269577+0000","last_clean":"2026-02-24T08:25:00.269577+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:00.269577+0000","last_undegraded":"2026-02-24T08:25:00.269577+0000","last_fullsized":"2026-02-24T08:25:00.269577+0000","mapping_epoch":51,"log_start":"53'1800","ondisk_log_start":"53'1800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97058816,"num_objects":1481,"num_object_clones":0,"num_object_copies":4443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":94784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"54'11968","reported_seq":11984,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.514552+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:25:00.514552+0000","last_peered":"2026-02-24T08:25:00.514552+0000","last_clean":"2026-02-24T08:25:00.514552+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:00.514552+0000","last_undegraded":"2026-02-24T08:25:00.514552+0000","last_fullsized":"2026-02-24T08:25:00.514552+0000","mapping_epoch":51,"log_start":"53'1900","ondisk_log_start":"53'1900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98041856,"num_objects":1496,"num_object_clones":0,"num_object_copies":4488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11968,"num_write_kb":95744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"54'11800","reported_seq":11816,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.077170+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:25:00.077170+0000","last_peered":"2026-02-24T08:25:00.077170+0000","last_clean":"2026-02-24T08:25:00.077170+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:00.077170+0000","last_undegraded":"2026-02-24T08:25:00.077170+0000","last_fullsized":"2026-02-24T08:25:00.077170+0000","mapping_epoch":51,"log_start":"53'1700","ondisk_log_start":"53'1700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96665600,"num_objects":1475,"num_object_clones":0,"num_object_copies":4425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11800,"num_write_kb":94400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"54'11810","reported_seq":11824,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.509034+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:25:00.509034+0000","last_peered":"2026-02-24T08:25:00.509034+0000","last_clean":"2026-02-24T08:25:00.509034+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:00.509034+0000","last_undegraded":"2026-02-24T08:25:00.509034+0000","last_fullsized":"2026-02-24T08:25:00.509034+0000","mapping_epoch":51,"log_start":"53'1800","ondisk_log_start":"53'1800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96747520,"num_objects":1477,"num_object_clones":0,"num_object_copies":4431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1477,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11810,"num_write_kb":94480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"54'12344","reported_seq":12360,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.130598+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:25:00.130598+0000","last_peered":"2026-02-24T08:25:00.130598+0000","last_clean":"2026-02-24T08:25:00.130598+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:00.130598+0000","last_undegraded":"2026-02-24T08:25:00.130598+0000","last_fullsized":"2026-02-24T08:25:00.130598+0000","mapping_epoch":51,"log_start":"53'2300","ondisk_log_start":"53'2300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101122048,"num_objects":1543,"num_object_clones":0,"num_object_copies":4629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12344,"num_write_kb":98752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"54'12029","reported_seq":12044,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.507060+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:25:00.507060+0000","last_peered":"2026-02-24T08:25:00.507060+0000","last_clean":"2026-02-24T08:25:00.507060+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:00.507060+0000","last_undegraded":"2026-02-24T08:25:00.507060+0000","last_fullsized":"2026-02-24T08:25:00.507060+0000","mapping_epoch":51,"log_start":"53'2000","ondisk_log_start":"53'2000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98541568,"num_objects":1504,"num_object_clones":0,"num_object_copies":4512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12029,"num_write_kb":96232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"54'11861","reported_seq":11874,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.227040+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:00.227040+0000","last_peered":"2026-02-24T08:25:00.227040+0000","last_clean":"2026-02-24T08:25:00.227040+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:00.227040+0000","last_undegraded":"2026-02-24T08:25:00.227040+0000","last_fullsized":"2026-02-24T08:25:00.227040+0000","mapping_epoch":51,"log_start":"53'1800","ondisk_log_start":"53'1800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97165312,"num_objects":1483,"num_object_clones":0,"num_object_copies":4449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1483,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11861,"num_write_kb":94888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"54'11752","reported_seq":11768,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.059047+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:25:00.059047+0000","last_peered":"2026-02-24T08:25:00.059047+0000","last_clean":"2026-02-24T08:25:00.059047+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:00.059047+0000","last_undegraded":"2026-02-24T08:25:00.059047+0000","last_fullsized":"2026-02-24T08:25:00.059047+0000","mapping_epoch":51,"log_start":"53'1700","ondisk_log_start":"53'1700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96272384,"num_objects":1469,"num_object_clones":0,"num_object_copies":4407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1469,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11752,"num_write_kb":94016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"54'11357","reported_seq":11363,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:25:00.292335+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:00.292335+0000","last_peered":"2026-02-24T08:25:00.292335+0000","last_clean":"2026-02-24T08:25:00.292335+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:00.292335+0000","last_undegraded":"2026-02-24T08:25:00.292335+0000","last_fullsized":"2026-02-24T08:25:00.292335+0000","mapping_epoch":51,"log_start":"53'1300","ondisk_log_start":"53'1300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93036544,"num_objects":1420,"num_object_clones":0,"num_object_copies":4260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11357,"num_write_kb":90856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":127,"reported_epoch":54,"state":"active+clean","last_fresh":"2026-02-24T08:24:55.910550+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:24:55.910550+0000","last_peered":"2026-02-24T08:24:55.910550+0000","last_clean":"2026-02-24T08:24:55.910550+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:24:55.910550+0000","last_undegraded":"2026-02-24T08:24:55.910550+0000","last_fullsized":"2026-02-24T08:24:55.910550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1559306240,"num_objects":23795,"num_object_clones":0,"num_object_copies":71385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23795,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190345,"num_write_kb":1522760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4676780032,"data_stored":4676780032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160845,"ondisk_log_size":160845,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9264,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247866,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2556536,"kb_used_data":1133284,"kb_used_omap":22,"kb_used_meta":1423209,"kb_avail":731446664,"statfs":{"total":751619276800,"available":749001383936,"internally_reserved":0,"allocated":1160482816,"data_stored":1160116866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23046,"internal_metadata":1457366522},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444092,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2757368,"kb_used_data":1332388,"kb_used_omap":30,"kb_used_meta":1424929,"kb_avail":731245832,"statfs":{"total":751619276800,"available":748795731968,"internally_reserved":0,"allocated":1364365312,"data_stored":1363999362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30920,"internal_metadata":1459128120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,11,11,11,0,16,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2234692,"kb_used_data":954736,"kb_used_omap":31,"kb_used_meta":1279904,"kb_avail":731768508,"statfs":{"total":751619276800,"available":749330952192,"internally_reserved":0,"allocated":977649664,"data_stored":977287266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32222,"internal_metadata":1310622242},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2505136,"kb_used_data":1134108,"kb_used_omap":34,"kb_used_meta":1370973,"kb_avail":731498064,"statfs":{"total":751619276800,"available":749054017536,"internally_reserved":0,"allocated":1161326592,"data_stored":1160960642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35477,"internal_metadata":1403876715},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9264,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1166704640,"data_stored":1166704640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":980328448,"data_stored":980328448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1363427328,"data_stored":1363427328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1166319616,"data_stored":1166319616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:03.734 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:25:03.734 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 36 2026-02-24T08:25:03.912 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:03.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 38 128 203229 203101 41.7523 27.1641 0.135262 0.0239142 2026-02-24T08:25:04.034 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:04.031+0000 7f302d109640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:04.034 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:04.031+0000 7f302d109640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:04.082 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:04.107 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:04 trial105 ceph-mon[39442]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:04.185 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:25:04.231 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:04.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:25:04.355 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:04.353+0000 7f5c06c29640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:04.356 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:04.353+0000 7f5c06c29640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:04.372 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:04.372 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:04.386 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:04.386 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:04.399 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:04.399 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:04.414 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:04.414 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:04.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 39 128 206793 206665 41.3956 27.8438 0.0231548 0.02414 2026-02-24T08:25:05.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:05 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3780718021' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T08:25:05.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:05 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2255102018' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:05.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:05 trial105 ceph-mon[39442]: pgmap v169: 17 pgs: 17 active+clean; 1.5 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.63k op/s 2026-02-24T08:25:05.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:25:05.942657+0000 min lat: 0.00104395 max lat: 0.204129 avg lat: 0.0243132 2026-02-24T08:25:05.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:25:05.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 40 128 210561 210433 41.0966 29.4375 0.0310782 0.0243132 2026-02-24T08:25:06.457 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:06.601 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:06.929 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:06.863+0000 7f951fa50640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:06.930 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:06.863+0000 7f951fa50640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:06.930 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:06.930 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:06.930 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:06.931 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:06.931 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:06.931 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:06.934 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:06.934 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:06.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 41 128 213893 213765 40.7291 26.0312 0.0200458 0.0245322 2026-02-24T08:25:07.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:07 trial105 ceph-mon[39442]: osdmap e55: 4 total, 4 up, 4 in 2026-02-24T08:25:07.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:07 trial105 ceph-mon[39442]: pgmap v171: 17 pgs: 17 active+clean; 1.6 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.58k op/s 2026-02-24T08:25:07.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2654151295' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:07.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 42 128 217031 216903 40.343 24.5156 0.0351013 0.0247723 2026-02-24T08:25:08.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 43 128 220847 220719 40.0981 29.8125 0.0515814 0.0249245 2026-02-24T08:25:09.245 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:25:09.246 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:25:09.396 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:09.512 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:09.520 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:09.518+0000 7f855663b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:09.520 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:09.518+0000 7f855663b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:09.662 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:09.778 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:25:09.788 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:09 trial105 ceph-mon[39442]: pgmap v172: 17 pgs: 17 active+clean; 1.6 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.58k op/s 2026-02-24T08:25:09.788 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:09 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/202102770' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:25:09.789 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:25:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:25:09] "GET /metrics HTTP/1.1" 200 4222 "" "Prometheus/3.6.0" 2026-02-24T08:25:09.792 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:09.790+0000 7fee0bdc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:09.792 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:09.790+0000 7fee0bdc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:09.815 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:09.815 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:09.825 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:25:09.829 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:09.829 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:09.842 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:25:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:25:09.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:25:09.847 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:09.847 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:09.862 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:09.862 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:09.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 44 128 224424 224296 39.8218 27.9453 0.0253645 0.0250986 2026-02-24T08:25:09.978 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:10.109 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:10.107+0000 7f8a509fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:10.110 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:10.107+0000 7f8a509fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:10.784 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:25:10.835 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:25:10.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 45 128 227865 227737 39.5343 26.8828 0.0120631 0.0252791 2026-02-24T08:25:11.023 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:11.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/202102770' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:25:11.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:10 trial105 ceph-mon[39442]: osdmap e56: 4 total, 4 up, 4 in 2026-02-24T08:25:11.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/228144470' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:11.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2647799706' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:25:11.144 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:11.141+0000 7f1bde478640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:11.144 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:11.141+0000 7f1bde478640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:11.784 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:25:11.832 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:25:11.908 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:11.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 46 128 231253 231125 39.2502 26.4688 0.0354705 0.0254621 2026-02-24T08:25:11.977 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:12.035 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:11 trial105 ceph-mon[39442]: pgmap v174: 17 pgs: 17 active+clean; 1.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.41k op/s 2026-02-24T08:25:12.035 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2647799706' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:25:12.036 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:11 trial105 ceph-mon[39442]: osdmap e57: 4 total, 4 up, 4 in 2026-02-24T08:25:12.036 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3275438234' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:25:12.049 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:12.095 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:12.093+0000 7fded4ae4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:12.096 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:12.093+0000 7fded4ae4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:12.171 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:12.168+0000 7f9eb72cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:12.171 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:12.169+0000 7f9eb72cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:12.186 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:12.187 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:12.202 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:12.202 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:12.216 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:12.216 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:12.230 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:12.230 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:12.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 47 128 234659 234531 38.9812 26.6094 0.0789745 0.0256374 2026-02-24T08:25:13.045 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:25:13.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:12 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3275438234' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:25:13.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:12 trial105 ceph-mon[39442]: osdmap e58: 4 total, 4 up, 4 in 2026-02-24T08:25:13.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:12 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3004422556' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:13.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:12 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3300612634' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:25:13.092 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:25:13.093 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:13.236 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:13.367 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:13.364+0000 7fe3b884c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:13.367 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:13.364+0000 7fe3b884c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:13.514 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:13.515 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:13.560 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2026-02-24T08:25:13.043511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1849164320,"num_objects":28210,"num_object_clones":0,"num_object_copies":84630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28210,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":225791,"num_write_kb":1807398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160955,"ondisk_log_size":160955,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11143616,"kb_used_data":5393200,"kb_used_omap":122,"kb_used_meta":5750213,"kb_avail":2924869184,"statfs":{"total":3006477107200,"available":2995066044416,"internally_reserved":0,"allocated":5522636800,"data_stored":5521121567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":125645,"internal_metadata":5888218419},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":143843328,"num_objects":2193,"num_object_clones":0,"num_object_copies":6579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17559,"num_write_kb":140472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.319057"},"pg_stats":[{"pgid":"4.f","version":"56'14040","reported_seq":14060,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.506898+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:10.506898+0000","last_peered":"2026-02-24T08:25:10.506898+0000","last_clean":"2026-02-24T08:25:10.506898+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:10.506898+0000","last_undegraded":"2026-02-24T08:25:10.506898+0000","last_fullsized":"2026-02-24T08:25:10.506898+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115015680,"num_objects":1755,"num_object_clones":0,"num_object_copies":5265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14040,"num_write_kb":112320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"56'13744","reported_seq":13757,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.253330+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:10.253330+0000","last_peered":"2026-02-24T08:25:10.253330+0000","last_clean":"2026-02-24T08:25:10.253330+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:10.253330+0000","last_undegraded":"2026-02-24T08:25:10.253330+0000","last_fullsized":"2026-02-24T08:25:10.253330+0000","mapping_epoch":51,"log_start":"53'3700","ondisk_log_start":"53'3700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112590848,"num_objects":1718,"num_object_clones":0,"num_object_copies":5154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13744,"num_write_kb":109952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"56'13880","reported_seq":13900,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.232551+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:10.232551+0000","last_peered":"2026-02-24T08:25:10.232551+0000","last_clean":"2026-02-24T08:25:10.232551+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:10.232551+0000","last_undegraded":"2026-02-24T08:25:10.232551+0000","last_fullsized":"2026-02-24T08:25:10.232551+0000","mapping_epoch":51,"log_start":"53'3800","ondisk_log_start":"53'3800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113704960,"num_objects":1735,"num_object_clones":0,"num_object_copies":5205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13880,"num_write_kb":111040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"56'14584","reported_seq":14604,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.134699+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:10.134699+0000","last_peered":"2026-02-24T08:25:10.134699+0000","last_clean":"2026-02-24T08:25:10.134699+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:10.134699+0000","last_undegraded":"2026-02-24T08:25:10.134699+0000","last_fullsized":"2026-02-24T08:25:10.134699+0000","mapping_epoch":51,"log_start":"53'4500","ondisk_log_start":"53'4500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119472128,"num_objects":1823,"num_object_clones":0,"num_object_copies":5469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14584,"num_write_kb":116672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"56'14036","reported_seq":14055,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.164346+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:25:10.164346+0000","last_peered":"2026-02-24T08:25:10.164346+0000","last_clean":"2026-02-24T08:25:10.164346+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:10.164346+0000","last_undegraded":"2026-02-24T08:25:10.164346+0000","last_fullsized":"2026-02-24T08:25:10.164346+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114982912,"num_objects":1755,"num_object_clones":0,"num_object_copies":5265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14036,"num_write_kb":112288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"56'14088","reported_seq":14108,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.239330+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:10.239330+0000","last_peered":"2026-02-24T08:25:10.239330+0000","last_clean":"2026-02-24T08:25:10.239330+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:10.239330+0000","last_undegraded":"2026-02-24T08:25:10.239330+0000","last_fullsized":"2026-02-24T08:25:10.239330+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115408896,"num_objects":1761,"num_object_clones":0,"num_object_copies":5283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14088,"num_write_kb":112704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"56'14128","reported_seq":14148,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.240861+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:25:10.240861+0000","last_peered":"2026-02-24T08:25:10.240861+0000","last_clean":"2026-02-24T08:25:10.240861+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:10.240861+0000","last_undegraded":"2026-02-24T08:25:10.240861+0000","last_fullsized":"2026-02-24T08:25:10.240861+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115736576,"num_objects":1766,"num_object_clones":0,"num_object_copies":5298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1766,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14128,"num_write_kb":113024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"56'13984","reported_seq":14002,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.332449+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:25:10.332449+0000","last_peered":"2026-02-24T08:25:10.332449+0000","last_clean":"2026-02-24T08:25:10.332449+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:10.332449+0000","last_undegraded":"2026-02-24T08:25:10.332449+0000","last_fullsized":"2026-02-24T08:25:10.332449+0000","mapping_epoch":51,"log_start":"53'3900","ondisk_log_start":"53'3900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114556928,"num_objects":1748,"num_object_clones":0,"num_object_copies":5244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13984,"num_write_kb":111872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"56'14196","reported_seq":14213,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.536553+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:25:10.536553+0000","last_peered":"2026-02-24T08:25:10.536553+0000","last_clean":"2026-02-24T08:25:10.536553+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:10.536553+0000","last_undegraded":"2026-02-24T08:25:10.536553+0000","last_fullsized":"2026-02-24T08:25:10.536553+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116293632,"num_objects":1775,"num_object_clones":0,"num_object_copies":5325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14196,"num_write_kb":113568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"56'14048","reported_seq":14068,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.164129+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:25:10.164129+0000","last_peered":"2026-02-24T08:25:10.164129+0000","last_clean":"2026-02-24T08:25:10.164129+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:10.164129+0000","last_undegraded":"2026-02-24T08:25:10.164129+0000","last_fullsized":"2026-02-24T08:25:10.164129+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115081216,"num_objects":1756,"num_object_clones":0,"num_object_copies":5268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14048,"num_write_kb":112384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"56'14248","reported_seq":14268,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.429023+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:25:10.429023+0000","last_peered":"2026-02-24T08:25:10.429023+0000","last_clean":"2026-02-24T08:25:10.429023+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:10.429023+0000","last_undegraded":"2026-02-24T08:25:10.429023+0000","last_fullsized":"2026-02-24T08:25:10.429023+0000","mapping_epoch":51,"log_start":"53'4200","ondisk_log_start":"53'4200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14248,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"56'14536","reported_seq":14556,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.154778+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:25:10.154778+0000","last_peered":"2026-02-24T08:25:10.154778+0000","last_clean":"2026-02-24T08:25:10.154778+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:10.154778+0000","last_undegraded":"2026-02-24T08:25:10.154778+0000","last_fullsized":"2026-02-24T08:25:10.154778+0000","mapping_epoch":51,"log_start":"53'4500","ondisk_log_start":"53'4500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119078912,"num_objects":1817,"num_object_clones":0,"num_object_copies":5451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14536,"num_write_kb":116288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"56'14248","reported_seq":14268,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.509136+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:25:10.509136+0000","last_peered":"2026-02-24T08:25:10.509136+0000","last_clean":"2026-02-24T08:25:10.509136+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:10.509136+0000","last_undegraded":"2026-02-24T08:25:10.509136+0000","last_fullsized":"2026-02-24T08:25:10.509136+0000","mapping_epoch":51,"log_start":"53'4200","ondisk_log_start":"53'4200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14248,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"56'14176","reported_seq":14191,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.252201+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:10.252201+0000","last_peered":"2026-02-24T08:25:10.252201+0000","last_clean":"2026-02-24T08:25:10.252201+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:10.252201+0000","last_undegraded":"2026-02-24T08:25:10.252201+0000","last_fullsized":"2026-02-24T08:25:10.252201+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116129792,"num_objects":1772,"num_object_clones":0,"num_object_copies":5316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14176,"num_write_kb":113408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"56'14104","reported_seq":14121,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.163082+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:25:10.163082+0000","last_peered":"2026-02-24T08:25:10.163082+0000","last_clean":"2026-02-24T08:25:10.163082+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:10.163082+0000","last_undegraded":"2026-02-24T08:25:10.163082+0000","last_fullsized":"2026-02-24T08:25:10.163082+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115539968,"num_objects":1763,"num_object_clones":0,"num_object_copies":5289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14104,"num_write_kb":112832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"56'13616","reported_seq":13636,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.335697+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:10.335697+0000","last_peered":"2026-02-24T08:25:10.335697+0000","last_clean":"2026-02-24T08:25:10.335697+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:10.335697+0000","last_undegraded":"2026-02-24T08:25:10.335697+0000","last_fullsized":"2026-02-24T08:25:10.335697+0000","mapping_epoch":51,"log_start":"53'3600","ondisk_log_start":"53'3600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111542272,"num_objects":1702,"num_object_clones":0,"num_object_copies":5106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13616,"num_write_kb":108928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:09.777449+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:25:09.777449+0000","last_peered":"2026-02-24T08:25:09.777449+0000","last_clean":"2026-02-24T08:25:09.777449+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:09.777449+0000","last_undegraded":"2026-02-24T08:25:09.777449+0000","last_fullsized":"2026-02-24T08:25:09.777449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1848573952,"num_objects":28208,"num_object_clones":0,"num_object_copies":84624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28208,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225656,"num_write_kb":1805248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5543952384,"data_stored":5543952384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160856,"ondisk_log_size":160856,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2819012,"kb_used_data":1341616,"kb_used_omap":22,"kb_used_meta":1477353,"kb_avail":731184188,"statfs":{"total":751619276800,"available":748732608512,"internally_reserved":0,"allocated":1373814784,"data_stored":1373440997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23120,"internal_metadata":1512809904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3109080,"kb_used_data":1577284,"kb_used_omap":31,"kb_used_meta":1531744,"kb_avail":730894120,"statfs":{"total":751619276800,"available":748435578880,"internally_reserved":0,"allocated":1615138816,"data_stored":1614757150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32222,"internal_metadata":1568506402},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2444580,"kb_used_data":1128528,"kb_used_omap":32,"kb_used_meta":1315999,"kb_avail":731558620,"statfs":{"total":751619276800,"available":749116026880,"internally_reserved":0,"allocated":1155612672,"data_stored":1155234558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33524,"internal_metadata":1347583244},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2770944,"kb_used_data":1345772,"kb_used_omap":35,"kb_used_meta":1425116,"kb_avail":731232256,"statfs":{"total":751619276800,"available":748781830144,"internally_reserved":0,"allocated":1378070528,"data_stored":1377688862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36779,"internal_metadata":1459318869},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1382629376,"data_stored":1382629376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1160912896,"data_stored":1160912896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1614036992,"data_stored":1614036992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1386373120,"data_stored":1386373120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:13.563 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:13.714 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:13.832 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:13 trial105 ceph-mon[39442]: pgmap v177: 17 pgs: 17 active+clean; 1.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.93k op/s 2026-02-24T08:25:13.832 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3300612634' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:25:13.832 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:13 trial105 ceph-mon[39442]: osdmap e59: 4 total, 4 up, 4 in 2026-02-24T08:25:13.846 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:13.843+0000 7efd130d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:13.846 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:13.844+0000 7efd130d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:13.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 48 128 238149 238021 38.7371 27.2656 0.0392148 0.0258004 2026-02-24T08:25:14.010 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:14.011 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:14.060 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2026-02-24T08:25:13.043511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1849164320,"num_objects":28210,"num_object_clones":0,"num_object_copies":84630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28210,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":225791,"num_write_kb":1807398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160955,"ondisk_log_size":160955,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11143616,"kb_used_data":5393200,"kb_used_omap":122,"kb_used_meta":5750213,"kb_avail":2924869184,"statfs":{"total":3006477107200,"available":2995066044416,"internally_reserved":0,"allocated":5522636800,"data_stored":5521121567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":125645,"internal_metadata":5888218419},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":143843328,"num_objects":2193,"num_object_clones":0,"num_object_copies":6579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17559,"num_write_kb":140472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.319057"},"pg_stats":[{"pgid":"4.f","version":"56'14040","reported_seq":14060,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.506898+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:10.506898+0000","last_peered":"2026-02-24T08:25:10.506898+0000","last_clean":"2026-02-24T08:25:10.506898+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:10.506898+0000","last_undegraded":"2026-02-24T08:25:10.506898+0000","last_fullsized":"2026-02-24T08:25:10.506898+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115015680,"num_objects":1755,"num_object_clones":0,"num_object_copies":5265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14040,"num_write_kb":112320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"56'13744","reported_seq":13757,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.253330+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:10.253330+0000","last_peered":"2026-02-24T08:25:10.253330+0000","last_clean":"2026-02-24T08:25:10.253330+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:10.253330+0000","last_undegraded":"2026-02-24T08:25:10.253330+0000","last_fullsized":"2026-02-24T08:25:10.253330+0000","mapping_epoch":51,"log_start":"53'3700","ondisk_log_start":"53'3700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112590848,"num_objects":1718,"num_object_clones":0,"num_object_copies":5154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13744,"num_write_kb":109952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"56'13880","reported_seq":13900,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.232551+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:10.232551+0000","last_peered":"2026-02-24T08:25:10.232551+0000","last_clean":"2026-02-24T08:25:10.232551+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:10.232551+0000","last_undegraded":"2026-02-24T08:25:10.232551+0000","last_fullsized":"2026-02-24T08:25:10.232551+0000","mapping_epoch":51,"log_start":"53'3800","ondisk_log_start":"53'3800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113704960,"num_objects":1735,"num_object_clones":0,"num_object_copies":5205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13880,"num_write_kb":111040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"56'14584","reported_seq":14604,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.134699+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:10.134699+0000","last_peered":"2026-02-24T08:25:10.134699+0000","last_clean":"2026-02-24T08:25:10.134699+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:10.134699+0000","last_undegraded":"2026-02-24T08:25:10.134699+0000","last_fullsized":"2026-02-24T08:25:10.134699+0000","mapping_epoch":51,"log_start":"53'4500","ondisk_log_start":"53'4500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119472128,"num_objects":1823,"num_object_clones":0,"num_object_copies":5469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14584,"num_write_kb":116672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"56'14036","reported_seq":14055,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.164346+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:25:10.164346+0000","last_peered":"2026-02-24T08:25:10.164346+0000","last_clean":"2026-02-24T08:25:10.164346+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:10.164346+0000","last_undegraded":"2026-02-24T08:25:10.164346+0000","last_fullsized":"2026-02-24T08:25:10.164346+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114982912,"num_objects":1755,"num_object_clones":0,"num_object_copies":5265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14036,"num_write_kb":112288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"56'14088","reported_seq":14108,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.239330+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:10.239330+0000","last_peered":"2026-02-24T08:25:10.239330+0000","last_clean":"2026-02-24T08:25:10.239330+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:10.239330+0000","last_undegraded":"2026-02-24T08:25:10.239330+0000","last_fullsized":"2026-02-24T08:25:10.239330+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115408896,"num_objects":1761,"num_object_clones":0,"num_object_copies":5283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14088,"num_write_kb":112704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"56'14128","reported_seq":14148,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.240861+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:25:10.240861+0000","last_peered":"2026-02-24T08:25:10.240861+0000","last_clean":"2026-02-24T08:25:10.240861+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:10.240861+0000","last_undegraded":"2026-02-24T08:25:10.240861+0000","last_fullsized":"2026-02-24T08:25:10.240861+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115736576,"num_objects":1766,"num_object_clones":0,"num_object_copies":5298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1766,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14128,"num_write_kb":113024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"56'13984","reported_seq":14002,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.332449+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:25:10.332449+0000","last_peered":"2026-02-24T08:25:10.332449+0000","last_clean":"2026-02-24T08:25:10.332449+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:10.332449+0000","last_undegraded":"2026-02-24T08:25:10.332449+0000","last_fullsized":"2026-02-24T08:25:10.332449+0000","mapping_epoch":51,"log_start":"53'3900","ondisk_log_start":"53'3900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114556928,"num_objects":1748,"num_object_clones":0,"num_object_copies":5244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13984,"num_write_kb":111872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"56'14196","reported_seq":14213,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.536553+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:25:10.536553+0000","last_peered":"2026-02-24T08:25:10.536553+0000","last_clean":"2026-02-24T08:25:10.536553+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:10.536553+0000","last_undegraded":"2026-02-24T08:25:10.536553+0000","last_fullsized":"2026-02-24T08:25:10.536553+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116293632,"num_objects":1775,"num_object_clones":0,"num_object_copies":5325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14196,"num_write_kb":113568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"56'14048","reported_seq":14068,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.164129+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:25:10.164129+0000","last_peered":"2026-02-24T08:25:10.164129+0000","last_clean":"2026-02-24T08:25:10.164129+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:10.164129+0000","last_undegraded":"2026-02-24T08:25:10.164129+0000","last_fullsized":"2026-02-24T08:25:10.164129+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115081216,"num_objects":1756,"num_object_clones":0,"num_object_copies":5268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14048,"num_write_kb":112384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"56'14248","reported_seq":14268,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.429023+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:25:10.429023+0000","last_peered":"2026-02-24T08:25:10.429023+0000","last_clean":"2026-02-24T08:25:10.429023+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:10.429023+0000","last_undegraded":"2026-02-24T08:25:10.429023+0000","last_fullsized":"2026-02-24T08:25:10.429023+0000","mapping_epoch":51,"log_start":"53'4200","ondisk_log_start":"53'4200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14248,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"56'14536","reported_seq":14556,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.154778+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:25:10.154778+0000","last_peered":"2026-02-24T08:25:10.154778+0000","last_clean":"2026-02-24T08:25:10.154778+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:10.154778+0000","last_undegraded":"2026-02-24T08:25:10.154778+0000","last_fullsized":"2026-02-24T08:25:10.154778+0000","mapping_epoch":51,"log_start":"53'4500","ondisk_log_start":"53'4500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119078912,"num_objects":1817,"num_object_clones":0,"num_object_copies":5451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14536,"num_write_kb":116288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"56'14248","reported_seq":14268,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.509136+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:25:10.509136+0000","last_peered":"2026-02-24T08:25:10.509136+0000","last_clean":"2026-02-24T08:25:10.509136+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:10.509136+0000","last_undegraded":"2026-02-24T08:25:10.509136+0000","last_fullsized":"2026-02-24T08:25:10.509136+0000","mapping_epoch":51,"log_start":"53'4200","ondisk_log_start":"53'4200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14248,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"56'14176","reported_seq":14191,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.252201+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:10.252201+0000","last_peered":"2026-02-24T08:25:10.252201+0000","last_clean":"2026-02-24T08:25:10.252201+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:10.252201+0000","last_undegraded":"2026-02-24T08:25:10.252201+0000","last_fullsized":"2026-02-24T08:25:10.252201+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116129792,"num_objects":1772,"num_object_clones":0,"num_object_copies":5316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14176,"num_write_kb":113408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"56'14104","reported_seq":14121,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.163082+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:25:10.163082+0000","last_peered":"2026-02-24T08:25:10.163082+0000","last_clean":"2026-02-24T08:25:10.163082+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:10.163082+0000","last_undegraded":"2026-02-24T08:25:10.163082+0000","last_fullsized":"2026-02-24T08:25:10.163082+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115539968,"num_objects":1763,"num_object_clones":0,"num_object_copies":5289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14104,"num_write_kb":112832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"56'13616","reported_seq":13636,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.335697+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:10.335697+0000","last_peered":"2026-02-24T08:25:10.335697+0000","last_clean":"2026-02-24T08:25:10.335697+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:10.335697+0000","last_undegraded":"2026-02-24T08:25:10.335697+0000","last_fullsized":"2026-02-24T08:25:10.335697+0000","mapping_epoch":51,"log_start":"53'3600","ondisk_log_start":"53'3600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111542272,"num_objects":1702,"num_object_clones":0,"num_object_copies":5106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13616,"num_write_kb":108928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:09.777449+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:25:09.777449+0000","last_peered":"2026-02-24T08:25:09.777449+0000","last_clean":"2026-02-24T08:25:09.777449+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:09.777449+0000","last_undegraded":"2026-02-24T08:25:09.777449+0000","last_fullsized":"2026-02-24T08:25:09.777449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1848573952,"num_objects":28208,"num_object_clones":0,"num_object_copies":84624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28208,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225656,"num_write_kb":1805248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5543952384,"data_stored":5543952384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160856,"ondisk_log_size":160856,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2819012,"kb_used_data":1341616,"kb_used_omap":22,"kb_used_meta":1477353,"kb_avail":731184188,"statfs":{"total":751619276800,"available":748732608512,"internally_reserved":0,"allocated":1373814784,"data_stored":1373440997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23120,"internal_metadata":1512809904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3109080,"kb_used_data":1577284,"kb_used_omap":31,"kb_used_meta":1531744,"kb_avail":730894120,"statfs":{"total":751619276800,"available":748435578880,"internally_reserved":0,"allocated":1615138816,"data_stored":1614757150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32222,"internal_metadata":1568506402},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2444580,"kb_used_data":1128528,"kb_used_omap":32,"kb_used_meta":1315999,"kb_avail":731558620,"statfs":{"total":751619276800,"available":749116026880,"internally_reserved":0,"allocated":1155612672,"data_stored":1155234558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33524,"internal_metadata":1347583244},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2770944,"kb_used_data":1345772,"kb_used_omap":35,"kb_used_meta":1425116,"kb_avail":731232256,"statfs":{"total":751619276800,"available":748781830144,"internally_reserved":0,"allocated":1378070528,"data_stored":1377688862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36779,"internal_metadata":1459318869},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1382629376,"data_stored":1382629376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1160912896,"data_stored":1160912896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1614036992,"data_stored":1614036992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1386373120,"data_stored":1386373120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:14.062 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:25:14.062 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:25:14.063 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-24T08:25:14.063 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:14.208 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:14.273 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:14.337 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:14.334+0000 7f9d7e19b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:14.337 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:14.334+0000 7f9d7e19b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:14.415 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:14.486 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:14.487 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:14.535 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2026-02-24T08:25:14.044076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1849164320,"num_objects":28210,"num_object_clones":0,"num_object_copies":84630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28210,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":225791,"num_write_kb":1807398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160955,"ondisk_log_size":160955,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11143616,"kb_used_data":5393200,"kb_used_omap":122,"kb_used_meta":5750213,"kb_avail":2924869184,"statfs":{"total":3006477107200,"available":2995066044416,"internally_reserved":0,"allocated":5522636800,"data_stored":5521121567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":125645,"internal_metadata":5888218419},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":143843328,"num_objects":2193,"num_object_clones":0,"num_object_copies":6579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17559,"num_write_kb":140472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.267657"},"pg_stats":[{"pgid":"4.f","version":"56'14040","reported_seq":14060,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.506898+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:10.506898+0000","last_peered":"2026-02-24T08:25:10.506898+0000","last_clean":"2026-02-24T08:25:10.506898+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:10.506898+0000","last_undegraded":"2026-02-24T08:25:10.506898+0000","last_fullsized":"2026-02-24T08:25:10.506898+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115015680,"num_objects":1755,"num_object_clones":0,"num_object_copies":5265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14040,"num_write_kb":112320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"56'13744","reported_seq":13757,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.253330+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:10.253330+0000","last_peered":"2026-02-24T08:25:10.253330+0000","last_clean":"2026-02-24T08:25:10.253330+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:10.253330+0000","last_undegraded":"2026-02-24T08:25:10.253330+0000","last_fullsized":"2026-02-24T08:25:10.253330+0000","mapping_epoch":51,"log_start":"53'3700","ondisk_log_start":"53'3700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112590848,"num_objects":1718,"num_object_clones":0,"num_object_copies":5154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13744,"num_write_kb":109952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"56'13880","reported_seq":13900,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.232551+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:10.232551+0000","last_peered":"2026-02-24T08:25:10.232551+0000","last_clean":"2026-02-24T08:25:10.232551+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:10.232551+0000","last_undegraded":"2026-02-24T08:25:10.232551+0000","last_fullsized":"2026-02-24T08:25:10.232551+0000","mapping_epoch":51,"log_start":"53'3800","ondisk_log_start":"53'3800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113704960,"num_objects":1735,"num_object_clones":0,"num_object_copies":5205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13880,"num_write_kb":111040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"56'14584","reported_seq":14604,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.134699+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:10.134699+0000","last_peered":"2026-02-24T08:25:10.134699+0000","last_clean":"2026-02-24T08:25:10.134699+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:10.134699+0000","last_undegraded":"2026-02-24T08:25:10.134699+0000","last_fullsized":"2026-02-24T08:25:10.134699+0000","mapping_epoch":51,"log_start":"53'4500","ondisk_log_start":"53'4500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119472128,"num_objects":1823,"num_object_clones":0,"num_object_copies":5469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14584,"num_write_kb":116672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"56'14036","reported_seq":14055,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.164346+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:25:10.164346+0000","last_peered":"2026-02-24T08:25:10.164346+0000","last_clean":"2026-02-24T08:25:10.164346+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:10.164346+0000","last_undegraded":"2026-02-24T08:25:10.164346+0000","last_fullsized":"2026-02-24T08:25:10.164346+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114982912,"num_objects":1755,"num_object_clones":0,"num_object_copies":5265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14036,"num_write_kb":112288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"56'14088","reported_seq":14108,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.239330+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:10.239330+0000","last_peered":"2026-02-24T08:25:10.239330+0000","last_clean":"2026-02-24T08:25:10.239330+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:10.239330+0000","last_undegraded":"2026-02-24T08:25:10.239330+0000","last_fullsized":"2026-02-24T08:25:10.239330+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115408896,"num_objects":1761,"num_object_clones":0,"num_object_copies":5283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14088,"num_write_kb":112704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"56'14128","reported_seq":14148,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.240861+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:25:10.240861+0000","last_peered":"2026-02-24T08:25:10.240861+0000","last_clean":"2026-02-24T08:25:10.240861+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:10.240861+0000","last_undegraded":"2026-02-24T08:25:10.240861+0000","last_fullsized":"2026-02-24T08:25:10.240861+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115736576,"num_objects":1766,"num_object_clones":0,"num_object_copies":5298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1766,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14128,"num_write_kb":113024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"56'13984","reported_seq":14002,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.332449+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:25:10.332449+0000","last_peered":"2026-02-24T08:25:10.332449+0000","last_clean":"2026-02-24T08:25:10.332449+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:10.332449+0000","last_undegraded":"2026-02-24T08:25:10.332449+0000","last_fullsized":"2026-02-24T08:25:10.332449+0000","mapping_epoch":51,"log_start":"53'3900","ondisk_log_start":"53'3900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114556928,"num_objects":1748,"num_object_clones":0,"num_object_copies":5244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13984,"num_write_kb":111872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"56'14196","reported_seq":14213,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.536553+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:25:10.536553+0000","last_peered":"2026-02-24T08:25:10.536553+0000","last_clean":"2026-02-24T08:25:10.536553+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:10.536553+0000","last_undegraded":"2026-02-24T08:25:10.536553+0000","last_fullsized":"2026-02-24T08:25:10.536553+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116293632,"num_objects":1775,"num_object_clones":0,"num_object_copies":5325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14196,"num_write_kb":113568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"56'14048","reported_seq":14068,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.164129+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:25:10.164129+0000","last_peered":"2026-02-24T08:25:10.164129+0000","last_clean":"2026-02-24T08:25:10.164129+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:10.164129+0000","last_undegraded":"2026-02-24T08:25:10.164129+0000","last_fullsized":"2026-02-24T08:25:10.164129+0000","mapping_epoch":51,"log_start":"53'4000","ondisk_log_start":"53'4000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115081216,"num_objects":1756,"num_object_clones":0,"num_object_copies":5268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14048,"num_write_kb":112384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"56'14248","reported_seq":14268,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.429023+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:25:10.429023+0000","last_peered":"2026-02-24T08:25:10.429023+0000","last_clean":"2026-02-24T08:25:10.429023+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:10.429023+0000","last_undegraded":"2026-02-24T08:25:10.429023+0000","last_fullsized":"2026-02-24T08:25:10.429023+0000","mapping_epoch":51,"log_start":"53'4200","ondisk_log_start":"53'4200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14248,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"56'14536","reported_seq":14556,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.154778+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:25:10.154778+0000","last_peered":"2026-02-24T08:25:10.154778+0000","last_clean":"2026-02-24T08:25:10.154778+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:10.154778+0000","last_undegraded":"2026-02-24T08:25:10.154778+0000","last_fullsized":"2026-02-24T08:25:10.154778+0000","mapping_epoch":51,"log_start":"53'4500","ondisk_log_start":"53'4500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119078912,"num_objects":1817,"num_object_clones":0,"num_object_copies":5451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14536,"num_write_kb":116288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"56'14248","reported_seq":14268,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.509136+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:25:10.509136+0000","last_peered":"2026-02-24T08:25:10.509136+0000","last_clean":"2026-02-24T08:25:10.509136+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:10.509136+0000","last_undegraded":"2026-02-24T08:25:10.509136+0000","last_fullsized":"2026-02-24T08:25:10.509136+0000","mapping_epoch":51,"log_start":"53'4200","ondisk_log_start":"53'4200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14248,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"56'14176","reported_seq":14191,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.252201+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:10.252201+0000","last_peered":"2026-02-24T08:25:10.252201+0000","last_clean":"2026-02-24T08:25:10.252201+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:10.252201+0000","last_undegraded":"2026-02-24T08:25:10.252201+0000","last_fullsized":"2026-02-24T08:25:10.252201+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116129792,"num_objects":1772,"num_object_clones":0,"num_object_copies":5316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1772,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14176,"num_write_kb":113408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"56'14104","reported_seq":14121,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.163082+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:25:10.163082+0000","last_peered":"2026-02-24T08:25:10.163082+0000","last_clean":"2026-02-24T08:25:10.163082+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:10.163082+0000","last_undegraded":"2026-02-24T08:25:10.163082+0000","last_fullsized":"2026-02-24T08:25:10.163082+0000","mapping_epoch":51,"log_start":"53'4100","ondisk_log_start":"53'4100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115539968,"num_objects":1763,"num_object_clones":0,"num_object_copies":5289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14104,"num_write_kb":112832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"56'13616","reported_seq":13636,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:10.335697+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:10.335697+0000","last_peered":"2026-02-24T08:25:10.335697+0000","last_clean":"2026-02-24T08:25:10.335697+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:10.335697+0000","last_undegraded":"2026-02-24T08:25:10.335697+0000","last_fullsized":"2026-02-24T08:25:10.335697+0000","mapping_epoch":51,"log_start":"53'3600","ondisk_log_start":"53'3600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111542272,"num_objects":1702,"num_object_clones":0,"num_object_copies":5106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13616,"num_write_kb":108928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":131,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-24T08:25:09.777449+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:25:09.777449+0000","last_peered":"2026-02-24T08:25:09.777449+0000","last_clean":"2026-02-24T08:25:09.777449+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:09.777449+0000","last_undegraded":"2026-02-24T08:25:09.777449+0000","last_fullsized":"2026-02-24T08:25:09.777449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1848573952,"num_objects":28208,"num_object_clones":0,"num_object_copies":84624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28208,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225656,"num_write_kb":1805248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5543952384,"data_stored":5543952384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160856,"ondisk_log_size":160856,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2819012,"kb_used_data":1341616,"kb_used_omap":22,"kb_used_meta":1477353,"kb_avail":731184188,"statfs":{"total":751619276800,"available":748732608512,"internally_reserved":0,"allocated":1373814784,"data_stored":1373440997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23120,"internal_metadata":1512809904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3109080,"kb_used_data":1577284,"kb_used_omap":31,"kb_used_meta":1531744,"kb_avail":730894120,"statfs":{"total":751619276800,"available":748435578880,"internally_reserved":0,"allocated":1615138816,"data_stored":1614757150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32222,"internal_metadata":1568506402},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2444580,"kb_used_data":1128528,"kb_used_omap":32,"kb_used_meta":1315999,"kb_avail":731558620,"statfs":{"total":751619276800,"available":749116026880,"internally_reserved":0,"allocated":1155612672,"data_stored":1155234558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33524,"internal_metadata":1347583244},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2770944,"kb_used_data":1345772,"kb_used_omap":35,"kb_used_meta":1425116,"kb_avail":731232256,"statfs":{"total":751619276800,"available":748781830144,"internally_reserved":0,"allocated":1378070528,"data_stored":1377688862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36779,"internal_metadata":1459318869},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9312,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1382629376,"data_stored":1382629376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1160912896,"data_stored":1160912896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1614036992,"data_stored":1614036992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1386373120,"data_stored":1386373120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:14.537 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:25:14.538 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 46 2026-02-24T08:25:14.543 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:14.541+0000 7f5abd082640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:14.543 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:14.541+0000 7f5abd082640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:14.560 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:14.560 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:14.571 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:14.572 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:14.584 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:14.584 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:14.596 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:14.596 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:14.681 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:14.812 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:14.810+0000 7fedff378640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:14.812 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:14.810+0000 7fedff378640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:14.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 49 127 241525 241398 38.4849 26.3828 0.0255449 0.0259666 2026-02-24T08:25:14.964 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:25:14.964 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:14 trial105 ceph-mon[39442]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:14.965 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:25:14.965 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:14 trial105 ceph-mon[39442]: osdmap e60: 4 total, 4 up, 4 in 2026-02-24T08:25:14.965 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:14 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/329657187' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:15.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:25:15.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 50 128 245043 244915 38.2647 27.4766 0.0131624 0.0261193 2026-02-24T08:25:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:15 trial105 ceph-mon[39442]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:15 trial105 ceph-mon[39442]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:15 trial105 ceph-mon[39442]: pgmap v180: 17 pgs: 17 active+clean; 1.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:25:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:15 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4245664192' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T08:25:16.660 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:16.801 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:16.921 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:16.918+0000 7fa0de1a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:16.922 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:16.918+0000 7fa0de1a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:16.936 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:16.936 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:16.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 51 128 248577 248449 38.0557 27.6094 0.0152041 0.0262627 2026-02-24T08:25:16.949 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:16.949 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:16.961 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:16.961 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:16.974 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:16.975 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:17.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 52 128 252006 251878 37.839 26.7891 0.0359405 0.0264133 2026-02-24T08:25:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:17 trial105 ceph-mon[39442]: pgmap v181: 17 pgs: 17 active+clean; 1.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.88k op/s 2026-02-24T08:25:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1365583691' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:18.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 53 128 255567 255439 37.65 27.8203 0.0410141 0.0265436 2026-02-24T08:25:19.023 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:19.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:18 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:25:19.047 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:18 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:25:19.165 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:19.288 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:19.285+0000 7f3ab0855640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:19.288 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:19.286+0000 7f3ab0855640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:19.305 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:19.305 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:19.318 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:19.318 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:19.331 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:19.331 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:19.343 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:19.344 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:19.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:25:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:25:19] "GET /metrics HTTP/1.1" 200 4208 "" "Prometheus/3.6.0" 2026-02-24T08:25:19.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:25:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:25:19.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:25:19.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 54 128 259080 258952 37.4609 27.4453 0.0400388 0.0266826 2026-02-24T08:25:20.005 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:25:20.005 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:25:20.005 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:20.151 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:20.181 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:19 trial105 ceph-mon[39442]: pgmap v182: 17 pgs: 17 active+clean; 1.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 19 MiB/s wr, 2.46k op/s 2026-02-24T08:25:20.182 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3512013276' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:20.283 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:20.281+0000 7f3d4d9d0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:20.283 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:20.281+0000 7f3d4d9d0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:20.437 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:20.437 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:20.488 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2026-02-24T08:25:18.725803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1989190176,"num_objects":30348,"num_object_clones":0,"num_object_copies":91044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30348,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":242884,"num_write_kb":1944142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160948,"ondisk_log_size":160948,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11658452,"kb_used_data":5799748,"kb_used_omap":130,"kb_used_meta":5858493,"kb_avail":2924354348,"statfs":{"total":3006477107200,"available":2994538852352,"internally_reserved":0,"allocated":5938941952,"data_stored":5937292944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":133716,"internal_metadata":5999097260},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,5,11,15,17,28,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":140025856,"num_objects":2138,"num_object_clones":0,"num_object_copies":6414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17093,"num_write_kb":136744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.942933"},"pg_stats":[{"pgid":"4.f","version":"60'15088","reported_seq":15116,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.535357+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:15.535357+0000","last_peered":"2026-02-24T08:25:15.535357+0000","last_clean":"2026-02-24T08:25:15.535357+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:15.535357+0000","last_undegraded":"2026-02-24T08:25:15.535357+0000","last_fullsized":"2026-02-24T08:25:15.535357+0000","mapping_epoch":51,"log_start":"53'5000","ondisk_log_start":"53'5000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123600896,"num_objects":1886,"num_object_clones":0,"num_object_copies":5658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1886,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15088,"num_write_kb":120704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'14728","reported_seq":14756,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.217513+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:15.217513+0000","last_peered":"2026-02-24T08:25:15.217513+0000","last_clean":"2026-02-24T08:25:15.217513+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:15.217513+0000","last_undegraded":"2026-02-24T08:25:15.217513+0000","last_fullsized":"2026-02-24T08:25:15.217513+0000","mapping_epoch":51,"log_start":"53'4700","ondisk_log_start":"53'4700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120651776,"num_objects":1841,"num_object_clones":0,"num_object_copies":5523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1841,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14728,"num_write_kb":117824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'15000","reported_seq":15028,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.343546+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:15.343546+0000","last_peered":"2026-02-24T08:25:15.343546+0000","last_clean":"2026-02-24T08:25:15.343546+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:15.343546+0000","last_undegraded":"2026-02-24T08:25:15.343546+0000","last_fullsized":"2026-02-24T08:25:15.343546+0000","mapping_epoch":51,"log_start":"53'4900","ondisk_log_start":"53'4900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122880000,"num_objects":1875,"num_object_clones":0,"num_object_copies":5625,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1875,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15000,"num_write_kb":120000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"60'15580","reported_seq":15607,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.356306+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:15.356306+0000","last_peered":"2026-02-24T08:25:15.356306+0000","last_clean":"2026-02-24T08:25:15.356306+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:15.356306+0000","last_undegraded":"2026-02-24T08:25:15.356306+0000","last_fullsized":"2026-02-24T08:25:15.356306+0000","mapping_epoch":51,"log_start":"53'5500","ondisk_log_start":"53'5500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127631360,"num_objects":1948,"num_object_clones":0,"num_object_copies":5844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15580,"num_write_kb":124640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"60'15020","reported_seq":15042,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.170506+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:25:15.170506+0000","last_peered":"2026-02-24T08:25:15.170506+0000","last_clean":"2026-02-24T08:25:15.170506+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:15.170506+0000","last_undegraded":"2026-02-24T08:25:15.170506+0000","last_fullsized":"2026-02-24T08:25:15.170506+0000","mapping_epoch":51,"log_start":"53'5000","ondisk_log_start":"53'5000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123043840,"num_objects":1878,"num_object_clones":0,"num_object_copies":5634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15020,"num_write_kb":120160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'15112","reported_seq":15140,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.238701+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:15.238701+0000","last_peered":"2026-02-24T08:25:15.238701+0000","last_clean":"2026-02-24T08:25:15.238701+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:15.238701+0000","last_undegraded":"2026-02-24T08:25:15.238701+0000","last_fullsized":"2026-02-24T08:25:15.238701+0000","mapping_epoch":51,"log_start":"53'5100","ondisk_log_start":"53'5100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123797504,"num_objects":1889,"num_object_clones":0,"num_object_copies":5667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1889,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15112,"num_write_kb":120896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'15248","reported_seq":15276,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.088767+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:25:15.088767+0000","last_peered":"2026-02-24T08:25:15.088767+0000","last_clean":"2026-02-24T08:25:15.088767+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:15.088767+0000","last_undegraded":"2026-02-24T08:25:15.088767+0000","last_fullsized":"2026-02-24T08:25:15.088767+0000","mapping_epoch":51,"log_start":"53'5200","ondisk_log_start":"53'5200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124911616,"num_objects":1906,"num_object_clones":0,"num_object_copies":5718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15248,"num_write_kb":121984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'15094","reported_seq":15122,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.350476+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:25:15.350476+0000","last_peered":"2026-02-24T08:25:15.350476+0000","last_clean":"2026-02-24T08:25:15.350476+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:15.350476+0000","last_undegraded":"2026-02-24T08:25:15.350476+0000","last_fullsized":"2026-02-24T08:25:15.350476+0000","mapping_epoch":51,"log_start":"53'5000","ondisk_log_start":"53'5000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123650048,"num_objects":1887,"num_object_clones":0,"num_object_copies":5661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1887,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15094,"num_write_kb":120752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"60'15312","reported_seq":15336,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.548779+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:25:15.548779+0000","last_peered":"2026-02-24T08:25:15.548779+0000","last_clean":"2026-02-24T08:25:15.548779+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:15.548779+0000","last_undegraded":"2026-02-24T08:25:15.548779+0000","last_fullsized":"2026-02-24T08:25:15.548779+0000","mapping_epoch":51,"log_start":"53'5300","ondisk_log_start":"53'5300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125435904,"num_objects":1914,"num_object_clones":0,"num_object_copies":5742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1914,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15312,"num_write_kb":122496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'15192","reported_seq":15220,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.156137+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:25:15.156137+0000","last_peered":"2026-02-24T08:25:15.156137+0000","last_clean":"2026-02-24T08:25:15.156137+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:15.156137+0000","last_undegraded":"2026-02-24T08:25:15.156137+0000","last_fullsized":"2026-02-24T08:25:15.156137+0000","mapping_epoch":51,"log_start":"53'5100","ondisk_log_start":"53'5100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124452864,"num_objects":1899,"num_object_clones":0,"num_object_copies":5697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1899,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15192,"num_write_kb":121536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'15288","reported_seq":15316,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.529203+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:25:15.529203+0000","last_peered":"2026-02-24T08:25:15.529203+0000","last_clean":"2026-02-24T08:25:15.529203+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:15.529203+0000","last_undegraded":"2026-02-24T08:25:15.529203+0000","last_fullsized":"2026-02-24T08:25:15.529203+0000","mapping_epoch":51,"log_start":"53'5200","ondisk_log_start":"53'5200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125239296,"num_objects":1911,"num_object_clones":0,"num_object_copies":5733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1911,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15288,"num_write_kb":122304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'15616","reported_seq":15644,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.144128+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:25:15.144128+0000","last_peered":"2026-02-24T08:25:15.144128+0000","last_clean":"2026-02-24T08:25:15.144128+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:15.144128+0000","last_undegraded":"2026-02-24T08:25:15.144128+0000","last_fullsized":"2026-02-24T08:25:15.144128+0000","mapping_epoch":51,"log_start":"53'5600","ondisk_log_start":"53'5600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127926272,"num_objects":1952,"num_object_clones":0,"num_object_copies":5856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15616,"num_write_kb":124928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'15232","reported_seq":15260,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.484690+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:25:15.484690+0000","last_peered":"2026-02-24T08:25:15.484690+0000","last_clean":"2026-02-24T08:25:15.484690+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:15.484690+0000","last_undegraded":"2026-02-24T08:25:15.484690+0000","last_fullsized":"2026-02-24T08:25:15.484690+0000","mapping_epoch":51,"log_start":"53'5200","ondisk_log_start":"53'5200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124780544,"num_objects":1904,"num_object_clones":0,"num_object_copies":5712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15232,"num_write_kb":121856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'15440","reported_seq":15468,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.265616+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:15.265616+0000","last_peered":"2026-02-24T08:25:15.265616+0000","last_clean":"2026-02-24T08:25:15.265616+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:15.265616+0000","last_undegraded":"2026-02-24T08:25:15.265616+0000","last_fullsized":"2026-02-24T08:25:15.265616+0000","mapping_epoch":51,"log_start":"53'5400","ondisk_log_start":"53'5400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126484480,"num_objects":1930,"num_object_clones":0,"num_object_copies":5790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1930,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15440,"num_write_kb":123520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"60'15165","reported_seq":15186,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.169916+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:25:15.169916+0000","last_peered":"2026-02-24T08:25:15.169916+0000","last_clean":"2026-02-24T08:25:15.169916+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:15.169916+0000","last_undegraded":"2026-02-24T08:25:15.169916+0000","last_fullsized":"2026-02-24T08:25:15.169916+0000","mapping_epoch":51,"log_start":"53'5100","ondisk_log_start":"53'5100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124231680,"num_objects":1896,"num_object_clones":0,"num_object_copies":5688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15165,"num_write_kb":121320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'14634","reported_seq":14662,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:15.358230+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:15.358230+0000","last_peered":"2026-02-24T08:25:15.358230+0000","last_clean":"2026-02-24T08:25:15.358230+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:15.358230+0000","last_undegraded":"2026-02-24T08:25:15.358230+0000","last_fullsized":"2026-02-24T08:25:15.358230+0000","mapping_epoch":51,"log_start":"53'4600","ondisk_log_start":"53'4600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119881728,"num_objects":1830,"num_object_clones":0,"num_object_copies":5490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14634,"num_write_kb":117072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":139,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:14.050756+0000","last_change":"2026-02-24T08:24:05.009833+0000","last_active":"2026-02-24T08:25:14.050756+0000","last_peered":"2026-02-24T08:25:14.050756+0000","last_clean":"2026-02-24T08:25:14.050756+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:14.050756+0000","last_undegraded":"2026-02-24T08:25:14.050756+0000","last_fullsized":"2026-02-24T08:25:14.050756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:24:05.009784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:24:05.009784+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:14.242180+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1988599808,"num_objects":30346,"num_object_clones":0,"num_object_copies":91038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242749,"num_write_kb":1941992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5965897728,"data_stored":5965897728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160849,"ondisk_log_size":160849,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9408,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247869,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2938872,"kb_used_data":1443428,"kb_used_omap":22,"kb_used_meta":1495401,"kb_avail":731064328,"statfs":{"total":751619276800,"available":748609871872,"internally_reserved":0,"allocated":1478070272,"data_stored":1477657132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23379,"internal_metadata":1531290797},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,1,2,3,19],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3245560,"kb_used_data":1695716,"kb_used_omap":34,"kb_used_meta":1549789,"kb_avail":730757640,"statfs":{"total":751619276800,"available":748295823360,"internally_reserved":0,"allocated":1736413184,"data_stored":1736000044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34826,"internal_metadata":1586984950},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,10,13,14,9,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2581668,"kb_used_data":1211472,"kb_used_omap":35,"kb_used_meta":1370140,"kb_avail":731421532,"statfs":{"total":751619276800,"available":748975648768,"internally_reserved":0,"allocated":1240547328,"data_stored":1240137740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36128,"internal_metadata":1403024096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2892352,"kb_used_data":1449132,"kb_used_omap":38,"kb_used_meta":1443161,"kb_avail":731110848,"statfs":{"total":751619276800,"available":748657508352,"internally_reserved":0,"allocated":1483911168,"data_stored":1483498028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39383,"internal_metadata":1477797417},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9408,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1489920000,"data_stored":1489920000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1246945280,"data_stored":1246945280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1737785344,"data_stored":1737785344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1491247104,"data_stored":1491247104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:20.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 55 128 262681 262553 37.2913 28.1328 0.0138116 0.0268008 2026-02-24T08:25:21.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:20 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:25:21.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:20 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:25:21.382 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:21.518 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:21.645 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:21.642+0000 7fe7f5a24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:21.645 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:21.643+0000 7fe7f5a24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:21.659 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:21.660 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:21.672 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:21.672 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:21.686 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:21.686 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:21.699 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:21.699 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:21.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:21 trial105 ceph-mon[39442]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:21.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:21 trial105 ceph-mon[39442]: pgmap v183: 17 pgs: 17 active+clean; 2.0 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.34k op/s 2026-02-24T08:25:21.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4066962982' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:21.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 56 128 266293 266165 37.1293 28.2188 0.0249164 0.0269203 2026-02-24T08:25:22.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 57 127 269722 269595 36.948 26.7969 0.0700535 0.0270497 2026-02-24T08:25:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:22 trial105 ceph-mon[39442]: osdmap e61: 4 total, 4 up, 4 in 2026-02-24T08:25:23.741 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:23.896 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:23.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 58 128 273186 273058 36.7773 27.0547 0.0178544 0.0271765 2026-02-24T08:25:24.019 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:23 trial105 ceph-mon[39442]: pgmap v185: 17 pgs: 17 active+clean; 2.0 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 4.00k op/s 2026-02-24T08:25:24.315 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:24.262+0000 7f3a9b613640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:24.315 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:24.263+0000 7f3a9b613640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:24.316 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:24.316 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:24.316 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:24.316 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:24.320 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:24.320 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:24.334 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:24.335 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:24.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3646099550' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:24.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 59 128 275900 275772 36.5133 21.2031 0.0520402 0.0273757 2026-02-24T08:25:25.490 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:25:25.490 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:25:25.490 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-24T08:25:25.490 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:25.636 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:25.763 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:25.759+0000 7fa96dd8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:25.763 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:25.759+0000 7fa96dd8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:25.925 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:25.926 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:25.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:25:25.944214+0000 min lat: 0.00104395 max lat: 0.204129 avg lat: 0.0274875 2026-02-24T08:25:25.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:25:25.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 60 128 279448 279320 36.3667 27.7188 0.0632989 0.0274875 2026-02-24T08:25:25.975 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2026-02-24T08:25:24.726755+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2133975584,"num_objects":32559,"num_object_clones":0,"num_object_copies":97677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32559,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":260558,"num_write_kb":2085534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160822,"ondisk_log_size":160822,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12152572,"kb_used_data":6221676,"kb_used_omap":131,"kb_used_meta":5930684,"kb_avail":2923860228,"statfs":{"total":3006477107200,"available":2994032873472,"internally_reserved":0,"allocated":6370996224,"data_stored":6369347216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":134367,"internal_metadata":6073021217},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,5,12,23,9,19,11,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":284811264,"num_objects":4349,"num_object_clones":0,"num_object_copies":13047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4349,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34767,"num_write_kb":278136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001498"},"pg_stats":[{"pgid":"4.f","version":"60'16189","reported_seq":16215,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.574780+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:20.574780+0000","last_peered":"2026-02-24T08:25:20.574780+0000","last_clean":"2026-02-24T08:25:20.574780+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:20.574780+0000","last_undegraded":"2026-02-24T08:25:20.574780+0000","last_fullsized":"2026-02-24T08:25:20.574780+0000","mapping_epoch":51,"log_start":"53'6100","ondisk_log_start":"53'6100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132620288,"num_objects":2024,"num_object_clones":0,"num_object_copies":6072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16189,"num_write_kb":129512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"60'15626","reported_seq":15654,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.261158+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:20.261158+0000","last_peered":"2026-02-24T08:25:20.261158+0000","last_clean":"2026-02-24T08:25:20.261158+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:20.261158+0000","last_undegraded":"2026-02-24T08:25:20.261158+0000","last_fullsized":"2026-02-24T08:25:20.261158+0000","mapping_epoch":51,"log_start":"53'5600","ondisk_log_start":"53'5600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128008192,"num_objects":1954,"num_object_clones":0,"num_object_copies":5862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15626,"num_write_kb":125008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'16204","reported_seq":16224,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.368481+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:20.368481+0000","last_peered":"2026-02-24T08:25:20.368481+0000","last_clean":"2026-02-24T08:25:20.368481+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:20.368481+0000","last_undegraded":"2026-02-24T08:25:20.368481+0000","last_fullsized":"2026-02-24T08:25:20.368481+0000","mapping_epoch":51,"log_start":"53'6200","ondisk_log_start":"53'6200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132743168,"num_objects":2026,"num_object_clones":0,"num_object_copies":6078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2026,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16204,"num_write_kb":129632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"60'16753","reported_seq":16779,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.366423+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:20.366423+0000","last_peered":"2026-02-24T08:25:20.366423+0000","last_clean":"2026-02-24T08:25:20.366423+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:20.366423+0000","last_undegraded":"2026-02-24T08:25:20.366423+0000","last_fullsized":"2026-02-24T08:25:20.366423+0000","mapping_epoch":51,"log_start":"53'6700","ondisk_log_start":"53'6700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137240576,"num_objects":2095,"num_object_clones":0,"num_object_copies":6285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16753,"num_write_kb":134024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"60'16012","reported_seq":16040,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.181784+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:25:20.181784+0000","last_peered":"2026-02-24T08:25:20.181784+0000","last_clean":"2026-02-24T08:25:20.181784+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:20.181784+0000","last_undegraded":"2026-02-24T08:25:20.181784+0000","last_fullsized":"2026-02-24T08:25:20.181784+0000","mapping_epoch":51,"log_start":"53'6000","ondisk_log_start":"53'6000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:29.713458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131170304,"num_objects":2002,"num_object_clones":0,"num_object_copies":6006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2002,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16012,"num_write_kb":128096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'16326","reported_seq":16348,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.261697+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:20.261697+0000","last_peered":"2026-02-24T08:25:20.261697+0000","last_clean":"2026-02-24T08:25:20.261697+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:20.261697+0000","last_undegraded":"2026-02-24T08:25:20.261697+0000","last_fullsized":"2026-02-24T08:25:20.261697+0000","mapping_epoch":51,"log_start":"53'6300","ondisk_log_start":"53'6300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133742592,"num_objects":2041,"num_object_clones":0,"num_object_copies":6123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16326,"num_write_kb":130608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'16456","reported_seq":16484,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.269101+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:25:20.269101+0000","last_peered":"2026-02-24T08:25:20.269101+0000","last_clean":"2026-02-24T08:25:20.269101+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:20.269101+0000","last_undegraded":"2026-02-24T08:25:20.269101+0000","last_fullsized":"2026-02-24T08:25:20.269101+0000","mapping_epoch":51,"log_start":"53'6400","ondisk_log_start":"53'6400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134807552,"num_objects":2057,"num_object_clones":0,"num_object_copies":6171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16456,"num_write_kb":131648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'16120","reported_seq":16148,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.338957+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:25:20.338957+0000","last_peered":"2026-02-24T08:25:20.338957+0000","last_clean":"2026-02-24T08:25:20.338957+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:20.338957+0000","last_undegraded":"2026-02-24T08:25:20.338957+0000","last_fullsized":"2026-02-24T08:25:20.338957+0000","mapping_epoch":51,"log_start":"53'6100","ondisk_log_start":"53'6100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132055040,"num_objects":2015,"num_object_clones":0,"num_object_copies":6045,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2015,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16120,"num_write_kb":128960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"60'16520","reported_seq":16548,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.567022+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:25:20.567022+0000","last_peered":"2026-02-24T08:25:20.567022+0000","last_clean":"2026-02-24T08:25:20.567022+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:20.567022+0000","last_undegraded":"2026-02-24T08:25:20.567022+0000","last_fullsized":"2026-02-24T08:25:20.567022+0000","mapping_epoch":51,"log_start":"53'6500","ondisk_log_start":"53'6500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135331840,"num_objects":2065,"num_object_clones":0,"num_object_copies":6195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16520,"num_write_kb":132160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'16296","reported_seq":16324,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.175730+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:25:20.175730+0000","last_peered":"2026-02-24T08:25:20.175730+0000","last_clean":"2026-02-24T08:25:20.175730+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:20.175730+0000","last_undegraded":"2026-02-24T08:25:20.175730+0000","last_fullsized":"2026-02-24T08:25:20.175730+0000","mapping_epoch":51,"log_start":"53'6200","ondisk_log_start":"53'6200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133496832,"num_objects":2037,"num_object_clones":0,"num_object_copies":6111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2037,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16296,"num_write_kb":130368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'16379","reported_seq":16394,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.569534+0000","last_change":"2026-02-24T08:24:24.849435+0000","last_active":"2026-02-24T08:25:20.569534+0000","last_peered":"2026-02-24T08:25:20.569534+0000","last_clean":"2026-02-24T08:25:20.569534+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:20.569534+0000","last_undegraded":"2026-02-24T08:25:20.569534+0000","last_fullsized":"2026-02-24T08:25:20.569534+0000","mapping_epoch":51,"log_start":"53'6300","ondisk_log_start":"53'6300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:24.030419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134176768,"num_objects":2048,"num_object_clones":0,"num_object_copies":6144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16379,"num_write_kb":131032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'16640","reported_seq":16668,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.164678+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:25:20.164678+0000","last_peered":"2026-02-24T08:25:20.164678+0000","last_clean":"2026-02-24T08:25:20.164678+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:20.164678+0000","last_undegraded":"2026-02-24T08:25:20.164678+0000","last_fullsized":"2026-02-24T08:25:20.164678+0000","mapping_epoch":51,"log_start":"53'6600","ondisk_log_start":"53'6600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136314880,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16640,"num_write_kb":133120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'16382","reported_seq":16409,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.562863+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:25:20.562863+0000","last_peered":"2026-02-24T08:25:20.562863+0000","last_clean":"2026-02-24T08:25:20.562863+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:20.562863+0000","last_undegraded":"2026-02-24T08:25:20.562863+0000","last_fullsized":"2026-02-24T08:25:20.562863+0000","mapping_epoch":51,"log_start":"53'6300","ondisk_log_start":"53'6300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134201344,"num_objects":2048,"num_object_clones":0,"num_object_copies":6144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16382,"num_write_kb":131056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'16552","reported_seq":16580,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.200775+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:20.200775+0000","last_peered":"2026-02-24T08:25:20.200775+0000","last_clean":"2026-02-24T08:25:20.200775+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:20.200775+0000","last_undegraded":"2026-02-24T08:25:20.200775+0000","last_fullsized":"2026-02-24T08:25:20.200775+0000","mapping_epoch":51,"log_start":"53'6500","ondisk_log_start":"53'6500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135593984,"num_objects":2069,"num_object_clones":0,"num_object_copies":6207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2069,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16552,"num_write_kb":132416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"60'16232","reported_seq":16260,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.089411+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:25:20.089411+0000","last_peered":"2026-02-24T08:25:20.089411+0000","last_clean":"2026-02-24T08:25:20.089411+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:20.089411+0000","last_undegraded":"2026-02-24T08:25:20.089411+0000","last_fullsized":"2026-02-24T08:25:20.089411+0000","mapping_epoch":51,"log_start":"53'6200","ondisk_log_start":"53'6200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132972544,"num_objects":2029,"num_object_clones":0,"num_object_copies":6087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2029,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16232,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"60'15736","reported_seq":15764,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:20.353549+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:20.353549+0000","last_peered":"2026-02-24T08:25:20.353549+0000","last_clean":"2026-02-24T08:25:20.353549+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:20.353549+0000","last_undegraded":"2026-02-24T08:25:20.353549+0000","last_fullsized":"2026-02-24T08:25:20.353549+0000","mapping_epoch":51,"log_start":"53'5700","ondisk_log_start":"53'5700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128909312,"num_objects":1967,"num_object_clones":0,"num_object_copies":5901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15736,"num_write_kb":125888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":147,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-24T08:25:19.691209+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:25:19.691209+0000","last_peered":"2026-02-24T08:25:19.691209+0000","last_clean":"2026-02-24T08:25:19.691209+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:19.691209+0000","last_undegraded":"2026-02-24T08:25:19.691209+0000","last_fullsized":"2026-02-24T08:25:19.691209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2133385216,"num_objects":32557,"num_object_clones":0,"num_object_copies":97671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260423,"num_write_kb":2083384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6399172608,"data_stored":6399172608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160723,"ondisk_log_size":160723,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9056,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247870,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3060256,"kb_used_data":1546764,"kb_used_omap":22,"kb_used_meta":1513449,"kb_avail":730942944,"statfs":{"total":751619276800,"available":748485574656,"internally_reserved":0,"allocated":1583886336,"data_stored":1583473196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23379,"internal_metadata":1549771949},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,7,7,6,19,9,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3388464,"kb_used_data":1820572,"kb_used_omap":34,"kb_used_meta":1567837,"kb_avail":730614736,"statfs":{"total":751619276800,"available":748149489664,"internally_reserved":0,"allocated":1864265728,"data_stored":1863852588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34826,"internal_metadata":1605466102},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,2,9],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2689932,"kb_used_data":1301688,"kb_used_omap":35,"kb_used_meta":1388188,"kb_avail":731313268,"statfs":{"total":751619276800,"available":748864786432,"internally_reserved":0,"allocated":1332928512,"data_stored":1332518924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36779,"internal_metadata":1421504597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3013920,"kb_used_data":1552652,"kb_used_omap":38,"kb_used_meta":1461209,"kb_avail":730989280,"statfs":{"total":751619276800,"available":748533022720,"internally_reserved":0,"allocated":1589915648,"data_stored":1589502508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39383,"internal_metadata":1496278569},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,3,7,3,0,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9056,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1598324736,"data_stored":1598324736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1338245120,"data_stored":1338245120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1863892992,"data_stored":1863892992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1598709760,"data_stored":1598709760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:25.977 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:25:25.977 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 56 2026-02-24T08:25:26.119 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:26.149 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:25 trial105 ceph-mon[39442]: pgmap v186: 17 pgs: 17 active+clean; 2.0 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.48k op/s 2026-02-24T08:25:26.149 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:25 trial105 ceph-mon[39442]: 4.4 scrub starts 2026-02-24T08:25:26.250 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:26.246+0000 7f16480d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:26.251 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:26.246+0000 7f16480d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:26.399 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:25:26.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:25:26.710 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:26.865 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:26.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 61 128 283117 282989 36.2404 28.6641 0.0244402 0.0275802 2026-02-24T08:25:26.990 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:26.987+0000 7fadfa102640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:26.991 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:26 trial105 ceph-mon[39442]: 4.4 scrub ok 2026-02-24T08:25:26.991 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1720084213' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T08:25:26.991 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:26.987+0000 7fadfa102640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:27.006 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:27.007 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:27.020 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:27.020 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:27.034 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:27.035 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:27.048 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:27.049 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:27.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 62 128 286563 286435 36.0901 26.9219 0.0176599 0.0276915 2026-02-24T08:25:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:27 trial105 ceph-mon[39442]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:27 trial105 ceph-mon[39442]: pgmap v187: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.45k op/s 2026-02-24T08:25:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1445532489' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:28.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 63 128 290128 290000 35.9593 27.8516 0.0154812 0.0277942 2026-02-24T08:25:29.093 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:29.234 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:29.655 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:25:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:25:29] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T08:25:29.672 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:29.651+0000 7fb5d2959640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:29.672 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:29.651+0000 7fb5d2959640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:29.686 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:29.687 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:29.701 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:29.702 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:29.716 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:29.717 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:29.730 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:29.730 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:25:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:25:29.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:25:29.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:29 trial105 ceph-mon[39442]: pgmap v188: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.45k op/s 2026-02-24T08:25:29.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:25:29.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4137899106' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:29.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 64 128 293255 293127 35.7791 24.4297 0.0208188 0.0279384 2026-02-24T08:25:30.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 65 128 296677 296549 35.6399 26.7344 0.0151993 0.0280488 2026-02-24T08:25:31.439 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:25:31.440 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:25:31.440 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:25:31.440 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:31.589 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:31.720 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:31.716+0000 7f12bb399640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:31.720 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:31.716+0000 7f12bb399640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:31.776 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:31.874 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:31.874 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:31.926 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:31.929 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2026-02-24T08:25:30.727601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2414494240,"num_objects":36838,"num_object_clones":0,"num_object_copies":110514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36838,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":294801,"num_write_kb":2359478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160865,"ondisk_log_size":160865,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13206012,"kb_used_data":7027820,"kb_used_omap":132,"kb_used_meta":6177979,"kb_avail":2922806788,"statfs":{"total":3006477107200,"available":2992954150912,"internally_reserved":0,"allocated":7196487680,"data_stored":7194807324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135580,"internal_metadata":6326251108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,5,4,1,14,32,8,30],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":280518656,"num_objects":4279,"num_object_clones":0,"num_object_copies":12837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4279,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34243,"num_write_kb":273944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001512"},"pg_stats":[{"pgid":"4.f","version":"61'18392","reported_seq":18419,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.592129+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:30.592129+0000","last_peered":"2026-02-24T08:25:30.592129+0000","last_clean":"2026-02-24T08:25:30.592129+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:30.592129+0000","last_undegraded":"2026-02-24T08:25:30.592129+0000","last_fullsized":"2026-02-24T08:25:30.592129+0000","mapping_epoch":51,"log_start":"53'8300","ondisk_log_start":"53'8300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150667264,"num_objects":2299,"num_object_clones":0,"num_object_copies":6897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18392,"num_write_kb":147136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'17784","reported_seq":17805,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.301133+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:30.301133+0000","last_peered":"2026-02-24T08:25:30.301133+0000","last_clean":"2026-02-24T08:25:30.301133+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:30.301133+0000","last_undegraded":"2026-02-24T08:25:30.301133+0000","last_fullsized":"2026-02-24T08:25:30.301133+0000","mapping_epoch":51,"log_start":"53'7700","ondisk_log_start":"53'7700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:34.137420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145686528,"num_objects":2223,"num_object_clones":0,"num_object_copies":6669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17784,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'18408","reported_seq":18438,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.379042+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:30.379042+0000","last_peered":"2026-02-24T08:25:30.379042+0000","last_clean":"2026-02-24T08:25:30.379042+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:30.379042+0000","last_undegraded":"2026-02-24T08:25:30.379042+0000","last_fullsized":"2026-02-24T08:25:30.379042+0000","mapping_epoch":51,"log_start":"53'8400","ondisk_log_start":"53'8400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150798336,"num_objects":2301,"num_object_clones":0,"num_object_copies":6903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18408,"num_write_kb":147264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'18931","reported_seq":18959,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.365156+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:30.365156+0000","last_peered":"2026-02-24T08:25:30.365156+0000","last_clean":"2026-02-24T08:25:30.365156+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:30.365156+0000","last_undegraded":"2026-02-24T08:25:30.365156+0000","last_fullsized":"2026-02-24T08:25:30.365156+0000","mapping_epoch":51,"log_start":"53'8900","ondisk_log_start":"53'8900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155082752,"num_objects":2367,"num_object_clones":0,"num_object_copies":7101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18931,"num_write_kb":151448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'18120","reported_seq":18150,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.178370+0000","last_change":"2026-02-24T08:24:24.850447+0000","last_active":"2026-02-24T08:25:30.178370+0000","last_peered":"2026-02-24T08:25:30.178370+0000","last_clean":"2026-02-24T08:25:30.178370+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:30.178370+0000","last_undegraded":"2026-02-24T08:25:30.178370+0000","last_fullsized":"2026-02-24T08:25:30.178370+0000","mapping_epoch":51,"log_start":"53'8100","ondisk_log_start":"53'8100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148439040,"num_objects":2265,"num_object_clones":0,"num_object_copies":6795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":144960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'18362","reported_seq":18386,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.298157+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:30.298157+0000","last_peered":"2026-02-24T08:25:30.298157+0000","last_clean":"2026-02-24T08:25:30.298157+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:30.298157+0000","last_undegraded":"2026-02-24T08:25:30.298157+0000","last_fullsized":"2026-02-24T08:25:30.298157+0000","mapping_epoch":51,"log_start":"53'8300","ondisk_log_start":"53'8300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:33.139329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150421504,"num_objects":2296,"num_object_clones":0,"num_object_copies":6888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2296,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18362,"num_write_kb":146896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'18720","reported_seq":18750,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.229164+0000","last_change":"2026-02-24T08:24:24.850479+0000","last_active":"2026-02-24T08:25:30.229164+0000","last_peered":"2026-02-24T08:25:30.229164+0000","last_clean":"2026-02-24T08:25:30.229164+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:30.229164+0000","last_undegraded":"2026-02-24T08:25:30.229164+0000","last_fullsized":"2026-02-24T08:25:30.229164+0000","mapping_epoch":51,"log_start":"53'8700","ondisk_log_start":"53'8700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:31.417553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153354240,"num_objects":2340,"num_object_clones":0,"num_object_copies":7020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18720,"num_write_kb":149760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'18120","reported_seq":18150,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.317188+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:25:30.317188+0000","last_peered":"2026-02-24T08:25:30.317188+0000","last_clean":"2026-02-24T08:25:30.317188+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:30.317188+0000","last_undegraded":"2026-02-24T08:25:30.317188+0000","last_fullsized":"2026-02-24T08:25:30.317188+0000","mapping_epoch":51,"log_start":"53'8100","ondisk_log_start":"53'8100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148439040,"num_objects":2265,"num_object_clones":0,"num_object_copies":6795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2265,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":144960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'18651","reported_seq":18679,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.560656+0000","last_change":"2026-02-24T08:24:24.850611+0000","last_active":"2026-02-24T08:25:30.560656+0000","last_peered":"2026-02-24T08:25:30.560656+0000","last_clean":"2026-02-24T08:25:30.560656+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:30.560656+0000","last_undegraded":"2026-02-24T08:25:30.560656+0000","last_fullsized":"2026-02-24T08:25:30.560656+0000","mapping_epoch":51,"log_start":"53'8600","ondisk_log_start":"53'8600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:32.151597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152788992,"num_objects":2332,"num_object_clones":0,"num_object_copies":6996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18651,"num_write_kb":149208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'18488","reported_seq":18518,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.201161+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:25:30.201161+0000","last_peered":"2026-02-24T08:25:30.201161+0000","last_clean":"2026-02-24T08:25:30.201161+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:30.201161+0000","last_undegraded":"2026-02-24T08:25:30.201161+0000","last_fullsized":"2026-02-24T08:25:30.201161+0000","mapping_epoch":51,"log_start":"53'8400","ondisk_log_start":"53'8400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151453696,"num_objects":2311,"num_object_clones":0,"num_object_copies":6933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18488,"num_write_kb":147904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'18360","reported_seq":18421,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.564174+0000","last_change":"2026-02-24T08:25:25.859210+0000","last_active":"2026-02-24T08:25:30.564174+0000","last_peered":"2026-02-24T08:25:30.564174+0000","last_clean":"2026-02-24T08:25:30.564174+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:30.564174+0000","last_undegraded":"2026-02-24T08:25:30.564174+0000","last_fullsized":"2026-02-24T08:25:30.564174+0000","mapping_epoch":51,"log_start":"53'8300","ondisk_log_start":"53'8300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'17368","last_scrub_stamp":"2026-02-24T08:25:25.859164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:25.859164+0000","objects_scrubbed":2169,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.950124+0000","scrub_duration":553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150405120,"num_objects":2295,"num_object_clones":0,"num_object_copies":6885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2295,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18360,"num_write_kb":146880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'18728","reported_seq":18758,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.165611+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:25:30.165611+0000","last_peered":"2026-02-24T08:25:30.165611+0000","last_clean":"2026-02-24T08:25:30.165611+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:30.165611+0000","last_undegraded":"2026-02-24T08:25:30.165611+0000","last_fullsized":"2026-02-24T08:25:30.165611+0000","mapping_epoch":51,"log_start":"53'8700","ondisk_log_start":"53'8700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153419776,"num_objects":2341,"num_object_clones":0,"num_object_copies":7023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18728,"num_write_kb":149824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'18624","reported_seq":18654,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.585066+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:25:30.585066+0000","last_peered":"2026-02-24T08:25:30.585066+0000","last_clean":"2026-02-24T08:25:30.585066+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:30.585066+0000","last_undegraded":"2026-02-24T08:25:30.585066+0000","last_fullsized":"2026-02-24T08:25:30.585066+0000","mapping_epoch":51,"log_start":"53'8600","ondisk_log_start":"53'8600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:35.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152567808,"num_objects":2328,"num_object_clones":0,"num_object_copies":6984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18624,"num_write_kb":148992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'18934","reported_seq":18964,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.295666+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:30.295666+0000","last_peered":"2026-02-24T08:25:30.295666+0000","last_clean":"2026-02-24T08:25:30.295666+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:30.295666+0000","last_undegraded":"2026-02-24T08:25:30.295666+0000","last_fullsized":"2026-02-24T08:25:30.295666+0000","mapping_epoch":51,"log_start":"53'8900","ondisk_log_start":"53'8900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155107328,"num_objects":2367,"num_object_clones":0,"num_object_copies":7101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18934,"num_write_kb":151472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'18152","reported_seq":18182,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.033451+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:25:30.033451+0000","last_peered":"2026-02-24T08:25:30.033451+0000","last_clean":"2026-02-24T08:25:30.033451+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:30.033451+0000","last_undegraded":"2026-02-24T08:25:30.033451+0000","last_fullsized":"2026-02-24T08:25:30.033451+0000","mapping_epoch":51,"log_start":"53'8100","ondisk_log_start":"53'8100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148701184,"num_objects":2269,"num_object_clones":0,"num_object_copies":6807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2269,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18152,"num_write_kb":145216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'17892","reported_seq":17922,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:30.388509+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:30.388509+0000","last_peered":"2026-02-24T08:25:30.388509+0000","last_clean":"2026-02-24T08:25:30.388509+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:30.388509+0000","last_undegraded":"2026-02-24T08:25:30.388509+0000","last_fullsized":"2026-02-24T08:25:30.388509+0000","mapping_epoch":51,"log_start":"53'7800","ondisk_log_start":"53'7800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146571264,"num_objects":2237,"num_object_clones":0,"num_object_copies":6711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17892,"num_write_kb":143136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":149,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:21.797246+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:25:21.797246+0000","last_peered":"2026-02-24T08:25:21.797246+0000","last_clean":"2026-02-24T08:25:21.797246+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:21.797246+0000","last_undegraded":"2026-02-24T08:25:21.797246+0000","last_fullsized":"2026-02-24T08:25:21.797246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2413903872,"num_objects":36836,"num_object_clones":0,"num_object_copies":110508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36836,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294666,"num_write_kb":2357328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7239671808,"data_stored":7239671808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160766,"ondisk_log_size":160766,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9088,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3354540,"kb_used_data":1753496,"kb_used_omap":22,"kb_used_meta":1601001,"kb_avail":730648660,"statfs":{"total":751619276800,"available":748184227840,"internally_reserved":0,"allocated":1795579904,"data_stored":1795158927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22639,"internal_metadata":1639425937},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,1,2,0,5,15],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444098,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3663804,"kb_used_data":2041768,"kb_used_omap":34,"kb_used_meta":1621981,"kb_avail":730339396,"statfs":{"total":751619276800,"available":747867541504,"internally_reserved":0,"allocated":2090770432,"data_stored":2090349455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35477,"internal_metadata":1660908907},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2899800,"kb_used_data":1475460,"kb_used_omap":36,"kb_used_meta":1424283,"kb_avail":731103400,"statfs":{"total":751619276800,"available":748649881600,"internally_reserved":0,"allocated":1510871040,"data_stored":1510453615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":1458466250},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,4,2,1,9,17,8,30],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3287868,"kb_used_data":1757096,"kb_used_omap":39,"kb_used_meta":1530712,"kb_avail":730715332,"statfs":{"total":751619276800,"available":748252499968,"internally_reserved":0,"allocated":1799266304,"data_stored":1798845327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40034,"internal_metadata":1567450014},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9088,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1808760832,"data_stored":1808760832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1513578496,"data_stored":1513578496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2109431808,"data_stored":2109431808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1807900672,"data_stored":1807900672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:31.931 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:25:31.931 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 101 2026-02-24T08:25:31.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 66 127 300100 299973 35.5052 26.75 0.016719 0.0281523 2026-02-24T08:25:31.983 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:31 trial105 ceph-mon[39442]: pgmap v189: 17 pgs: 17 active+clean; 2.2 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.42k op/s 2026-02-24T08:25:32.053 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:32.049+0000 7f7716772640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:32.053 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:32.049+0000 7f7716772640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:32.068 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:32.069 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:32.082 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:32.087 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:32.087 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:32.104 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:32.104 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:32.118 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:32.118 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:32.204 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:32.201+0000 7f8392455640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:32.204 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:32.201+0000 7f8392455640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:32.348 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:25:32.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:25:32.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:32 trial105 ceph-mon[39442]: 4.b scrub starts 2026-02-24T08:25:32.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:32 trial105 ceph-mon[39442]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:32.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:32 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2669385445' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:32.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:32 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4279982552' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "101"} : dispatch 2026-02-24T08:25:32.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:32 trial105 ceph-mon[39442]: 4.7 scrub starts 2026-02-24T08:25:32.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 67 128 303403 303275 35.3603 25.7969 0.0273817 0.0282651 2026-02-24T08:25:33.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 68 128 306911 306783 35.2433 27.4062 0.0887303 0.0283614 2026-02-24T08:25:34.182 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:33 trial105 ceph-mon[39442]: 4.b scrub ok 2026-02-24T08:25:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:33 trial105 ceph-mon[39442]: pgmap v190: 17 pgs: 17 active+clean; 2.2 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.13k op/s 2026-02-24T08:25:34.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:33 trial105 ceph-mon[39442]: 4.7 scrub ok 2026-02-24T08:25:34.335 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:34.464 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:34.460+0000 7f3666796640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:34.464 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:34.460+0000 7f3666796640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:34.479 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:34.479 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:34.493 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:34.493 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:34.506 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:34.506 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:34.522 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:34.522 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:34.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 69 128 310418 310290 35.1295 27.3984 0.0186849 0.0284519 2026-02-24T08:25:35.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3647286071' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:35.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 70 128 313959 313831 35.0229 27.6641 0.0640947 0.0285395 2026-02-24T08:25:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:35 trial105 ceph-mon[39442]: pgmap v191: 17 pgs: 17 active+clean; 2.2 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.85k op/s 2026-02-24T08:25:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:35 trial105 ceph-mon[39442]: 4.9 scrub starts 2026-02-24T08:25:36.565 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:36.704 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:36.823 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:36.820+0000 7f8c3c61c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:36.823 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:36.820+0000 7f8c3c61c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:36.836 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:36.837 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:36.851 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:36.851 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:36.851 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:36 trial105 ceph-mon[39442]: 4.9 scrub ok 2026-02-24T08:25:36.851 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:25:36.851 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:25:36.851 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:25:36.851 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:25:36.851 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:25:36.865 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:36.865 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:36.880 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:36.880 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:36.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 71 128 317134 317006 34.8789 24.8047 0.0618586 0.0286592 2026-02-24T08:25:37.389 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:25:37.389 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:25:37.389 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_2 2026-02-24T08:25:37.389 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:37.528 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:37.651 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:37.647+0000 7f76cc373640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:37.651 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:37.648+0000 7f76cc373640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:37.794 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:37.795 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:37.837 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2026-02-24T08:25:36.728403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2556002848,"num_objects":38996,"num_object_clones":0,"num_object_copies":116988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38996,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":312075,"num_write_kb":2497670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160839,"ondisk_log_size":160839,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13692724,"kb_used_data":7442340,"kb_used_omap":132,"kb_used_meta":6250171,"kb_avail":2922320076,"statfs":{"total":3006477107200,"available":2992455757824,"internally_reserved":0,"allocated":7620956160,"data_stored":7619275804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135580,"internal_metadata":6400175716},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,2,3,12,10,17,22,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":422027264,"num_objects":6437,"num_object_clones":0,"num_object_copies":19311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6437,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51517,"num_write_kb":412136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001647"},"pg_stats":[{"pgid":"4.f","version":"61'19536","reported_seq":19566,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.590282+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:35.590282+0000","last_peered":"2026-02-24T08:25:35.590282+0000","last_clean":"2026-02-24T08:25:35.590282+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:35.590282+0000","last_undegraded":"2026-02-24T08:25:35.590282+0000","last_fullsized":"2026-02-24T08:25:35.590282+0000","mapping_epoch":51,"log_start":"53'9500","ondisk_log_start":"53'9500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:38.572000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160038912,"num_objects":2442,"num_object_clones":0,"num_object_copies":7326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19536,"num_write_kb":156288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'18865","reported_seq":18894,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.323461+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:35.323461+0000","last_peered":"2026-02-24T08:25:35.323461+0000","last_clean":"2026-02-24T08:25:35.323461+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:35.323461+0000","last_undegraded":"2026-02-24T08:25:35.323461+0000","last_fullsized":"2026-02-24T08:25:35.323461+0000","mapping_epoch":51,"log_start":"53'8800","ondisk_log_start":"53'8800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154542080,"num_objects":2359,"num_object_clones":0,"num_object_copies":7077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2359,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18865,"num_write_kb":150920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'19536","reported_seq":19566,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.406179+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:35.406179+0000","last_peered":"2026-02-24T08:25:35.406179+0000","last_clean":"2026-02-24T08:25:35.406179+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:35.406179+0000","last_undegraded":"2026-02-24T08:25:35.406179+0000","last_fullsized":"2026-02-24T08:25:35.406179+0000","mapping_epoch":51,"log_start":"53'9500","ondisk_log_start":"53'9500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160038912,"num_objects":2442,"num_object_clones":0,"num_object_copies":7326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19536,"num_write_kb":156288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'19960","reported_seq":19987,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.402750+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:35.402750+0000","last_peered":"2026-02-24T08:25:35.402750+0000","last_clean":"2026-02-24T08:25:35.402750+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:35.402750+0000","last_undegraded":"2026-02-24T08:25:35.402750+0000","last_fullsized":"2026-02-24T08:25:35.402750+0000","mapping_epoch":51,"log_start":"53'9900","ondisk_log_start":"53'9900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163512320,"num_objects":2495,"num_object_clones":0,"num_object_copies":7485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2495,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19960,"num_write_kb":159680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'19344","reported_seq":19404,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.211677+0000","last_change":"2026-02-24T08:25:32.677569+0000","last_active":"2026-02-24T08:25:35.211677+0000","last_peered":"2026-02-24T08:25:35.211677+0000","last_clean":"2026-02-24T08:25:35.211677+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:35.211677+0000","last_undegraded":"2026-02-24T08:25:35.211677+0000","last_fullsized":"2026-02-24T08:25:35.211677+0000","mapping_epoch":51,"log_start":"53'9300","ondisk_log_start":"53'9300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'18712","last_scrub_stamp":"2026-02-24T08:25:32.677533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.677533+0000","objects_scrubbed":2301,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:58.590112+0000","scrub_duration":1845,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158466048,"num_objects":2418,"num_object_clones":0,"num_object_copies":7254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2418,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19344,"num_write_kb":154752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'19312","reported_seq":19340,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.322965+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:35.322965+0000","last_peered":"2026-02-24T08:25:35.322965+0000","last_clean":"2026-02-24T08:25:35.322965+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:35.322965+0000","last_undegraded":"2026-02-24T08:25:35.322965+0000","last_fullsized":"2026-02-24T08:25:35.322965+0000","mapping_epoch":51,"log_start":"53'9300","ondisk_log_start":"53'9300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158203904,"num_objects":2414,"num_object_clones":0,"num_object_copies":7242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19312,"num_write_kb":154496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'19941","reported_seq":19979,"reported_epoch":61,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:25:35.323304+0000","last_change":"2026-02-24T08:25:34.561020+0000","last_active":"2026-02-24T08:25:35.323304+0000","last_peered":"2026-02-24T08:25:35.323304+0000","last_clean":"2026-02-24T08:25:35.323304+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:35.323304+0000","last_undegraded":"2026-02-24T08:25:35.323304+0000","last_fullsized":"2026-02-24T08:25:35.323304+0000","mapping_epoch":51,"log_start":"53'9900","ondisk_log_start":"53'9900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":699,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163356672,"num_objects":2493,"num_object_clones":0,"num_object_copies":7479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19941,"num_write_kb":159528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'19070","reported_seq":19098,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.407230+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:25:35.407230+0000","last_peered":"2026-02-24T08:25:35.407230+0000","last_clean":"2026-02-24T08:25:35.407230+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:35.407230+0000","last_undegraded":"2026-02-24T08:25:35.407230+0000","last_fullsized":"2026-02-24T08:25:35.407230+0000","mapping_epoch":51,"log_start":"53'9000","ondisk_log_start":"53'9000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:37.029394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156221440,"num_objects":2384,"num_object_clones":0,"num_object_copies":7152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2384,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19070,"num_write_kb":152560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'19640","reported_seq":19702,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.547193+0000","last_change":"2026-02-24T08:25:32.900165+0000","last_active":"2026-02-24T08:25:35.547193+0000","last_peered":"2026-02-24T08:25:35.547193+0000","last_clean":"2026-02-24T08:25:35.547193+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:35.547193+0000","last_undegraded":"2026-02-24T08:25:35.547193+0000","last_fullsized":"2026-02-24T08:25:35.547193+0000","mapping_epoch":51,"log_start":"53'9600","ondisk_log_start":"53'9600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'19040","last_scrub_stamp":"2026-02-24T08:25:32.900096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.900096+0000","objects_scrubbed":2378,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.680505+0000","scrub_duration":526,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160890880,"num_objects":2455,"num_object_clones":0,"num_object_copies":7365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19640,"num_write_kb":157120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'19544","reported_seq":19574,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.192229+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:25:35.192229+0000","last_peered":"2026-02-24T08:25:35.192229+0000","last_clean":"2026-02-24T08:25:35.192229+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:35.192229+0000","last_undegraded":"2026-02-24T08:25:35.192229+0000","last_fullsized":"2026-02-24T08:25:35.192229+0000","mapping_epoch":51,"log_start":"53'9500","ondisk_log_start":"53'9500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.143103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160104448,"num_objects":2443,"num_object_clones":0,"num_object_copies":7329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19544,"num_write_kb":156352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'19552","reported_seq":19607,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.596091+0000","last_change":"2026-02-24T08:25:25.859210+0000","last_active":"2026-02-24T08:25:35.596091+0000","last_peered":"2026-02-24T08:25:35.596091+0000","last_clean":"2026-02-24T08:25:35.596091+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:35.596091+0000","last_undegraded":"2026-02-24T08:25:35.596091+0000","last_fullsized":"2026-02-24T08:25:35.596091+0000","mapping_epoch":51,"log_start":"53'9500","ondisk_log_start":"53'9500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'17368","last_scrub_stamp":"2026-02-24T08:25:25.859164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:25.859164+0000","objects_scrubbed":2169,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.950124+0000","scrub_duration":553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160169984,"num_objects":2444,"num_object_clones":0,"num_object_copies":7332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19552,"num_write_kb":156416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'19720","reported_seq":19750,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.200251+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:25:35.200251+0000","last_peered":"2026-02-24T08:25:35.200251+0000","last_clean":"2026-02-24T08:25:35.200251+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:35.200251+0000","last_undegraded":"2026-02-24T08:25:35.200251+0000","last_fullsized":"2026-02-24T08:25:35.200251+0000","mapping_epoch":51,"log_start":"53'9700","ondisk_log_start":"53'9700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.717695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161546240,"num_objects":2465,"num_object_clones":0,"num_object_copies":7395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19720,"num_write_kb":157760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'19760","reported_seq":19790,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.539743+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:25:35.539743+0000","last_peered":"2026-02-24T08:25:35.539743+0000","last_clean":"2026-02-24T08:25:35.539743+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:35.539743+0000","last_undegraded":"2026-02-24T08:25:35.539743+0000","last_fullsized":"2026-02-24T08:25:35.539743+0000","mapping_epoch":51,"log_start":"53'9700","ondisk_log_start":"53'9700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161873920,"num_objects":2470,"num_object_clones":0,"num_object_copies":7410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19760,"num_write_kb":158080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'20064","reported_seq":20094,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.304237+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:35.304237+0000","last_peered":"2026-02-24T08:25:35.304237+0000","last_clean":"2026-02-24T08:25:35.304237+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:35.304237+0000","last_undegraded":"2026-02-24T08:25:35.304237+0000","last_fullsized":"2026-02-24T08:25:35.304237+0000","mapping_epoch":51,"log_start":"53'10000","ondisk_log_start":"53'10000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164364288,"num_objects":2508,"num_object_clones":0,"num_object_copies":7524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20064,"num_write_kb":160512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'19224","reported_seq":19246,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.211730+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:25:35.211730+0000","last_peered":"2026-02-24T08:25:35.211730+0000","last_clean":"2026-02-24T08:25:35.211730+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:35.211730+0000","last_undegraded":"2026-02-24T08:25:35.211730+0000","last_fullsized":"2026-02-24T08:25:35.211730+0000","mapping_epoch":51,"log_start":"53'9200","ondisk_log_start":"53'9200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:39.240368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157483008,"num_objects":2403,"num_object_clones":0,"num_object_copies":7209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19224,"num_write_kb":153792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'18872","reported_seq":18902,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:35.317815+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:35.317815+0000","last_peered":"2026-02-24T08:25:35.317815+0000","last_clean":"2026-02-24T08:25:35.317815+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:35.317815+0000","last_undegraded":"2026-02-24T08:25:35.317815+0000","last_fullsized":"2026-02-24T08:25:35.317815+0000","mapping_epoch":51,"log_start":"53'8800","ondisk_log_start":"53'8800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154599424,"num_objects":2359,"num_object_clones":0,"num_object_copies":7077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2359,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18872,"num_write_kb":150976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":149,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:21.797246+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:25:21.797246+0000","last_peered":"2026-02-24T08:25:21.797246+0000","last_clean":"2026-02-24T08:25:21.797246+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:21.797246+0000","last_undegraded":"2026-02-24T08:25:21.797246+0000","last_fullsized":"2026-02-24T08:25:21.797246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2555412480,"num_objects":38994,"num_object_clones":0,"num_object_copies":116982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311940,"num_write_kb":2495520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7665156096,"data_stored":7665156096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160740,"ondisk_log_size":160740,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9088,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3473748,"kb_used_data":1854656,"kb_used_omap":22,"kb_used_meta":1619049,"kb_avail":730529452,"statfs":{"total":751619276800,"available":748062158848,"internally_reserved":0,"allocated":1899167744,"data_stored":1898746767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22639,"internal_metadata":1657907089},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444099,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3784236,"kb_used_data":2162200,"kb_used_omap":34,"kb_used_meta":1621981,"kb_avail":730218964,"statfs":{"total":751619276800,"available":747744219136,"internally_reserved":0,"allocated":2214092800,"data_stored":2213671823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35477,"internal_metadata":1660908907},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3005400,"kb_used_data":1563012,"kb_used_omap":36,"kb_used_meta":1442331,"kb_avail":730997800,"statfs":{"total":751619276800,"available":748541747200,"internally_reserved":0,"allocated":1600524288,"data_stored":1600106863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":1476947402},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705735,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3429340,"kb_used_data":1862472,"kb_used_omap":39,"kb_used_meta":1566808,"kb_avail":730573860,"statfs":{"total":751619276800,"available":748107632640,"internally_reserved":0,"allocated":1907171328,"data_stored":1906750351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40034,"internal_metadata":1604412318},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,2,3,12,10,17,22,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9088,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1915871232,"data_stored":1915871232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1604124672,"data_stored":1604124672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2232516608,"data_stored":2232516608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1912643584,"data_stored":1912643584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:37.839 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_2 pgp_num 56 2026-02-24T08:25:37.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 72 128 320381 320253 34.7468 25.3672 0.0620264 0.028765 2026-02-24T08:25:37.977 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:38.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:37 trial105 ceph-mon[39442]: pgmap v192: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.29k op/s 2026-02-24T08:25:38.046 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3394776352' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:38.105 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:38.102+0000 7fa088b49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:38.105 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:38.103+0000 7fa088b49640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:38.249 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:25:38.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:25:38.925 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:38.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 73 127 323773 323646 34.6339 26.5078 0.0628048 0.0288623 2026-02-24T08:25:39.071 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:39.098 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:38 trial105 ceph-mon[39442]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:39.098 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:38 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/762615545' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pgp_num", "val": "56"} : dispatch 2026-02-24T08:25:39.192 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:39.189+0000 7f3ec29f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:39.192 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:39.189+0000 7f3ec29f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:39.206 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:39.207 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:39.220 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:39.220 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:39.233 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:39.234 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:39.246 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:39.246 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:39.814 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:25:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:25:39] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T08:25:39.840 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:25:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:25:39.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:25:39.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 74 128 327202 327074 34.5278 26.7812 0.0364363 0.0289509 2026-02-24T08:25:40.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:39 trial105 ceph-mon[39442]: pgmap v193: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.89k op/s 2026-02-24T08:25:40.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:39 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3942591834' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:40.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 75 127 330794 330667 34.4416 28.0703 0.0307865 0.029025 2026-02-24T08:25:41.288 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:41.437 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:41.749 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:41.720+0000 7f8751fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:41.749 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:41.720+0000 7f8751fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:41.749 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:41.749 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:41.753 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:41.753 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:41.767 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:41.767 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:41.781 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:41.781 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:41 trial105 ceph-mon[39442]: 4.6 scrub starts 2026-02-24T08:25:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:41 trial105 ceph-mon[39442]: pgmap v194: 17 pgs: 17 active+clean; 2.5 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.28k op/s 2026-02-24T08:25:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:41 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3954673388' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:41.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 76 128 333855 333727 34.303 23.9062 0.0482269 0.0291378 2026-02-24T08:25:42.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 77 128 337389 337261 34.216 27.6094 0.0457215 0.0292154 2026-02-24T08:25:43.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:42 trial105 ceph-mon[39442]: 4.2 scrub starts 2026-02-24T08:25:43.290 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:25:43.290 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:25:43.291 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:25:43.291 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:43.441 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:43.561 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:43.559+0000 7fdc0d041640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:43.562 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:43.559+0000 7fdc0d041640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:43.694 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:43.695 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:43.740 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2026-02-24T08:25:42.729231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2693177888,"num_objects":41093,"num_object_clones":0,"num_object_copies":123279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41093,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":328820,"num_write_kb":2631630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161084,"ondisk_log_size":161084,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":14203068,"kb_used_data":7844396,"kb_used_omap":132,"kb_used_meta":6358459,"kb_avail":2921809732,"statfs":{"total":3006477107200,"available":2991933165568,"internally_reserved":0,"allocated":8032661504,"data_stored":8030981148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135580,"internal_metadata":6511062628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,8,6,13,15,28,23,34],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":278683648,"num_objects":4255,"num_object_clones":0,"num_object_copies":12765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4255,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34019,"num_write_kb":272152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001630"},"pg_stats":[{"pgid":"4.f","version":"61'20448","reported_seq":20478,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.600393+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:40.600393+0000","last_peered":"2026-02-24T08:25:40.600393+0000","last_clean":"2026-02-24T08:25:40.600393+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:40.600393+0000","last_undegraded":"2026-02-24T08:25:40.600393+0000","last_fullsized":"2026-02-24T08:25:40.600393+0000","mapping_epoch":51,"log_start":"53'10400","ondisk_log_start":"53'10400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167510016,"num_objects":2556,"num_object_clones":0,"num_object_copies":7668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20448,"num_write_kb":163584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'19992","reported_seq":20022,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.325687+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:40.325687+0000","last_peered":"2026-02-24T08:25:40.325687+0000","last_clean":"2026-02-24T08:25:40.325687+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:40.325687+0000","last_undegraded":"2026-02-24T08:25:40.325687+0000","last_fullsized":"2026-02-24T08:25:40.325687+0000","mapping_epoch":51,"log_start":"53'9900","ondisk_log_start":"53'9900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163774464,"num_objects":2499,"num_object_clones":0,"num_object_copies":7497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19992,"num_write_kb":159936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'20776","reported_seq":20806,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.372983+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:40.372983+0000","last_peered":"2026-02-24T08:25:40.372983+0000","last_clean":"2026-02-24T08:25:40.372983+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:40.372983+0000","last_undegraded":"2026-02-24T08:25:40.372983+0000","last_fullsized":"2026-02-24T08:25:40.372983+0000","mapping_epoch":51,"log_start":"53'10700","ondisk_log_start":"53'10700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170196992,"num_objects":2597,"num_object_clones":0,"num_object_copies":7791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20776,"num_write_kb":166208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'20946","reported_seq":20971,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.404827+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:40.404827+0000","last_peered":"2026-02-24T08:25:40.404827+0000","last_clean":"2026-02-24T08:25:40.404827+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:40.404827+0000","last_undegraded":"2026-02-24T08:25:40.404827+0000","last_fullsized":"2026-02-24T08:25:40.404827+0000","mapping_epoch":51,"log_start":"53'10900","ondisk_log_start":"53'10900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:43.617432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171589632,"num_objects":2619,"num_object_clones":0,"num_object_copies":7857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2619,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20946,"num_write_kb":167568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'20360","reported_seq":20421,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.215304+0000","last_change":"2026-02-24T08:25:32.677569+0000","last_active":"2026-02-24T08:25:40.215304+0000","last_peered":"2026-02-24T08:25:40.215304+0000","last_clean":"2026-02-24T08:25:40.215304+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:40.215304+0000","last_undegraded":"2026-02-24T08:25:40.215304+0000","last_fullsized":"2026-02-24T08:25:40.215304+0000","mapping_epoch":51,"log_start":"53'10300","ondisk_log_start":"53'10300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'18712","last_scrub_stamp":"2026-02-24T08:25:32.677533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.677533+0000","objects_scrubbed":2301,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:58.590112+0000","scrub_duration":1845,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166789120,"num_objects":2545,"num_object_clones":0,"num_object_copies":7635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20360,"num_write_kb":162880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'20397","reported_seq":20421,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.344004+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:40.344004+0000","last_peered":"2026-02-24T08:25:40.344004+0000","last_clean":"2026-02-24T08:25:40.344004+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:40.344004+0000","last_undegraded":"2026-02-24T08:25:40.344004+0000","last_fullsized":"2026-02-24T08:25:40.344004+0000","mapping_epoch":51,"log_start":"53'10300","ondisk_log_start":"53'10300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167092224,"num_objects":2550,"num_object_clones":0,"num_object_copies":7650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20397,"num_write_kb":163176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'20800","reported_seq":20863,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.339148+0000","last_change":"2026-02-24T08:25:35.902752+0000","last_active":"2026-02-24T08:25:40.339148+0000","last_peered":"2026-02-24T08:25:40.339148+0000","last_clean":"2026-02-24T08:25:40.339148+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:40.339148+0000","last_undegraded":"2026-02-24T08:25:40.339148+0000","last_fullsized":"2026-02-24T08:25:40.339148+0000","mapping_epoch":51,"log_start":"53'10700","ondisk_log_start":"53'10700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'20048","last_scrub_stamp":"2026-02-24T08:25:35.902638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:35.902638+0000","objects_scrubbed":2495,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:49.000779+0000","scrub_duration":1037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170393600,"num_objects":2600,"num_object_clones":0,"num_object_copies":7800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2600,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20800,"num_write_kb":166400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'20190","reported_seq":20219,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.409840+0000","last_change":"2026-02-24T08:24:24.851486+0000","last_active":"2026-02-24T08:25:40.409840+0000","last_peered":"2026-02-24T08:25:40.409840+0000","last_clean":"2026-02-24T08:25:40.409840+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:40.409840+0000","last_undegraded":"2026-02-24T08:25:40.409840+0000","last_fullsized":"2026-02-24T08:25:40.409840+0000","mapping_epoch":51,"log_start":"53'10100","ondisk_log_start":"53'10100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165396480,"num_objects":2524,"num_object_clones":0,"num_object_copies":7572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20190,"num_write_kb":161520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'20641","reported_seq":20701,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.608237+0000","last_change":"2026-02-24T08:25:32.900165+0000","last_active":"2026-02-24T08:25:40.608237+0000","last_peered":"2026-02-24T08:25:40.608237+0000","last_clean":"2026-02-24T08:25:40.608237+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:40.608237+0000","last_undegraded":"2026-02-24T08:25:40.608237+0000","last_fullsized":"2026-02-24T08:25:40.608237+0000","mapping_epoch":51,"log_start":"53'10600","ondisk_log_start":"53'10600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'19040","last_scrub_stamp":"2026-02-24T08:25:32.900096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.900096+0000","objects_scrubbed":2378,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.680505+0000","scrub_duration":526,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169091072,"num_objects":2581,"num_object_clones":0,"num_object_copies":7743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2581,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20641,"num_write_kb":165128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'20739","reported_seq":20764,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.228645+0000","last_change":"2026-02-24T08:24:24.849732+0000","last_active":"2026-02-24T08:25:40.228645+0000","last_peered":"2026-02-24T08:25:40.228645+0000","last_clean":"2026-02-24T08:25:40.228645+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:40.228645+0000","last_undegraded":"2026-02-24T08:25:40.228645+0000","last_fullsized":"2026-02-24T08:25:40.228645+0000","mapping_epoch":51,"log_start":"53'10700","ondisk_log_start":"53'10700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169893888,"num_objects":2593,"num_object_clones":0,"num_object_copies":7779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20739,"num_write_kb":165912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'20522","reported_seq":20583,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.605979+0000","last_change":"2026-02-24T08:25:25.859210+0000","last_active":"2026-02-24T08:25:40.605979+0000","last_peered":"2026-02-24T08:25:40.605979+0000","last_clean":"2026-02-24T08:25:40.605979+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:40.605979+0000","last_undegraded":"2026-02-24T08:25:40.605979+0000","last_fullsized":"2026-02-24T08:25:40.605979+0000","mapping_epoch":51,"log_start":"53'10500","ondisk_log_start":"53'10500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'17368","last_scrub_stamp":"2026-02-24T08:25:25.859164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:25.859164+0000","objects_scrubbed":2169,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.950124+0000","scrub_duration":553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168116224,"num_objects":2566,"num_object_clones":0,"num_object_copies":7698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20522,"num_write_kb":164176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'20972","reported_seq":21002,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.225931+0000","last_change":"2026-02-24T08:24:24.850206+0000","last_active":"2026-02-24T08:25:40.225931+0000","last_peered":"2026-02-24T08:25:40.225931+0000","last_clean":"2026-02-24T08:25:40.225931+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:40.225931+0000","last_undegraded":"2026-02-24T08:25:40.225931+0000","last_fullsized":"2026-02-24T08:25:40.225931+0000","mapping_epoch":51,"log_start":"53'10900","ondisk_log_start":"53'10900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171802624,"num_objects":2622,"num_object_clones":0,"num_object_copies":7866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2622,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20972,"num_write_kb":167776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'20666","reported_seq":20696,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.588380+0000","last_change":"2026-02-24T08:24:24.849345+0000","last_active":"2026-02-24T08:25:40.588380+0000","last_peered":"2026-02-24T08:25:40.588380+0000","last_clean":"2026-02-24T08:25:40.588380+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:40.588380+0000","last_undegraded":"2026-02-24T08:25:40.588380+0000","last_fullsized":"2026-02-24T08:25:40.588380+0000","mapping_epoch":51,"log_start":"53'10600","ondisk_log_start":"53'10600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169295872,"num_objects":2584,"num_object_clones":0,"num_object_copies":7752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20666,"num_write_kb":165328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'21052","reported_seq":21080,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.347300+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:40.347300+0000","last_peered":"2026-02-24T08:25:40.347300+0000","last_clean":"2026-02-24T08:25:40.347300+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:40.347300+0000","last_undegraded":"2026-02-24T08:25:40.347300+0000","last_fullsized":"2026-02-24T08:25:40.347300+0000","mapping_epoch":51,"log_start":"54'11000","ondisk_log_start":"54'11000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172457984,"num_objects":2632,"num_object_clones":0,"num_object_copies":7896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2632,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21052,"num_write_kb":168416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'20312","reported_seq":20342,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.190820+0000","last_change":"2026-02-24T08:24:24.850381+0000","last_active":"2026-02-24T08:25:40.190820+0000","last_peered":"2026-02-24T08:25:40.190820+0000","last_clean":"2026-02-24T08:25:40.190820+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:40.190820+0000","last_undegraded":"2026-02-24T08:25:40.190820+0000","last_fullsized":"2026-02-24T08:25:40.190820+0000","mapping_epoch":51,"log_start":"53'10300","ondisk_log_start":"53'10300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166395904,"num_objects":2539,"num_object_clones":0,"num_object_copies":7617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20312,"num_write_kb":162496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'19872","reported_seq":19900,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:40.419729+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:40.419729+0000","last_peered":"2026-02-24T08:25:40.419729+0000","last_clean":"2026-02-24T08:25:40.419729+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:40.419729+0000","last_undegraded":"2026-02-24T08:25:40.419729+0000","last_fullsized":"2026-02-24T08:25:40.419729+0000","mapping_epoch":51,"log_start":"53'9800","ondisk_log_start":"53'9800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:44.230478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162791424,"num_objects":2484,"num_object_clones":0,"num_object_copies":7452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19872,"num_write_kb":158976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":149,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:21.797246+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:25:21.797246+0000","last_peered":"2026-02-24T08:25:21.797246+0000","last_clean":"2026-02-24T08:25:21.797246+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:21.797246+0000","last_undegraded":"2026-02-24T08:25:21.797246+0000","last_fullsized":"2026-02-24T08:25:21.797246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2692587520,"num_objects":41091,"num_object_clones":0,"num_object_copies":123273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328685,"num_write_kb":2629480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8078065664,"data_stored":8078065664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160985,"ondisk_log_size":160985,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9088,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247874,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3574820,"kb_used_data":1955728,"kb_used_omap":22,"kb_used_meta":1619049,"kb_avail":730428380,"statfs":{"total":751619276800,"available":747958661120,"internally_reserved":0,"allocated":2002665472,"data_stored":2002244495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22639,"internal_metadata":1657907089},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,0,8,10,15,23,34],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444100,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3995404,"kb_used_data":2283128,"kb_used_omap":34,"kb_used_meta":1712221,"kb_avail":730007796,"statfs":{"total":751619276800,"available":747527983104,"internally_reserved":0,"allocated":2337923072,"data_stored":2337502095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35477,"internal_metadata":1753314667},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3104144,"kb_used_data":1643708,"kb_used_omap":36,"kb_used_meta":1460379,"kb_avail":730899056,"statfs":{"total":751619276800,"available":748440633344,"internally_reserved":0,"allocated":1683156992,"data_stored":1682739567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":1495428554},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,5,6,5,5,13],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3528700,"kb_used_data":1961832,"kb_used_omap":39,"kb_used_meta":1566808,"kb_avail":730474500,"statfs":{"total":751619276800,"available":748005888000,"internally_reserved":0,"allocated":2008915968,"data_stored":2008494991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40034,"internal_metadata":1604412318},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9088,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2019303424,"data_stored":2019303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1687412736,"data_stored":1687412736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2354872320,"data_stored":2354872320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2016477184,"data_stored":2016477184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:43.742 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:25:43.742 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 111 2026-02-24T08:25:43.842 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:43.894 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:43.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 78 128 340681 340553 34.1071 25.7188 0.0158445 0.0293083 2026-02-24T08:25:43.951 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:43 trial105 ceph-mon[39442]: 4.6 scrub ok 2026-02-24T08:25:43.951 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:43 trial105 ceph-mon[39442]: pgmap v195: 17 pgs: 17 active+clean; 2.5 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.83k op/s 2026-02-24T08:25:43.951 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:43 trial105 ceph-mon[39442]: 4.2 scrub ok 2026-02-24T08:25:43.993 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:44.030 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:44.028+0000 7f9916610640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:44.032 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:44.030+0000 7f9916610640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:44.108 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:44.105+0000 7f32d5f1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:44.108 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:44.106+0000 7f32d5f1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:44.126 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:44.126 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:44.138 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:44.138 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:44.152 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:44.152 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:44.165 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:44.165 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:44.180 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:25:44.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:25:44.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 79 128 344015 343887 34.005 26.0469 0.0566619 0.0293965 2026-02-24T08:25:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:44 trial105 ceph-mon[39442]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:44 trial105 ceph-mon[39442]: 4.0 scrub starts 2026-02-24T08:25:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:44 trial105 ceph-mon[39442]: 4.8 scrub starts 2026-02-24T08:25:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:25:45.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4224214382' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:45.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/483437595' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "111"} : dispatch 2026-02-24T08:25:45.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:25:45.945768+0000 min lat: 0.00104395 max lat: 0.227592 avg lat: 0.0294841 2026-02-24T08:25:45.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:25:45.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 80 128 347330 347202 33.9037 25.8984 0.0304063 0.0294841 2026-02-24T08:25:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:45 trial105 ceph-mon[39442]: 4.8 scrub ok 2026-02-24T08:25:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:45 trial105 ceph-mon[39442]: 4.0 scrub ok 2026-02-24T08:25:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:45 trial105 ceph-mon[39442]: pgmap v196: 17 pgs: 17 active+clean; 2.5 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.83k op/s 2026-02-24T08:25:46.218 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:46.368 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:46.573 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:46.570+0000 7f0154092640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:46.573 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:46.570+0000 7f0154092640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:46.587 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:46.587 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:46.602 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:46.602 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:46.616 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:46.616 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:46.631 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:46.631 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:46.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 81 128 350745 350617 33.8144 26.6797 0.0498413 0.0295612 2026-02-24T08:25:47.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:46 trial105 ceph-mon[39442]: 4.3 scrub starts 2026-02-24T08:25:47.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1932537696' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:47.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:46 trial105 ceph-mon[39442]: 4.a scrub starts 2026-02-24T08:25:47.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 82 128 354215 354087 33.7326 27.1094 0.0178234 0.0296352 2026-02-24T08:25:48.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:47 trial105 ceph-mon[39442]: 4.3 scrub ok 2026-02-24T08:25:48.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:47 trial105 ceph-mon[39442]: pgmap v197: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.6 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.23k op/s 2026-02-24T08:25:48.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:47 trial105 ceph-mon[39442]: 4.a scrub ok 2026-02-24T08:25:48.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:47 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:25:48.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:47 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:25:48.679 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:48.827 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:48.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 83 128 357672 357544 33.6516 27.0078 0.00998783 0.0297055 2026-02-24T08:25:48.959 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:48.957+0000 7f5b7171d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:48.959 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:48.957+0000 7f5b7171d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:48.960 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:48 trial105 ceph-mon[39442]: 4.f scrub starts 2026-02-24T08:25:48.974 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:48.974 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:48.986 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:48.986 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:49.001 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:49.001 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:49.014 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:49.014 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:49.225 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:25:49.225 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:25:49.226 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:25:49.226 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:49.368 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:49.489 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:49.487+0000 7f825a9ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:49.489 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:49.487+0000 7f825a9ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:49.633 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:49.634 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:49.635 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:25:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:25:49] "GET /metrics HTTP/1.1" 200 4216 "" "Prometheus/3.6.0" 2026-02-24T08:25:49.678 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2026-02-24T08:25:48.731813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2830533152,"num_objects":43186,"num_object_clones":0,"num_object_copies":129558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43186,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":345587,"num_write_kb":2765766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160951,"ondisk_log_size":160951,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":14699164,"kb_used_data":8250188,"kb_used_omap":132,"kb_used_meta":6448763,"kb_avail":2921313636,"statfs":{"total":3006477107200,"available":2991425163264,"internally_reserved":0,"allocated":8448192512,"data_stored":8446512156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135580,"internal_metadata":6603533924},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":274530304,"num_objects":4190,"num_object_clones":0,"num_object_copies":12570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33512,"num_write_kb":268096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003410"},"pg_stats":[{"pgid":"4.f","version":"61'21408","reported_seq":21438,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.605517+0000","last_change":"2026-02-24T08:24:24.850345+0000","last_active":"2026-02-24T08:25:45.605517+0000","last_peered":"2026-02-24T08:25:45.605517+0000","last_clean":"2026-02-24T08:25:45.605517+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:45.605517+0000","last_undegraded":"2026-02-24T08:25:45.605517+0000","last_fullsized":"2026-02-24T08:25:45.605517+0000","mapping_epoch":51,"log_start":"54'11400","ondisk_log_start":"54'11400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175374336,"num_objects":2676,"num_object_clones":0,"num_object_copies":8028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21408,"num_write_kb":171264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'21403","reported_seq":21431,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.354869+0000","last_change":"2026-02-24T08:24:24.852354+0000","last_active":"2026-02-24T08:25:45.354869+0000","last_peered":"2026-02-24T08:25:45.354869+0000","last_clean":"2026-02-24T08:25:45.354869+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:45.354869+0000","last_undegraded":"2026-02-24T08:25:45.354869+0000","last_fullsized":"2026-02-24T08:25:45.354869+0000","mapping_epoch":51,"log_start":"54'11400","ondisk_log_start":"54'11400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175333376,"num_objects":2676,"num_object_clones":0,"num_object_copies":8028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2676,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21403,"num_write_kb":171224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'21791","reported_seq":21819,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.432534+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:45.432534+0000","last_peered":"2026-02-24T08:25:45.432534+0000","last_clean":"2026-02-24T08:25:45.432534+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:45.432534+0000","last_undegraded":"2026-02-24T08:25:45.432534+0000","last_fullsized":"2026-02-24T08:25:45.432534+0000","mapping_epoch":51,"log_start":"54'11700","ondisk_log_start":"54'11700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:48.273950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178511872,"num_objects":2724,"num_object_clones":0,"num_object_copies":8172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2724,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21791,"num_write_kb":174328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'22048","reported_seq":22078,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.365032+0000","last_change":"2026-02-24T08:24:24.851941+0000","last_active":"2026-02-24T08:25:45.365032+0000","last_peered":"2026-02-24T08:25:45.365032+0000","last_clean":"2026-02-24T08:25:45.365032+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:45.365032+0000","last_undegraded":"2026-02-24T08:25:45.365032+0000","last_fullsized":"2026-02-24T08:25:45.365032+0000","mapping_epoch":51,"log_start":"54'12000","ondisk_log_start":"54'12000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180617216,"num_objects":2756,"num_object_clones":0,"num_object_copies":8268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22048,"num_write_kb":176384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'21424","reported_seq":21485,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.191791+0000","last_change":"2026-02-24T08:25:32.677569+0000","last_active":"2026-02-24T08:25:45.191791+0000","last_peered":"2026-02-24T08:25:45.191791+0000","last_clean":"2026-02-24T08:25:45.191791+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:45.191791+0000","last_undegraded":"2026-02-24T08:25:45.191791+0000","last_fullsized":"2026-02-24T08:25:45.191791+0000","mapping_epoch":51,"log_start":"54'11400","ondisk_log_start":"54'11400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'18712","last_scrub_stamp":"2026-02-24T08:25:32.677533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.677533+0000","objects_scrubbed":2301,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:58.590112+0000","scrub_duration":1845,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175505408,"num_objects":2678,"num_object_clones":0,"num_object_copies":8034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21424,"num_write_kb":171392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'21348","reported_seq":21371,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.363968+0000","last_change":"2026-02-24T08:24:24.852555+0000","last_active":"2026-02-24T08:25:45.363968+0000","last_peered":"2026-02-24T08:25:45.363968+0000","last_clean":"2026-02-24T08:25:45.363968+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:45.363968+0000","last_undegraded":"2026-02-24T08:25:45.363968+0000","last_fullsized":"2026-02-24T08:25:45.363968+0000","mapping_epoch":51,"log_start":"54'11300","ondisk_log_start":"54'11300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174882816,"num_objects":2669,"num_object_clones":0,"num_object_copies":8007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21348,"num_write_kb":170784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'21771","reported_seq":21834,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.354793+0000","last_change":"2026-02-24T08:25:35.902752+0000","last_active":"2026-02-24T08:25:45.354793+0000","last_peered":"2026-02-24T08:25:45.354793+0000","last_clean":"2026-02-24T08:25:45.354793+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:45.354793+0000","last_undegraded":"2026-02-24T08:25:45.354793+0000","last_fullsized":"2026-02-24T08:25:45.354793+0000","mapping_epoch":51,"log_start":"54'11700","ondisk_log_start":"54'11700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'20048","last_scrub_stamp":"2026-02-24T08:25:35.902638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:35.902638+0000","objects_scrubbed":2495,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:49.000779+0000","scrub_duration":1037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178348032,"num_objects":2722,"num_object_clones":0,"num_object_copies":8166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21771,"num_write_kb":174168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'21200","reported_seq":21264,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.413165+0000","last_change":"2026-02-24T08:25:44.625620+0000","last_active":"2026-02-24T08:25:45.413165+0000","last_peered":"2026-02-24T08:25:45.413165+0000","last_clean":"2026-02-24T08:25:45.413165+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:45.413165+0000","last_undegraded":"2026-02-24T08:25:45.413165+0000","last_fullsized":"2026-02-24T08:25:45.413165+0000","mapping_epoch":51,"log_start":"54'11100","ondisk_log_start":"54'11100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21024","last_scrub_stamp":"2026-02-24T08:25:44.625584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:44.625584+0000","objects_scrubbed":2617,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:14.077261+0000","scrub_duration":883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173670400,"num_objects":2650,"num_object_clones":0,"num_object_copies":7950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2650,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21200,"num_write_kb":169600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'21588","reported_seq":21650,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.609104+0000","last_change":"2026-02-24T08:25:32.900165+0000","last_active":"2026-02-24T08:25:45.609104+0000","last_peered":"2026-02-24T08:25:45.609104+0000","last_clean":"2026-02-24T08:25:45.609104+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:45.609104+0000","last_undegraded":"2026-02-24T08:25:45.609104+0000","last_fullsized":"2026-02-24T08:25:45.609104+0000","mapping_epoch":51,"log_start":"54'11500","ondisk_log_start":"54'11500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'19040","last_scrub_stamp":"2026-02-24T08:25:32.900096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.900096+0000","objects_scrubbed":2378,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.680505+0000","scrub_duration":526,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176848896,"num_objects":2699,"num_object_clones":0,"num_object_copies":8097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2699,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21588,"num_write_kb":172704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'21783","reported_seq":21843,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.238871+0000","last_change":"2026-02-24T08:25:41.906665+0000","last_active":"2026-02-24T08:25:45.238871+0000","last_peered":"2026-02-24T08:25:45.238871+0000","last_clean":"2026-02-24T08:25:45.238871+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:45.238871+0000","last_undegraded":"2026-02-24T08:25:45.238871+0000","last_fullsized":"2026-02-24T08:25:45.238871+0000","mapping_epoch":51,"log_start":"54'11700","ondisk_log_start":"54'11700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21160","last_scrub_stamp":"2026-02-24T08:25:41.906618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:41.906618+0000","objects_scrubbed":2631,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.653616+0000","scrub_duration":1269,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178446336,"num_objects":2723,"num_object_clones":0,"num_object_copies":8169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21783,"num_write_kb":174264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'21496","reported_seq":21557,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.538448+0000","last_change":"2026-02-24T08:25:25.859210+0000","last_active":"2026-02-24T08:25:45.538448+0000","last_peered":"2026-02-24T08:25:45.538448+0000","last_clean":"2026-02-24T08:25:45.538448+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:45.538448+0000","last_undegraded":"2026-02-24T08:25:45.538448+0000","last_fullsized":"2026-02-24T08:25:45.538448+0000","mapping_epoch":51,"log_start":"54'11400","ondisk_log_start":"54'11400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'17368","last_scrub_stamp":"2026-02-24T08:25:25.859164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:25.859164+0000","objects_scrubbed":2169,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.950124+0000","scrub_duration":553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176095232,"num_objects":2687,"num_object_clones":0,"num_object_copies":8061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21496,"num_write_kb":171968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'22104","reported_seq":22147,"reported_epoch":61,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:25:45.231194+0000","last_change":"2026-02-24T08:25:44.760730+0000","last_active":"2026-02-24T08:25:45.231194+0000","last_peered":"2026-02-24T08:25:45.231194+0000","last_clean":"2026-02-24T08:25:45.231194+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:45.231194+0000","last_undegraded":"2026-02-24T08:25:45.231194+0000","last_fullsized":"2026-02-24T08:25:45.231194+0000","mapping_epoch":51,"log_start":"54'12100","ondisk_log_start":"54'12100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":899,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181075968,"num_objects":2763,"num_object_clones":0,"num_object_copies":8289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22104,"num_write_kb":176832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'21784","reported_seq":21848,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.561438+0000","last_change":"2026-02-24T08:25:43.017326+0000","last_active":"2026-02-24T08:25:45.561438+0000","last_peered":"2026-02-24T08:25:45.561438+0000","last_clean":"2026-02-24T08:25:45.561438+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:45.561438+0000","last_undegraded":"2026-02-24T08:25:45.561438+0000","last_fullsized":"2026-02-24T08:25:45.561438+0000","mapping_epoch":51,"log_start":"54'11700","ondisk_log_start":"54'11700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21216","last_scrub_stamp":"2026-02-24T08:25:43.017253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:43.017253+0000","objects_scrubbed":2648,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:55.211256+0000","scrub_duration":569,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178454528,"num_objects":2723,"num_object_clones":0,"num_object_copies":8169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21784,"num_write_kb":174272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'22024","reported_seq":22054,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.205461+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:45.205461+0000","last_peered":"2026-02-24T08:25:45.205461+0000","last_clean":"2026-02-24T08:25:45.205461+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:45.205461+0000","last_undegraded":"2026-02-24T08:25:45.205461+0000","last_fullsized":"2026-02-24T08:25:45.205461+0000","mapping_epoch":51,"log_start":"54'12000","ondisk_log_start":"54'12000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:49.126543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180420608,"num_objects":2753,"num_object_clones":0,"num_object_copies":8259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2753,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22024,"num_write_kb":176192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'21376","reported_seq":21440,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.225436+0000","last_change":"2026-02-24T08:25:44.671573+0000","last_active":"2026-02-24T08:25:45.225436+0000","last_peered":"2026-02-24T08:25:45.225436+0000","last_clean":"2026-02-24T08:25:45.225436+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:45.225436+0000","last_undegraded":"2026-02-24T08:25:45.225436+0000","last_fullsized":"2026-02-24T08:25:45.225436+0000","mapping_epoch":51,"log_start":"54'11300","ondisk_log_start":"54'11300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21288","last_scrub_stamp":"2026-02-24T08:25:44.671491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:44.671491+0000","objects_scrubbed":2644,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:46.197472+0000","scrub_duration":954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175112192,"num_objects":2672,"num_object_clones":0,"num_object_copies":8016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21376,"num_write_kb":171008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'20904","reported_seq":20934,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:45.409298+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:45.409298+0000","last_peered":"2026-02-24T08:25:45.409298+0000","last_clean":"2026-02-24T08:25:45.409298+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:45.409298+0000","last_undegraded":"2026-02-24T08:25:45.409298+0000","last_fullsized":"2026-02-24T08:25:45.409298+0000","mapping_epoch":51,"log_start":"54'10900","ondisk_log_start":"54'10900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171245568,"num_objects":2613,"num_object_clones":0,"num_object_copies":7839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2613,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20904,"num_write_kb":167232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":149,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:21.797246+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:25:21.797246+0000","last_peered":"2026-02-24T08:25:21.797246+0000","last_clean":"2026-02-24T08:25:21.797246+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:21.797246+0000","last_undegraded":"2026-02-24T08:25:21.797246+0000","last_fullsized":"2026-02-24T08:25:21.797246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2829942784,"num_objects":43184,"num_object_clones":0,"num_object_copies":129552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345452,"num_write_kb":2763616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8490565632,"data_stored":8490565632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160852,"ondisk_log_size":160852,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9088,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247875,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3714444,"kb_used_data":2059256,"kb_used_omap":22,"kb_used_meta":1655145,"kb_avail":730288756,"statfs":{"total":751619276800,"available":747815686144,"internally_reserved":0,"allocated":2108678144,"data_stored":2108257167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22639,"internal_metadata":1694869393},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4112300,"kb_used_data":2399960,"kb_used_omap":34,"kb_used_meta":1712285,"kb_avail":729890900,"statfs":{"total":751619276800,"available":747408281600,"internally_reserved":0,"allocated":2457559040,"data_stored":2457138063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35477,"internal_metadata":1753380203},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3206152,"kb_used_data":1727668,"kb_used_omap":36,"kb_used_meta":1478427,"kb_avail":730797048,"statfs":{"total":751619276800,"available":748336177152,"internally_reserved":0,"allocated":1769132032,"data_stored":1768714607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":1513909706},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3666268,"kb_used_data":2063304,"kb_used_omap":39,"kb_used_meta":1602904,"kb_avail":730336932,"statfs":{"total":751619276800,"available":747865018368,"internally_reserved":0,"allocated":2112823296,"data_stored":2112402319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40034,"internal_metadata":1641374622},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9088,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2120974336,"data_stored":2120974336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1773289472,"data_stored":1773289472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2475040768,"data_stored":2475040768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2121261056,"data_stored":2121261056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:49.679 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:25:49.679 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 121 2026-02-24T08:25:49.822 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:49.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:25:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:25:49.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:25:49.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 84 128 360974 360846 33.5581 25.7969 0.00863884 0.0297891 2026-02-24T08:25:49.947 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:49.945+0000 7fb9ea19a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:49.948 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:49.945+0000 7fb9ea19a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:50.091 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:25:50.091 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:49 trial105 ceph-mon[39442]: pgmap v198: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.6 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.79k op/s 2026-02-24T08:25:50.091 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:49 trial105 ceph-mon[39442]: 4.c scrub starts 2026-02-24T08:25:50.091 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/263969629' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:50.091 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:49 trial105 ceph-mon[39442]: 4.e scrub starts 2026-02-24T08:25:50.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:25:50.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 85 128 364316 364188 33.4704 26.1094 0.0252066 0.0298665 2026-02-24T08:25:51.057 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:51.082 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:50 trial105 ceph-mon[39442]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:51.082 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:50 trial105 ceph-mon[39442]: 4.c scrub ok 2026-02-24T08:25:51.082 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:50 trial105 ceph-mon[39442]: 4.f scrub ok 2026-02-24T08:25:51.082 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2814444476' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "121"} : dispatch 2026-02-24T08:25:51.083 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:50 trial105 ceph-mon[39442]: 4.e scrub ok 2026-02-24T08:25:51.194 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:51.313 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:51.311+0000 7f4f2fbba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:51.313 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:51.311+0000 7f4f2fbba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:51.328 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:51.329 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:51.343 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:51.343 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:51.358 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:51.358 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:51.371 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:51.371 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:51.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 86 127 367614 367487 33.3809 25.7734 0.0224241 0.0299467 2026-02-24T08:25:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:51 trial105 ceph-mon[39442]: pgmap v199: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.8 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.21k op/s 2026-02-24T08:25:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:51 trial105 ceph-mon[39442]: 4.1 scrub starts 2026-02-24T08:25:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1145724280' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:52.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 87 127 371153 371026 33.315 27.6484 0.0227951 0.0300063 2026-02-24T08:25:53.412 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:53.435 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:53 trial105 ceph-mon[39442]: pgmap v200: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.8 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.81k op/s 2026-02-24T08:25:53.546 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:53.669 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:53.666+0000 7fe917be5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:53.669 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:53.667+0000 7fe917be5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:53.685 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:53.686 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:53.700 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:53.700 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:53.713 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:53.713 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:53.726 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:53.726 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:53.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 88 128 374426 374298 33.2269 25.5625 0.032353 0.0300849 2026-02-24T08:25:54.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:54 trial105 ceph-mon[39442]: 4.5 scrub starts 2026-02-24T08:25:54.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:54 trial105 ceph-mon[39442]: 4.1 scrub ok 2026-02-24T08:25:54.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4156698071' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:54.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 89 128 377698 377570 33.1407 25.5625 0.0223763 0.0301621 2026-02-24T08:25:55.134 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:25:55.134 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:25:55.135 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_2 2026-02-24T08:25:55.135 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:25:55.283 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:55.306 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:55 trial105 ceph-mon[39442]: 4.d scrub starts 2026-02-24T08:25:55.306 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:55 trial105 ceph-mon[39442]: pgmap v201: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.8 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.81k op/s 2026-02-24T08:25:55.404 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:55.401+0000 7f75c583f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:55.404 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:55.401+0000 7f75c583f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:55.554 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:25:55.555 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:25:55.599 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2026-02-24T08:25:54.732634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2969969184,"num_objects":45312,"num_object_clones":0,"num_object_copies":135936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45312,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":362608,"num_write_kb":2901934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160972,"ondisk_log_size":160972,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":15174932,"kb_used_data":8657732,"kb_used_omap":132,"kb_used_meta":6516987,"kb_avail":2920837868,"statfs":{"total":3006477107200,"available":2990937976832,"internally_reserved":0,"allocated":8865517568,"data_stored":8863837212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":135617,"internal_metadata":6673395263},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,18,20,14,32,18,27,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":276791296,"num_objects":4219,"num_object_clones":0,"num_object_copies":12657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33788,"num_write_kb":270304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003403"},"pg_stats":[{"pgid":"4.f","version":"61'22568","reported_seq":22634,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.534801+0000","last_change":"2026-02-24T08:25:49.995329+0000","last_active":"2026-02-24T08:25:50.534801+0000","last_peered":"2026-02-24T08:25:50.534801+0000","last_clean":"2026-02-24T08:25:50.534801+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:25:50.534801+0000","last_undegraded":"2026-02-24T08:25:50.534801+0000","last_fullsized":"2026-02-24T08:25:50.534801+0000","mapping_epoch":51,"log_start":"54'12500","ondisk_log_start":"54'12500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'22416","last_scrub_stamp":"2026-02-24T08:25:49.995265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:49.995265+0000","objects_scrubbed":2777,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.116260+0000","scrub_duration":1749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184877056,"num_objects":2821,"num_object_clones":0,"num_object_copies":8463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22568,"num_write_kb":180544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'22488","reported_seq":22546,"reported_epoch":61,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:25:50.373862+0000","last_change":"2026-02-24T08:25:49.663929+0000","last_active":"2026-02-24T08:25:50.373862+0000","last_peered":"2026-02-24T08:25:50.373862+0000","last_clean":"2026-02-24T08:25:50.373862+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:25:50.373862+0000","last_undegraded":"2026-02-24T08:25:50.373862+0000","last_fullsized":"2026-02-24T08:25:50.373862+0000","mapping_epoch":51,"log_start":"54'12400","ondisk_log_start":"54'12400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":2399,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184221696,"num_objects":2811,"num_object_clones":0,"num_object_copies":8433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2811,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22488,"num_write_kb":179904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'22883","reported_seq":22913,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.446844+0000","last_change":"2026-02-24T08:24:24.851928+0000","last_active":"2026-02-24T08:25:50.446844+0000","last_peered":"2026-02-24T08:25:50.446844+0000","last_clean":"2026-02-24T08:25:50.446844+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:25:50.446844+0000","last_undegraded":"2026-02-24T08:25:50.446844+0000","last_fullsized":"2026-02-24T08:25:50.446844+0000","mapping_epoch":51,"log_start":"54'12800","ondisk_log_start":"54'12800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187457536,"num_objects":2861,"num_object_clones":0,"num_object_copies":8583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2861,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22883,"num_write_kb":183064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'23104","reported_seq":23171,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.445049+0000","last_change":"2026-02-24T08:25:49.798343+0000","last_active":"2026-02-24T08:25:50.445049+0000","last_peered":"2026-02-24T08:25:50.445049+0000","last_clean":"2026-02-24T08:25:50.445049+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:25:50.445049+0000","last_undegraded":"2026-02-24T08:25:50.445049+0000","last_fullsized":"2026-02-24T08:25:50.445049+0000","mapping_epoch":51,"log_start":"54'13100","ondisk_log_start":"54'13100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'23000","last_scrub_stamp":"2026-02-24T08:25:49.798270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:49.798270+0000","objects_scrubbed":2869,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:18.225302+0000","scrub_duration":1006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189267968,"num_objects":2888,"num_object_clones":0,"num_object_copies":8664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2888,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23104,"num_write_kb":184832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'22408","reported_seq":22469,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.253280+0000","last_change":"2026-02-24T08:25:32.677569+0000","last_active":"2026-02-24T08:25:50.253280+0000","last_peered":"2026-02-24T08:25:50.253280+0000","last_clean":"2026-02-24T08:25:50.253280+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:25:50.253280+0000","last_undegraded":"2026-02-24T08:25:50.253280+0000","last_fullsized":"2026-02-24T08:25:50.253280+0000","mapping_epoch":51,"log_start":"54'12400","ondisk_log_start":"54'12400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'18712","last_scrub_stamp":"2026-02-24T08:25:32.677533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.677533+0000","objects_scrubbed":2301,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:58.590112+0000","scrub_duration":1845,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183566336,"num_objects":2801,"num_object_clones":0,"num_object_copies":8403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22408,"num_write_kb":179264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'22464","reported_seq":22529,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.361387+0000","last_change":"2026-02-24T08:25:47.089979+0000","last_active":"2026-02-24T08:25:50.361387+0000","last_peered":"2026-02-24T08:25:50.361387+0000","last_clean":"2026-02-24T08:25:50.361387+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:25:50.361387+0000","last_undegraded":"2026-02-24T08:25:50.361387+0000","last_fullsized":"2026-02-24T08:25:50.361387+0000","mapping_epoch":51,"log_start":"54'12400","ondisk_log_start":"54'12400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21752","last_scrub_stamp":"2026-02-24T08:25:47.089946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:47.089946+0000","objects_scrubbed":2714,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:53.244420+0000","scrub_duration":451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184025088,"num_objects":2808,"num_object_clones":0,"num_object_copies":8424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2808,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22464,"num_write_kb":179712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'22816","reported_seq":22872,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.375548+0000","last_change":"2026-02-24T08:25:35.902752+0000","last_active":"2026-02-24T08:25:50.375548+0000","last_peered":"2026-02-24T08:25:50.375548+0000","last_clean":"2026-02-24T08:25:50.375548+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:25:50.375548+0000","last_undegraded":"2026-02-24T08:25:50.375548+0000","last_fullsized":"2026-02-24T08:25:50.375548+0000","mapping_epoch":51,"log_start":"54'12800","ondisk_log_start":"54'12800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'20048","last_scrub_stamp":"2026-02-24T08:25:35.902638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:35.902638+0000","objects_scrubbed":2495,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:49.000779+0000","scrub_duration":1037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186908672,"num_objects":2852,"num_object_clones":0,"num_object_copies":8556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2852,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22816,"num_write_kb":182528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'22304","reported_seq":22368,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.404002+0000","last_change":"2026-02-24T08:25:44.625620+0000","last_active":"2026-02-24T08:25:50.404002+0000","last_peered":"2026-02-24T08:25:50.404002+0000","last_clean":"2026-02-24T08:25:50.404002+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:25:50.404002+0000","last_undegraded":"2026-02-24T08:25:50.404002+0000","last_fullsized":"2026-02-24T08:25:50.404002+0000","mapping_epoch":51,"log_start":"54'12300","ondisk_log_start":"54'12300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21024","last_scrub_stamp":"2026-02-24T08:25:44.625584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:44.625584+0000","objects_scrubbed":2617,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:14.077261+0000","scrub_duration":883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182714368,"num_objects":2788,"num_object_clones":0,"num_object_copies":8364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22304,"num_write_kb":178432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'22640","reported_seq":22702,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.558459+0000","last_change":"2026-02-24T08:25:32.900165+0000","last_active":"2026-02-24T08:25:50.558459+0000","last_peered":"2026-02-24T08:25:50.558459+0000","last_clean":"2026-02-24T08:25:50.558459+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:25:50.558459+0000","last_undegraded":"2026-02-24T08:25:50.558459+0000","last_fullsized":"2026-02-24T08:25:50.558459+0000","mapping_epoch":51,"log_start":"54'12600","ondisk_log_start":"54'12600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'19040","last_scrub_stamp":"2026-02-24T08:25:32.900096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.900096+0000","objects_scrubbed":2378,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.680505+0000","scrub_duration":526,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185466880,"num_objects":2830,"num_object_clones":0,"num_object_copies":8490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22640,"num_write_kb":181120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'22992","reported_seq":23057,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.248697+0000","last_change":"2026-02-24T08:25:41.906665+0000","last_active":"2026-02-24T08:25:50.248697+0000","last_peered":"2026-02-24T08:25:50.248697+0000","last_clean":"2026-02-24T08:25:50.248697+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:25:50.248697+0000","last_undegraded":"2026-02-24T08:25:50.248697+0000","last_fullsized":"2026-02-24T08:25:50.248697+0000","mapping_epoch":51,"log_start":"54'12900","ondisk_log_start":"54'12900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21160","last_scrub_stamp":"2026-02-24T08:25:41.906618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:41.906618+0000","objects_scrubbed":2631,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.653616+0000","scrub_duration":1269,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188350464,"num_objects":2874,"num_object_clones":0,"num_object_copies":8622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2874,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22992,"num_write_kb":183936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'22494","reported_seq":22549,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.624177+0000","last_change":"2026-02-24T08:25:25.859210+0000","last_active":"2026-02-24T08:25:50.624177+0000","last_peered":"2026-02-24T08:25:50.624177+0000","last_clean":"2026-02-24T08:25:50.624177+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:25:50.624177+0000","last_undegraded":"2026-02-24T08:25:50.624177+0000","last_fullsized":"2026-02-24T08:25:50.624177+0000","mapping_epoch":51,"log_start":"54'12400","ondisk_log_start":"54'12400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'17368","last_scrub_stamp":"2026-02-24T08:25:25.859164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:25.859164+0000","objects_scrubbed":2169,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.950124+0000","scrub_duration":553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184270848,"num_objects":2812,"num_object_clones":0,"num_object_copies":8436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2812,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22494,"num_write_kb":179952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'23088","reported_seq":23154,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.196386+0000","last_change":"2026-02-24T08:25:45.841494+0000","last_active":"2026-02-24T08:25:50.196386+0000","last_peered":"2026-02-24T08:25:50.196386+0000","last_clean":"2026-02-24T08:25:50.196386+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:25:50.196386+0000","last_undegraded":"2026-02-24T08:25:50.196386+0000","last_fullsized":"2026-02-24T08:25:50.196386+0000","mapping_epoch":51,"log_start":"54'13000","ondisk_log_start":"54'13000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'22248","last_scrub_stamp":"2026-02-24T08:25:45.841412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:45.841412+0000","objects_scrubbed":2769,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:00.463377+0000","scrub_duration":840,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189136896,"num_objects":2886,"num_object_clones":0,"num_object_copies":8658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2886,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23088,"num_write_kb":184704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'22632","reported_seq":22696,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.584850+0000","last_change":"2026-02-24T08:25:43.017326+0000","last_active":"2026-02-24T08:25:50.584850+0000","last_peered":"2026-02-24T08:25:50.584850+0000","last_clean":"2026-02-24T08:25:50.584850+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:25:50.584850+0000","last_undegraded":"2026-02-24T08:25:50.584850+0000","last_fullsized":"2026-02-24T08:25:50.584850+0000","mapping_epoch":51,"log_start":"54'12600","ondisk_log_start":"54'12600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21216","last_scrub_stamp":"2026-02-24T08:25:43.017253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:43.017253+0000","objects_scrubbed":2648,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:55.211256+0000","scrub_duration":569,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185401344,"num_objects":2829,"num_object_clones":0,"num_object_copies":8487,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22632,"num_write_kb":181056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'23096","reported_seq":23126,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.356810+0000","last_change":"2026-02-24T08:24:24.852337+0000","last_active":"2026-02-24T08:25:50.356810+0000","last_peered":"2026-02-24T08:25:50.356810+0000","last_clean":"2026-02-24T08:25:50.356810+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:25:50.356810+0000","last_undegraded":"2026-02-24T08:25:50.356810+0000","last_fullsized":"2026-02-24T08:25:50.356810+0000","mapping_epoch":51,"log_start":"54'13000","ondisk_log_start":"54'13000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189202432,"num_objects":2887,"num_object_clones":0,"num_object_copies":8661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2887,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23096,"num_write_kb":184768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'22504","reported_seq":22568,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.242395+0000","last_change":"2026-02-24T08:25:44.671573+0000","last_active":"2026-02-24T08:25:50.242395+0000","last_peered":"2026-02-24T08:25:50.242395+0000","last_clean":"2026-02-24T08:25:50.242395+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:25:50.242395+0000","last_undegraded":"2026-02-24T08:25:50.242395+0000","last_fullsized":"2026-02-24T08:25:50.242395+0000","mapping_epoch":51,"log_start":"54'12500","ondisk_log_start":"54'12500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21288","last_scrub_stamp":"2026-02-24T08:25:44.671491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:44.671491+0000","objects_scrubbed":2644,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:46.197472+0000","scrub_duration":954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184352768,"num_objects":2813,"num_object_clones":0,"num_object_copies":8439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22504,"num_write_kb":180032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'21992","reported_seq":22022,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:50.347278+0000","last_change":"2026-02-24T08:24:24.851993+0000","last_active":"2026-02-24T08:25:50.347278+0000","last_peered":"2026-02-24T08:25:50.347278+0000","last_clean":"2026-02-24T08:25:50.347278+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:25:50.347278+0000","last_undegraded":"2026-02-24T08:25:50.347278+0000","last_fullsized":"2026-02-24T08:25:50.347278+0000","mapping_epoch":51,"log_start":"54'11900","ondisk_log_start":"54'11900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:24:23.838492+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180158464,"num_objects":2749,"num_object_clones":0,"num_object_copies":8247,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21992,"num_write_kb":175936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":149,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:21.797246+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:25:21.797246+0000","last_peered":"2026-02-24T08:25:21.797246+0000","last_clean":"2026-02-24T08:25:21.797246+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:21.797246+0000","last_undegraded":"2026-02-24T08:25:21.797246+0000","last_fullsized":"2026-02-24T08:25:21.797246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":2969378816,"num_objects":45310,"num_object_clones":0,"num_object_copies":135930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362473,"num_write_kb":2899784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8908840960,"data_stored":8908840960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160873,"ondisk_log_size":160873,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9104,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247876,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3817356,"kb_used_data":2162168,"kb_used_omap":22,"kb_used_meta":1655145,"kb_avail":730185844,"statfs":{"total":751619276800,"available":747710304256,"internally_reserved":0,"allocated":2214060032,"data_stored":2213639055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22676,"internal_metadata":1694869356},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,8,8,8,12,8,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4271020,"kb_used_data":2522648,"kb_used_omap":34,"kb_used_meta":1748317,"kb_avail":729732180,"statfs":{"total":751619276800,"available":747245752320,"internally_reserved":0,"allocated":2583191552,"data_stored":2582770575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35477,"internal_metadata":1790276971},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3320360,"kb_used_data":1809684,"kb_used_omap":36,"kb_used_meta":1510619,"kb_avail":730682840,"statfs":{"total":751619276800,"available":748219228160,"internally_reserved":0,"allocated":1853116416,"data_stored":1852698991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":1546874314},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,5,3,16,7,13,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3766196,"kb_used_data":2163232,"kb_used_omap":39,"kb_used_meta":1602904,"kb_avail":730237004,"statfs":{"total":751619276800,"available":747762692096,"internally_reserved":0,"allocated":2215149568,"data_stored":2214728591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40034,"internal_metadata":1641374622},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,7,7,3,4,3,8,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9104,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2224488448,"data_stored":2224488448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1859469312,"data_stored":1859469312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2599559168,"data_stored":2599559168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2225324032,"data_stored":2225324032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:25:55.601 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:25:55.601 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_2 pg_num 66 2026-02-24T08:25:55.745 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:55.768 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:25:55.872 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:55.869+0000 7f52553a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:55.872 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:55.870+0000 7f52553a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:55.921 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:55.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 90 84 380951 380867 33.0587 25.7578 0.0701383 0.0302394 2026-02-24T08:25:56.012 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:25:56.036 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:56.033+0000 7fb8ff18a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:56.036 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:56.033+0000 7fb8ff18a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:56.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:25:56.048 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:56.049 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:56.059 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:56.060 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:56.070 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:56.070 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:56.080 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:56.080 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:56.115 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:56 trial105 ceph-mon[39442]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:25:56.116 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/270227687' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_2", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T08:25:56.116 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2267463442' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total time run: 90.0486 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total writes made: 380951 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Write size: 8192 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object size: 65536 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Bandwidth (MB/sec): 33.0508 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Bandwidth: 13.8425 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max bandwidth (MB/sec): 88.1875 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min bandwidth (MB/sec): 21.2031 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average IOPS: 4230 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev IOPS: 1771.84 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max IOPS: 11288 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min IOPS: 2714 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average Latency(s): 0.0302441 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Latency(s): 0.0232763 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max latency(s): 0.227592 2026-02-24T08:25:56.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min latency(s): 0.00104395 2026-02-24T08:25:56.955 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:25:57.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:57 trial105 ceph-mon[39442]: 4.5 scrub ok 2026-02-24T08:25:57.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:57 trial105 ceph-mon[39442]: 4.d scrub ok 2026-02-24T08:25:57.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:57 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:25:57.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:57 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:25:57.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:57 trial105 ceph-mon[39442]: pgmap v202: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.9 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.22k op/s 2026-02-24T08:25:58.118 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:25:58.267 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:25:58.413 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:58.410+0000 7f53f4947640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:58.413 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:25:58.410+0000 7f53f4947640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:25:58.431 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:25:58.431 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:25:58.448 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:25:58.448 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:25:58.462 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:25:58.463 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:25:58.479 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:25:58.480 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:25:58.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3928211005' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:25:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:25:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:25:59.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:25:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:59 trial105 ceph-mon[39442]: pgmap v203: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.9 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.82k op/s 2026-02-24T08:25:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:25:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:25:59.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:25:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:25:59] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-24T08:26:00.528 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:00.677 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:00.814 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:00.811+0000 7f1352f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:00.815 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:00.812+0000 7f1352f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:00.836 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:00.836 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:00.851 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:00.851 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:00.868 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:00.868 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:00.883 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:00.883 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:01.048 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:01.048 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:01.048 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:26:01.049 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:26:01.198 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:01.327 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:01.324+0000 7fb7e2f01640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:01.327 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:01.324+0000 7fb7e2f01640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:01.350 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:26:01.350 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:26:01.351 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:26:01.351 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:26:01.351 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:26:01.351 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:26:01.351 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:26:01.351 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:26:01.351 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:26:01.351 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:26:01.351 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:26:01.352 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:26:01.390 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:26:01.391 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:26:01.391 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:26:01.540 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:01.691 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:01.689+0000 7fe915059640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:01.691 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:01.689+0000 7fe915059640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:26:01.713 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:26:01.749 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:26:01.750 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:26:01.750 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:26:01.899 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:01.926 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:01 trial105 ceph-mon[39442]: pgmap v204: 17 pgs: 17 active+clean; 2.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 23 MiB/s wr, 3.99k op/s 2026-02-24T08:26:01.926 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/626229293' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:02.020 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:02.016+0000 7fcdebe45640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:02.020 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:02.016+0000 7fcdebe45640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:02.043 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:26:02.043 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:26:02.044 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:26:02.044 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:26:02.044 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:26:02.044 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:26:02.044 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:26:02.044 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:26:02.044 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:26:02.045 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:26:02.045 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:26:02.045 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:26:02.088 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:26:02.088 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:26:02.089 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:26:02.238 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:02.378 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:02.375+0000 7f4d28456640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:02.378 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:02.376+0000 7f4d28456640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:02.407 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:26:02.407 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:26:02.407 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:26:02.408 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:26:02.408 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:26:02.408 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:26:02.408 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:26:02.408 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:26:02.408 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:26:02.408 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:26:02.408 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:26:02.408 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:26:02.445 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:26:02.446 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:26:02.928 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:03.067 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:03.413 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:03.411+0000 7fe66fe9f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:03.414 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:03.411+0000 7fe66fe9f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:03.429 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:03.430 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:03.443 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:03.443 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:03.458 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:03.458 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:03.472 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:03.472 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:04.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:03 trial105 ceph-mon[39442]: pgmap v205: 17 pgs: 17 active+clean; 2.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 12 MiB/s wr, 2.57k op/s 2026-02-24T08:26:04.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2210230105' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:05.516 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:05.665 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:05.792 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:05.788+0000 7fbcd5ac0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:05.792 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:05.788+0000 7fbcd5ac0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:05.792 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:05 trial105 ceph-mon[39442]: pgmap v206: 17 pgs: 17 active+clean; 2.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 12 MiB/s wr, 2.57k op/s 2026-02-24T08:26:05.814 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:05.815 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:05.833 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:05.834 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:05.856 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:05.856 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:05.875 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:05.876 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:07.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:06 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2147527079' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:07.447 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:07.448 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:07.448 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:26:07.448 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:26:07.599 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:07.733 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:07.729+0000 7f96cbc7a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:07.733 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:07.730+0000 7f96cbc7a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:07.890 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:26:07.891 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:26:07.921 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:07.942 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2026-02-24T08:26:06.734450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1201332792,"num_objects":18325,"num_object_clones":0,"num_object_copies":54975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18325,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":410384,"num_write_kb":3049759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161048,"ondisk_log_size":161048,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9705152,"kb_used_data":3909488,"kb_used_omap":102,"kb_used_meta":5795289,"kb_avail":2926307648,"statfs":{"total":3006477107200,"available":2996539031552,"internally_reserved":0,"allocated":4003315712,"data_stored":4001623140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":105241,"internal_metadata":5934376167},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,0,6,7,14,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1768636392,"num_objects":-26987,"num_object_clones":0,"num_object_copies":-80961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26987,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":47776,"num_write_kb":147825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001816"},"pg_stats":[{"pgid":"4.f","version":"61'25662","reported_seq":25727,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.688641+0000","last_change":"2026-02-24T08:25:49.995329+0000","last_active":"2026-02-24T08:26:05.688641+0000","last_peered":"2026-02-24T08:26:05.688641+0000","last_clean":"2026-02-24T08:26:05.688641+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:26:05.688641+0000","last_undegraded":"2026-02-24T08:26:05.688641+0000","last_fullsized":"2026-02-24T08:26:05.688641+0000","mapping_epoch":51,"log_start":"60'15600","ondisk_log_start":"60'15600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'22416","last_scrub_stamp":"2026-02-24T08:25:49.995265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:49.995265+0000","objects_scrubbed":2777,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.116260+0000","scrub_duration":1749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73531392,"num_objects":1122,"num_object_clones":0,"num_object_copies":3366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25662,"num_write_kb":190464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'25579","reported_seq":25642,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.454132+0000","last_change":"2026-02-24T08:25:50.425967+0000","last_active":"2026-02-24T08:26:05.454132+0000","last_peered":"2026-02-24T08:26:05.454132+0000","last_clean":"2026-02-24T08:26:05.454132+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:26:05.454132+0000","last_undegraded":"2026-02-24T08:26:05.454132+0000","last_fullsized":"2026-02-24T08:26:05.454132+0000","mapping_epoch":51,"log_start":"60'15500","ondisk_log_start":"60'15500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'22488","last_scrub_stamp":"2026-02-24T08:25:50.425932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:50.425932+0000","objects_scrubbed":2803,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:58.038253+0000","scrub_duration":752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78381056,"num_objects":1196,"num_object_clones":0,"num_object_copies":3588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25579,"num_write_kb":190400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'25900","reported_seq":25970,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.499280+0000","last_change":"2026-02-24T08:25:56.087288+0000","last_active":"2026-02-24T08:26:05.499280+0000","last_peered":"2026-02-24T08:26:05.499280+0000","last_clean":"2026-02-24T08:26:05.499280+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:26:05.499280+0000","last_undegraded":"2026-02-24T08:26:05.499280+0000","last_fullsized":"2026-02-24T08:26:05.499280+0000","mapping_epoch":51,"log_start":"60'15800","ondisk_log_start":"60'15800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'24112","last_scrub_stamp":"2026-02-24T08:25:56.087226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:56.087226+0000","objects_scrubbed":3005,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:01.681810+0000","scrub_duration":2304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80412696,"num_objects":1228,"num_object_clones":0,"num_object_copies":3684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1228,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25900,"num_write_kb":192897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'26170","reported_seq":26235,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.500648+0000","last_change":"2026-02-24T08:25:49.798343+0000","last_active":"2026-02-24T08:26:05.500648+0000","last_peered":"2026-02-24T08:26:05.500648+0000","last_clean":"2026-02-24T08:26:05.500648+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:26:05.500648+0000","last_undegraded":"2026-02-24T08:26:05.500648+0000","last_fullsized":"2026-02-24T08:26:05.500648+0000","mapping_epoch":51,"log_start":"60'16100","ondisk_log_start":"60'16100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'23000","last_scrub_stamp":"2026-02-24T08:25:49.798270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:49.798270+0000","objects_scrubbed":2869,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:18.225302+0000","scrub_duration":1006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75038720,"num_objects":1145,"num_object_clones":0,"num_object_copies":3435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26170,"num_write_kb":194240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'25295","reported_seq":25356,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.284096+0000","last_change":"2026-02-24T08:25:32.677569+0000","last_active":"2026-02-24T08:26:05.284096+0000","last_peered":"2026-02-24T08:26:05.284096+0000","last_clean":"2026-02-24T08:26:05.284096+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:26:05.284096+0000","last_undegraded":"2026-02-24T08:26:05.284096+0000","last_fullsized":"2026-02-24T08:26:05.284096+0000","mapping_epoch":51,"log_start":"60'15200","ondisk_log_start":"60'15200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'18712","last_scrub_stamp":"2026-02-24T08:25:32.677533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.677533+0000","objects_scrubbed":2301,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:58.590112+0000","scrub_duration":1845,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75169792,"num_objects":1147,"num_object_clones":0,"num_object_copies":3441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25295,"num_write_kb":188032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'25400","reported_seq":25464,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.457968+0000","last_change":"2026-02-24T08:25:47.089979+0000","last_active":"2026-02-24T08:26:05.457968+0000","last_peered":"2026-02-24T08:26:05.457968+0000","last_clean":"2026-02-24T08:26:05.457968+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:26:05.457968+0000","last_undegraded":"2026-02-24T08:26:05.457968+0000","last_fullsized":"2026-02-24T08:26:05.457968+0000","mapping_epoch":51,"log_start":"60'15300","ondisk_log_start":"60'15300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21752","last_scrub_stamp":"2026-02-24T08:25:47.089946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:47.089946+0000","objects_scrubbed":2714,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:53.244420+0000","scrub_duration":451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73007104,"num_objects":1114,"num_object_clones":0,"num_object_copies":3342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25400,"num_write_kb":188544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'25724","reported_seq":25786,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.446477+0000","last_change":"2026-02-24T08:25:35.902752+0000","last_active":"2026-02-24T08:26:05.446477+0000","last_peered":"2026-02-24T08:26:05.446477+0000","last_clean":"2026-02-24T08:26:05.446477+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:26:05.446477+0000","last_undegraded":"2026-02-24T08:26:05.446477+0000","last_fullsized":"2026-02-24T08:26:05.446477+0000","mapping_epoch":51,"log_start":"60'15700","ondisk_log_start":"60'15700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'20048","last_scrub_stamp":"2026-02-24T08:25:35.902638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:35.902638+0000","objects_scrubbed":2495,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:49.000779+0000","scrub_duration":1037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75366400,"num_objects":1150,"num_object_clones":0,"num_object_copies":3450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25724,"num_write_kb":191104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'25304","reported_seq":25365,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.505734+0000","last_change":"2026-02-24T08:25:44.625620+0000","last_active":"2026-02-24T08:26:05.505734+0000","last_peered":"2026-02-24T08:26:05.505734+0000","last_clean":"2026-02-24T08:26:05.505734+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:26:05.505734+0000","last_undegraded":"2026-02-24T08:26:05.505734+0000","last_fullsized":"2026-02-24T08:26:05.505734+0000","mapping_epoch":51,"log_start":"60'15300","ondisk_log_start":"60'15300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21024","last_scrub_stamp":"2026-02-24T08:25:44.625584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:44.625584+0000","objects_scrubbed":2617,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:14.077261+0000","scrub_duration":883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73400320,"num_objects":1120,"num_object_clones":0,"num_object_copies":3360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25304,"num_write_kb":187904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'25545","reported_seq":25607,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.688663+0000","last_change":"2026-02-24T08:25:32.900165+0000","last_active":"2026-02-24T08:26:05.688663+0000","last_peered":"2026-02-24T08:26:05.688663+0000","last_clean":"2026-02-24T08:26:05.688663+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:26:05.688663+0000","last_undegraded":"2026-02-24T08:26:05.688663+0000","last_fullsized":"2026-02-24T08:26:05.688663+0000","mapping_epoch":51,"log_start":"60'15500","ondisk_log_start":"60'15500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'19040","last_scrub_stamp":"2026-02-24T08:25:32.900096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.900096+0000","objects_scrubbed":2378,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.680505+0000","scrub_duration":526,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70508544,"num_objects":1076,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25545,"num_write_kb":189304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'25910","reported_seq":25975,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.312236+0000","last_change":"2026-02-24T08:25:41.906665+0000","last_active":"2026-02-24T08:26:05.312236+0000","last_peered":"2026-02-24T08:26:05.312236+0000","last_clean":"2026-02-24T08:26:05.312236+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:26:05.312236+0000","last_undegraded":"2026-02-24T08:26:05.312236+0000","last_fullsized":"2026-02-24T08:26:05.312236+0000","mapping_epoch":51,"log_start":"60'15900","ondisk_log_start":"60'15900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21160","last_scrub_stamp":"2026-02-24T08:25:41.906618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:41.906618+0000","objects_scrubbed":2631,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.653616+0000","scrub_duration":1269,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":1216,"num_object_clones":0,"num_object_copies":3648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25910,"num_write_kb":192896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'25489","reported_seq":25550,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.660040+0000","last_change":"2026-02-24T08:25:25.859210+0000","last_active":"2026-02-24T08:26:05.660040+0000","last_peered":"2026-02-24T08:26:05.660040+0000","last_clean":"2026-02-24T08:26:05.660040+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:26:05.660040+0000","last_undegraded":"2026-02-24T08:26:05.660040+0000","last_fullsized":"2026-02-24T08:26:05.660040+0000","mapping_epoch":51,"log_start":"60'15400","ondisk_log_start":"60'15400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'17368","last_scrub_stamp":"2026-02-24T08:25:25.859164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:25.859164+0000","objects_scrubbed":2169,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.950124+0000","scrub_duration":553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70123520,"num_objects":1070,"num_object_clones":0,"num_object_copies":3210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25489,"num_write_kb":188864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'26210","reported_seq":26276,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.306629+0000","last_change":"2026-02-24T08:25:45.841494+0000","last_active":"2026-02-24T08:26:05.306629+0000","last_peered":"2026-02-24T08:26:05.306629+0000","last_clean":"2026-02-24T08:26:05.306629+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:26:05.306629+0000","last_undegraded":"2026-02-24T08:26:05.306629+0000","last_fullsized":"2026-02-24T08:26:05.306629+0000","mapping_epoch":51,"log_start":"60'16200","ondisk_log_start":"60'16200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'22248","last_scrub_stamp":"2026-02-24T08:25:45.841412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:45.841412+0000","objects_scrubbed":2769,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:00.463377+0000","scrub_duration":840,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77135872,"num_objects":1177,"num_object_clones":0,"num_object_copies":3531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1177,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26210,"num_write_kb":194752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'25525","reported_seq":25587,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.663813+0000","last_change":"2026-02-24T08:25:43.017326+0000","last_active":"2026-02-24T08:26:05.663813+0000","last_peered":"2026-02-24T08:26:05.663813+0000","last_clean":"2026-02-24T08:26:05.663813+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:26:05.663813+0000","last_undegraded":"2026-02-24T08:26:05.663813+0000","last_fullsized":"2026-02-24T08:26:05.663813+0000","mapping_epoch":51,"log_start":"60'15500","ondisk_log_start":"60'15500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21216","last_scrub_stamp":"2026-02-24T08:25:43.017253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:43.017253+0000","objects_scrubbed":2648,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:55.211256+0000","scrub_duration":569,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70713344,"num_objects":1079,"num_object_clones":0,"num_object_copies":3237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1079,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25525,"num_write_kb":189184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'26079","reported_seq":26146,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.446511+0000","last_change":"2026-02-24T08:25:53.098354+0000","last_active":"2026-02-24T08:26:05.446511+0000","last_peered":"2026-02-24T08:26:05.446511+0000","last_clean":"2026-02-24T08:26:05.446511+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:26:05.446511+0000","last_undegraded":"2026-02-24T08:26:05.446511+0000","last_fullsized":"2026-02-24T08:26:05.446511+0000","mapping_epoch":51,"log_start":"60'16000","ondisk_log_start":"60'16000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'23712","last_scrub_stamp":"2026-02-24T08:25:53.098308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:53.098308+0000","objects_scrubbed":2923,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:22.219914+0000","scrub_duration":2356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76873728,"num_objects":1173,"num_object_clones":0,"num_object_copies":3519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26079,"num_write_kb":193792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'25570","reported_seq":25631,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.291050+0000","last_change":"2026-02-24T08:25:44.671573+0000","last_active":"2026-02-24T08:26:05.291050+0000","last_peered":"2026-02-24T08:26:05.291050+0000","last_clean":"2026-02-24T08:26:05.291050+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:26:05.291050+0000","last_undegraded":"2026-02-24T08:26:05.291050+0000","last_fullsized":"2026-02-24T08:26:05.291050+0000","mapping_epoch":51,"log_start":"60'15500","ondisk_log_start":"60'15500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21288","last_scrub_stamp":"2026-02-24T08:25:44.671491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:44.671491+0000","objects_scrubbed":2644,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:46.197472+0000","scrub_duration":954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76021760,"num_objects":1160,"num_object_clones":0,"num_object_copies":3480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25570,"num_write_kb":190080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'24887","reported_seq":24951,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:05.499240+0000","last_change":"2026-02-24T08:25:55.973761+0000","last_active":"2026-02-24T08:26:05.499240+0000","last_peered":"2026-02-24T08:26:05.499240+0000","last_clean":"2026-02-24T08:26:05.499240+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:26:05.499240+0000","last_undegraded":"2026-02-24T08:26:05.499240+0000","last_fullsized":"2026-02-24T08:26:05.499240+0000","mapping_epoch":51,"log_start":"60'14800","ondisk_log_start":"60'14800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'23144","last_scrub_stamp":"2026-02-24T08:25:55.973709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:55.973709+0000","objects_scrubbed":2827,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:56.816691+0000","scrub_duration":2994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75366400,"num_objects":1150,"num_object_clones":0,"num_object_copies":3450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24887,"num_write_kb":185152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":149,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:21.797246+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:25:21.797246+0000","last_peered":"2026-02-24T08:25:21.797246+0000","last_clean":"2026-02-24T08:25:21.797246+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:21.797246+0000","last_undegraded":"2026-02-24T08:25:21.797246+0000","last_fullsized":"2026-02-24T08:25:21.797246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1200742424,"num_objects":18323,"num_object_clones":0,"num_object_copies":54969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18323,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":410249,"num_write_kb":3047609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3604467712,"data_stored":3604455496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160949,"ondisk_log_size":160949,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9104,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247879,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2699544,"kb_used_data":990084,"kb_used_omap":22,"kb_used_meta":1709289,"kb_avail":731303656,"statfs":{"total":751619276800,"available":748854943744,"internally_reserved":0,"allocated":1013846016,"data_stored":1013420967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22676,"internal_metadata":1750312812},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2041168,"kb_used_data":1176892,"kb_used_omap":4,"kb_used_meta":864187,"kb_avail":731962032,"statfs":{"total":751619276800,"available":749529120768,"internally_reserved":0,"allocated":1205137408,"data_stored":1204712359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4450,"internal_metadata":884928158},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,0,6,7,14,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2332040,"kb_used_data":767220,"kb_used_omap":36,"kb_used_meta":1564763,"kb_avail":731671160,"statfs":{"total":751619276800,"available":749231267840,"internally_reserved":0,"allocated":785633280,"data_stored":785215855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":1602317770},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705741,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2632400,"kb_used_data":975292,"kb_used_omap":39,"kb_used_meta":1657048,"kb_avail":731370800,"statfs":{"total":751619276800,"available":748923699200,"internally_reserved":0,"allocated":998699008,"data_stored":998273959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40685,"internal_metadata":1696817427},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9104,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":925102080,"data_stored":925098008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":719970304,"data_stored":719970304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1060237312,"data_stored":1060233240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":899158016,"data_stored":899153944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:26:07.944 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:26:07.945 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 131 2026-02-24T08:26:08.013 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:07 trial105 ceph-mon[39442]: pgmap v207: 17 pgs: 17 active+clean; 1.1 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 12 MiB/s wr, 3.98k op/s 2026-02-24T08:26:08.079 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:08.142 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:08.220 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:08.216+0000 7f73886c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:08.220 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:08.217+0000 7f73886c4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:08.239 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:08.239 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:08.264 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:08.265 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:08.281 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:08.278+0000 7fafc8446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:08.281 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:08.278+0000 7fafc8446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:08.284 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:08.284 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:08.299 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:08.300 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:08.438 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:26:08.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:26:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:08 trial105 ceph-mon[39442]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:26:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1403972326' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3351987' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "131"} : dispatch 2026-02-24T08:26:09.842 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:26:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:26:09.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:26:09.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:09 trial105 ceph-mon[39442]: pgmap v208: 17 pgs: 17 active+clean; 1.1 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 1.0 MiB/s wr, 2.57k op/s 2026-02-24T08:26:09.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:26:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:26:09] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-24T08:26:10.356 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:10.513 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:10.642 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:10.638+0000 7fa006ccd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:10.642 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:10.638+0000 7fa006ccd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:10.659 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:10.660 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:10.676 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:10.676 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:10.698 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:10.698 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:10.714 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:10.714 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:10.807 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Removed 47619 objects 2026-02-24T08:26:10.807 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Clean up completed and total clean up time :13.8519 2026-02-24T08:26:10.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1585221921' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:11 trial105 ceph-mon[39442]: pgmap v209: 17 pgs: 17 active+clean; 58 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 1.0 MiB/s wr, 4.02k op/s 2026-02-24T08:26:12.767 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:12.883 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:12.982 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:12.978+0000 7f16e6c3b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:12.982 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:12.978+0000 7f16e6c3b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:12.994 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:12.994 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:13.005 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:13.005 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:13.016 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:13.016 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:13.027 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:13.027 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:13.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:13 trial105 ceph-mon[39442]: pgmap v210: 17 pgs: 17 active+clean; 58 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.85k op/s 2026-02-24T08:26:13.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2971225941' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:13.484 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:13.484 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:13.485 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:26:13.485 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:26:13.602 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:13.882 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:13.809+0000 7f911c350640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:13.882 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:13.809+0000 7f911c350640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:13.922 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:26:13.923 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:26:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:26:14.603 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2026-02-24T08:26:12.735325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":61071928,"num_objects":926,"num_object_clones":0,"num_object_copies":2778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":926,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":427783,"num_write_kb":3049759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161047,"ondisk_log_size":161047,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6477120,"kb_used_data":627312,"kb_used_omap":102,"kb_used_meta":5849433,"kb_avail":2929535680,"statfs":{"total":3006477107200,"available":2999844536320,"internally_reserved":0,"allocated":642367488,"data_stored":640674916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":105241,"internal_metadata":5989819623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,15,16,39,58,45,25,20,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2246180864,"num_objects":-34274,"num_object_clones":0,"num_object_copies":-102822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-34274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001730"},"pg_stats":[{"pgid":"4.f","version":"61'26770","reported_seq":26828,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.690032+0000","last_change":"2026-02-24T08:25:49.995329+0000","last_active":"2026-02-24T08:26:10.690032+0000","last_peered":"2026-02-24T08:26:10.690032+0000","last_clean":"2026-02-24T08:26:10.690032+0000","last_became_active":"2026-02-24T08:24:24.850106+0000","last_became_peered":"2026-02-24T08:24:24.850106+0000","last_unstale":"2026-02-24T08:26:10.690032+0000","last_undegraded":"2026-02-24T08:26:10.690032+0000","last_fullsized":"2026-02-24T08:26:10.690032+0000","mapping_epoch":51,"log_start":"61'16700","ondisk_log_start":"61'16700","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'22416","last_scrub_stamp":"2026-02-24T08:25:49.995265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:49.995265+0000","objects_scrubbed":2777,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.116260+0000","scrub_duration":1749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26770,"num_write_kb":190464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'26697","reported_seq":26764,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.474892+0000","last_change":"2026-02-24T08:25:50.425967+0000","last_active":"2026-02-24T08:26:10.474892+0000","last_peered":"2026-02-24T08:26:10.474892+0000","last_clean":"2026-02-24T08:26:10.474892+0000","last_became_active":"2026-02-24T08:24:24.852082+0000","last_became_peered":"2026-02-24T08:24:24.852082+0000","last_unstale":"2026-02-24T08:26:10.474892+0000","last_undegraded":"2026-02-24T08:26:10.474892+0000","last_fullsized":"2026-02-24T08:26:10.474892+0000","mapping_epoch":51,"log_start":"61'16600","ondisk_log_start":"61'16600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'22488","last_scrub_stamp":"2026-02-24T08:25:50.425932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:50.425932+0000","objects_scrubbed":2803,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:58.038253+0000","scrub_duration":752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26697,"num_write_kb":190400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"61'27062","reported_seq":27130,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.530562+0000","last_change":"2026-02-24T08:25:56.087288+0000","last_active":"2026-02-24T08:26:10.530562+0000","last_peered":"2026-02-24T08:26:10.530562+0000","last_clean":"2026-02-24T08:26:10.530562+0000","last_became_active":"2026-02-24T08:24:24.851162+0000","last_became_peered":"2026-02-24T08:24:24.851162+0000","last_unstale":"2026-02-24T08:26:10.530562+0000","last_undegraded":"2026-02-24T08:26:10.530562+0000","last_fullsized":"2026-02-24T08:26:10.530562+0000","mapping_epoch":51,"log_start":"61'17000","ondisk_log_start":"61'17000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'24112","last_scrub_stamp":"2026-02-24T08:25:56.087226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:56.087226+0000","objects_scrubbed":3005,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:01.681810+0000","scrub_duration":2304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259864,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27062,"num_write_kb":192897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"61'27247","reported_seq":27310,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.529423+0000","last_change":"2026-02-24T08:25:49.798343+0000","last_active":"2026-02-24T08:26:10.529423+0000","last_peered":"2026-02-24T08:26:10.529423+0000","last_clean":"2026-02-24T08:26:10.529423+0000","last_became_active":"2026-02-24T08:24:24.851070+0000","last_became_peered":"2026-02-24T08:24:24.851070+0000","last_unstale":"2026-02-24T08:26:10.529423+0000","last_undegraded":"2026-02-24T08:26:10.529423+0000","last_fullsized":"2026-02-24T08:26:10.529423+0000","mapping_epoch":51,"log_start":"61'17200","ondisk_log_start":"61'17200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'23000","last_scrub_stamp":"2026-02-24T08:25:49.798270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:49.798270+0000","objects_scrubbed":2869,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:18.225302+0000","scrub_duration":1006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27247,"num_write_kb":194240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"61'26361","reported_seq":26422,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.335942+0000","last_change":"2026-02-24T08:25:32.677569+0000","last_active":"2026-02-24T08:26:10.335942+0000","last_peered":"2026-02-24T08:26:10.335942+0000","last_clean":"2026-02-24T08:26:10.335942+0000","last_became_active":"2026-02-24T08:24:24.850170+0000","last_became_peered":"2026-02-24T08:24:24.850170+0000","last_unstale":"2026-02-24T08:26:10.335942+0000","last_undegraded":"2026-02-24T08:26:10.335942+0000","last_fullsized":"2026-02-24T08:26:10.335942+0000","mapping_epoch":51,"log_start":"60'16300","ondisk_log_start":"60'16300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'18712","last_scrub_stamp":"2026-02-24T08:25:32.677533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.677533+0000","objects_scrubbed":2301,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:58.590112+0000","scrub_duration":1845,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26361,"num_write_kb":188032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'26465","reported_seq":26526,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.481400+0000","last_change":"2026-02-24T08:25:47.089979+0000","last_active":"2026-02-24T08:26:10.481400+0000","last_peered":"2026-02-24T08:26:10.481400+0000","last_clean":"2026-02-24T08:26:10.481400+0000","last_became_active":"2026-02-24T08:24:24.852303+0000","last_became_peered":"2026-02-24T08:24:24.852303+0000","last_unstale":"2026-02-24T08:26:10.481400+0000","last_undegraded":"2026-02-24T08:26:10.481400+0000","last_fullsized":"2026-02-24T08:26:10.481400+0000","mapping_epoch":51,"log_start":"60'16400","ondisk_log_start":"60'16400","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21752","last_scrub_stamp":"2026-02-24T08:25:47.089946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:47.089946+0000","objects_scrubbed":2714,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:53.244420+0000","scrub_duration":451,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26465,"num_write_kb":188544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"61'26824","reported_seq":26880,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.475846+0000","last_change":"2026-02-24T08:25:35.902752+0000","last_active":"2026-02-24T08:26:10.475846+0000","last_peered":"2026-02-24T08:26:10.475846+0000","last_clean":"2026-02-24T08:26:10.475846+0000","last_became_active":"2026-02-24T08:24:24.850283+0000","last_became_peered":"2026-02-24T08:24:24.850283+0000","last_unstale":"2026-02-24T08:26:10.475846+0000","last_undegraded":"2026-02-24T08:26:10.475846+0000","last_fullsized":"2026-02-24T08:26:10.475846+0000","mapping_epoch":51,"log_start":"61'16800","ondisk_log_start":"61'16800","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'20048","last_scrub_stamp":"2026-02-24T08:25:35.902638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:35.902638+0000","objects_scrubbed":2495,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:49.000779+0000","scrub_duration":1037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26824,"num_write_kb":191104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"61'26374","reported_seq":26434,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.515060+0000","last_change":"2026-02-24T08:25:44.625620+0000","last_active":"2026-02-24T08:26:10.515060+0000","last_peered":"2026-02-24T08:26:10.515060+0000","last_clean":"2026-02-24T08:26:10.515060+0000","last_became_active":"2026-02-24T08:24:24.850779+0000","last_became_peered":"2026-02-24T08:24:24.850779+0000","last_unstale":"2026-02-24T08:26:10.515060+0000","last_undegraded":"2026-02-24T08:26:10.515060+0000","last_fullsized":"2026-02-24T08:26:10.515060+0000","mapping_epoch":51,"log_start":"60'16300","ondisk_log_start":"60'16300","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21024","last_scrub_stamp":"2026-02-24T08:25:44.625584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:44.625584+0000","objects_scrubbed":2617,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:14.077261+0000","scrub_duration":883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26374,"num_write_kb":187904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"61'26603","reported_seq":26664,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.684377+0000","last_change":"2026-02-24T08:25:32.900165+0000","last_active":"2026-02-24T08:26:10.684377+0000","last_peered":"2026-02-24T08:26:10.684377+0000","last_clean":"2026-02-24T08:26:10.684377+0000","last_became_active":"2026-02-24T08:24:24.850340+0000","last_became_peered":"2026-02-24T08:24:24.850340+0000","last_unstale":"2026-02-24T08:26:10.684377+0000","last_undegraded":"2026-02-24T08:26:10.684377+0000","last_fullsized":"2026-02-24T08:26:10.684377+0000","mapping_epoch":51,"log_start":"60'16600","ondisk_log_start":"60'16600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'19040","last_scrub_stamp":"2026-02-24T08:25:32.900096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:32.900096+0000","objects_scrubbed":2378,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.680505+0000","scrub_duration":526,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1171456,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26603,"num_write_kb":189304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"61'27037","reported_seq":27098,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.324963+0000","last_change":"2026-02-24T08:25:41.906665+0000","last_active":"2026-02-24T08:26:10.324963+0000","last_peered":"2026-02-24T08:26:10.324963+0000","last_clean":"2026-02-24T08:26:10.324963+0000","last_became_active":"2026-02-24T08:24:24.849500+0000","last_became_peered":"2026-02-24T08:24:24.849500+0000","last_unstale":"2026-02-24T08:26:10.324963+0000","last_undegraded":"2026-02-24T08:26:10.324963+0000","last_fullsized":"2026-02-24T08:26:10.324963+0000","mapping_epoch":51,"log_start":"61'17000","ondisk_log_start":"61'17000","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21160","last_scrub_stamp":"2026-02-24T08:25:41.906618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:41.906618+0000","objects_scrubbed":2631,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.653616+0000","scrub_duration":1269,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27037,"num_write_kb":192896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'26538","reported_seq":26596,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.693797+0000","last_change":"2026-02-24T08:25:25.859210+0000","last_active":"2026-02-24T08:26:10.693797+0000","last_peered":"2026-02-24T08:26:10.693797+0000","last_clean":"2026-02-24T08:26:10.693797+0000","last_became_active":"2026-02-24T08:24:24.849217+0000","last_became_peered":"2026-02-24T08:24:24.849217+0000","last_unstale":"2026-02-24T08:26:10.693797+0000","last_undegraded":"2026-02-24T08:26:10.693797+0000","last_fullsized":"2026-02-24T08:26:10.693797+0000","mapping_epoch":51,"log_start":"60'16500","ondisk_log_start":"60'16500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'17368","last_scrub_stamp":"2026-02-24T08:25:25.859164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:25.859164+0000","objects_scrubbed":2169,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:50.950124+0000","scrub_duration":553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26538,"num_write_kb":188864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'27288","reported_seq":27352,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.333812+0000","last_change":"2026-02-24T08:25:45.841494+0000","last_active":"2026-02-24T08:26:10.333812+0000","last_peered":"2026-02-24T08:26:10.333812+0000","last_clean":"2026-02-24T08:26:10.333812+0000","last_became_active":"2026-02-24T08:24:24.849955+0000","last_became_peered":"2026-02-24T08:24:24.849955+0000","last_unstale":"2026-02-24T08:26:10.333812+0000","last_undegraded":"2026-02-24T08:26:10.333812+0000","last_fullsized":"2026-02-24T08:26:10.333812+0000","mapping_epoch":51,"log_start":"61'17200","ondisk_log_start":"61'17200","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'22248","last_scrub_stamp":"2026-02-24T08:25:45.841412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:45.841412+0000","objects_scrubbed":2769,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:00.463377+0000","scrub_duration":840,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27288,"num_write_kb":194752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"61'26584","reported_seq":26648,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.688426+0000","last_change":"2026-02-24T08:25:43.017326+0000","last_active":"2026-02-24T08:26:10.688426+0000","last_peered":"2026-02-24T08:26:10.688426+0000","last_clean":"2026-02-24T08:26:10.688426+0000","last_became_active":"2026-02-24T08:24:24.849121+0000","last_became_peered":"2026-02-24T08:24:24.849121+0000","last_unstale":"2026-02-24T08:26:10.688426+0000","last_undegraded":"2026-02-24T08:26:10.688426+0000","last_fullsized":"2026-02-24T08:26:10.688426+0000","mapping_epoch":51,"log_start":"60'16500","ondisk_log_start":"60'16500","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21216","last_scrub_stamp":"2026-02-24T08:25:43.017253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:43.017253+0000","objects_scrubbed":2648,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:55.211256+0000","scrub_duration":569,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26584,"num_write_kb":189184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"61'27197","reported_seq":27260,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.475835+0000","last_change":"2026-02-24T08:25:53.098354+0000","last_active":"2026-02-24T08:26:10.475835+0000","last_peered":"2026-02-24T08:26:10.475835+0000","last_clean":"2026-02-24T08:26:10.475835+0000","last_became_active":"2026-02-24T08:24:24.852039+0000","last_became_peered":"2026-02-24T08:24:24.852039+0000","last_unstale":"2026-02-24T08:26:10.475835+0000","last_undegraded":"2026-02-24T08:26:10.475835+0000","last_fullsized":"2026-02-24T08:26:10.475835+0000","mapping_epoch":51,"log_start":"61'17100","ondisk_log_start":"61'17100","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'23712","last_scrub_stamp":"2026-02-24T08:25:53.098308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:53.098308+0000","objects_scrubbed":2923,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:22.219914+0000","scrub_duration":2356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27197,"num_write_kb":193792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"61'26636","reported_seq":26697,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.337129+0000","last_change":"2026-02-24T08:25:44.671573+0000","last_active":"2026-02-24T08:26:10.337129+0000","last_peered":"2026-02-24T08:26:10.337129+0000","last_clean":"2026-02-24T08:26:10.337129+0000","last_became_active":"2026-02-24T08:24:24.850095+0000","last_became_peered":"2026-02-24T08:24:24.850095+0000","last_unstale":"2026-02-24T08:26:10.337129+0000","last_undegraded":"2026-02-24T08:26:10.337129+0000","last_fullsized":"2026-02-24T08:26:10.337129+0000","mapping_epoch":51,"log_start":"61'16600","ondisk_log_start":"61'16600","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'21288","last_scrub_stamp":"2026-02-24T08:25:44.671491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:44.671491+0000","objects_scrubbed":2644,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:46.197472+0000","scrub_duration":954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26636,"num_write_kb":190080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"61'25965","reported_seq":26030,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:26:10.523179+0000","last_change":"2026-02-24T08:25:55.973761+0000","last_active":"2026-02-24T08:26:10.523179+0000","last_peered":"2026-02-24T08:26:10.523179+0000","last_clean":"2026-02-24T08:26:10.523179+0000","last_became_active":"2026-02-24T08:24:24.851214+0000","last_became_peered":"2026-02-24T08:24:24.851214+0000","last_unstale":"2026-02-24T08:26:10.523179+0000","last_undegraded":"2026-02-24T08:26:10.523179+0000","last_fullsized":"2026-02-24T08:26:10.523179+0000","mapping_epoch":51,"log_start":"60'15900","ondisk_log_start":"60'15900","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'23144","last_scrub_stamp":"2026-02-24T08:25:55.973709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:24:23.838492+0000","last_clean_scrub_stamp":"2026-02-24T08:25:55.973709+0000","objects_scrubbed":2827,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:56.816691+0000","scrub_duration":2994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25965,"num_write_kb":185152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":149,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:21.797246+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:25:21.797246+0000","last_peered":"2026-02-24T08:25:21.797246+0000","last_clean":"2026-02-24T08:25:21.797246+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:21.797246+0000","last_undegraded":"2026-02-24T08:25:21.797246+0000","last_fullsized":"2026-02-24T08:25:21.797246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":60481560,"num_objects":924,"num_object_clones":0,"num_object_copies":2772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":924,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":427648,"num_write_kb":3047609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188469248,"data_stored":188457032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160948,"ondisk_log_size":160948,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9104,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1907480,"kb_used_data":180036,"kb_used_omap":22,"kb_used_meta":1727337,"kb_avail":732095720,"statfs":{"total":751619276800,"available":749666017280,"internally_reserved":0,"allocated":184356864,"data_stored":183931815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22676,"internal_metadata":1768793964},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,5,16,21,5,13,20,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1087824,"kb_used_data":205564,"kb_used_omap":4,"kb_used_meta":882235,"kb_avail":732915376,"statfs":{"total":751619276800,"available":750505345024,"internally_reserved":0,"allocated":210497536,"data_stored":210072487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4450,"internal_metadata":903409310},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,7,3,13,11,25,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1647240,"kb_used_data":82292,"kb_used_omap":36,"kb_used_meta":1564763,"kb_avail":732355960,"statfs":{"total":751619276800,"available":749932503040,"internally_reserved":0,"allocated":84267008,"data_stored":83849583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":1602317770},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,4,7,8,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1834576,"kb_used_data":159420,"kb_used_omap":39,"kb_used_meta":1675096,"kb_avail":732168624,"statfs":{"total":751619276800,"available":749740670976,"internally_reserved":0,"allocated":163246080,"data_stored":162821031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40685,"internal_metadata":1715298579},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,4,3,18,12,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9104,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73592832,"data_stored":73588760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11132928,"data_stored":11132928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58388480,"data_stored":58384408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45355008,"data_stored":45350936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:26:14.605 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 131 2026-02-24T08:26:14.723 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:14.830 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:14.827+0000 7fa782354640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:14.830 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:14.827+0000 7fa782354640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:14.937 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:26:14.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:26:15.061 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:15.177 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:15 trial105 ceph-mon[39442]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:26:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:15 trial105 ceph-mon[39442]: pgmap v211: 17 pgs: 17 active+clean; 58 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.85k op/s 2026-02-24T08:26:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:15 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3263735750' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "131"} : dispatch 2026-02-24T08:26:15.276 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:15.272+0000 7f3b031b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:15.276 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:15.272+0000 7f3b031b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:15.288 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:15.288 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:15.298 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:15.298 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:15.309 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:15.310 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:15.320 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:15.320 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:15.718 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_2 2026-02-24T08:26:15.718 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2026-02-24T08:26:15.834 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:15.935 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:15.931+0000 7f44233fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:15.935 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:15.931+0000 7f44233fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:16.053 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_2' removed 2026-02-24T08:26:16.096 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T08:26:16.096 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T08:26:16.096 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_3 2026-02-24T08:26:16.096 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool create unique_pool_3 16 2026-02-24T08:26:16.214 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:16.314 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:16.311+0000 7fc5d7ad6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:16.314 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/881771680' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:16.314 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/569854271' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:26:16.315 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:16.311+0000 7fc5d7ad6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:17.059 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_3' created 2026-02-24T08:26:17.098 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2026-02-24T08:26:17.213 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:17.314 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:17.311+0000 7effbc5b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:17.314 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:17.311+0000 7effbc5b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:17.314 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/569854271' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_2", "pool2": "unique_pool_2", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:26:17.315 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:17 trial105 ceph-mon[39442]: osdmap e62: 4 total, 4 up, 4 in 2026-02-24T08:26:17.315 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1506071292' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16} : dispatch 2026-02-24T08:26:17.315 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:17 trial105 ceph-mon[39442]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 5.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:26:17.354 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:17.471 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:17.571 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:17.569+0000 7ff789d7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:17.571 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:17.569+0000 7ff789d7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:17.583 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:17.583 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:17.594 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:17.594 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:17.605 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:17.605 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:17.616 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:17.617 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:18.061 INFO:teuthology.orchestra.run.trial105.stderr:enabled application 'rados' on pool 'unique_pool_3' 2026-02-24T08:26:18.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1506071292' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_3", "pg_num": 16}]': finished 2026-02-24T08:26:18.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:18 trial105 ceph-mon[39442]: osdmap e63: 4 total, 4 up, 4 in 2026-02-24T08:26:18.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1780964939' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:26:18.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4125127028' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:19.104 DEBUG:teuthology.orchestra.run.trial105:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_3 bench 90 write' 2026-02-24T08:26:19.107 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T08:26:19.107 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T08:26:19.156 INFO:tasks.radosbench.radosbench.0.trial105.stdout:hints = 1 2026-02-24T08:26:19.156 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T08:26:19.156 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object prefix: benchmark_data_trial105_110519 2026-02-24T08:26:19.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:26:19.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 0 0 0 0 0 0 - 0 2026-02-24T08:26:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1780964939' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_3", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:26:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:19 trial105 ceph-mon[39442]: osdmap e64: 4 total, 4 up, 4 in 2026-02-24T08:26:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:19 trial105 ceph-mon[39442]: pgmap v216: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:26:19.653 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:19.792 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:19.818 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:26:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:26:19] "GET /metrics HTTP/1.1" 200 4221 "" "Prometheus/3.6.0" 2026-02-24T08:26:19.918 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:19.915+0000 7f1ee82b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:19.918 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:19.915+0000 7f1ee82b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:19.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:26:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:26:19.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:26:19.948 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:19.948 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:19.962 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:19.962 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:19.970 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:19.970 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:19.970 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:26:19.976 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:19.976 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:19.990 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:19.991 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:20.111 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:20.137 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:20 trial105 ceph-mon[39442]: osdmap e65: 4 total, 4 up, 4 in 2026-02-24T08:26:20.137 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:20 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2550012377' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:20.156 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 1 128 8814 8686 67.8539 67.8594 0.00699961 0.0145077 2026-02-24T08:26:20.234 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:20.231+0000 7f7020448640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:20.234 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:20.232+0000 7f7020448640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:20.380 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:26:20.381 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:26:20.428 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2026-02-24T08:26:19.066169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5871948,"kb_used_data":4284,"kb_used_omap":102,"kb_used_meta":5867481,"kb_avail":2930140852,"statfs":{"total":3006477107200,"available":3000464232448,"internally_reserved":0,"allocated":4386816,"data_stored":2706460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":105241,"internal_metadata":6008300775},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-60481560,"num_objects":-924,"num_object_clones":0,"num_object_copies":-2772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-924,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-427648,"num_write_kb":-3047609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.330524"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:26:17.054519+0000","last_change":"2026-02-24T08:26:17.054519+0000","last_active":"2026-02-24T08:26:17.054519+0000","last_peered":"2026-02-24T08:26:17.054519+0000","last_clean":"2026-02-24T08:26:17.054519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:26:17.054519+0000","last_undegraded":"2026-02-24T08:26:17.054519+0000","last_fullsized":"2026-02-24T08:26:17.054519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":149,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-24T08:25:21.797246+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:25:21.797246+0000","last_peered":"2026-02-24T08:25:21.797246+0000","last_clean":"2026-02-24T08:25:21.797246+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:25:21.797246+0000","last_undegraded":"2026-02-24T08:25:21.797246+0000","last_fullsized":"2026-02-24T08:25:21.797246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9104,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1728596,"kb_used_data":1216,"kb_used_omap":22,"kb_used_meta":1727337,"kb_avail":732274604,"statfs":{"total":751619276800,"available":749849194496,"internally_reserved":0,"allocated":1245184,"data_stored":824207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22676,"internal_metadata":1768793964},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444107,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":883476,"kb_used_data":1216,"kb_used_omap":4,"kb_used_meta":882235,"kb_avail":733119724,"statfs":{"total":751619276800,"available":750714597376,"internally_reserved":0,"allocated":1245184,"data_stored":824207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4450,"internal_metadata":903409310},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1583504,"kb_used_data":636,"kb_used_omap":36,"kb_used_meta":1582811,"kb_avail":732419696,"statfs":{"total":751619276800,"available":749997768704,"internally_reserved":0,"allocated":651264,"data_stored":233839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":1620798922},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1676372,"kb_used_data":1216,"kb_used_omap":39,"kb_used_meta":1675096,"kb_avail":732326828,"statfs":{"total":751619276800,"available":749902671872,"internally_reserved":0,"allocated":1245184,"data_stored":824207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40685,"internal_metadata":1715298579},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9104,"internal_metadata":0}]}} 2026-02-24T08:26:21.156 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 2 128 17310 17182 67.1121 66.375 0.0132669 0.0148043 2026-02-24T08:26:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:21 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:26:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:21 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:26:21.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:21 trial105 ceph-mon[39442]: from='client.14917 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:26:21.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:21 trial105 ceph-mon[39442]: pgmap v218: 17 pgs: 17 active+clean; 90 MiB data, 5.8 GiB used, 2.7 TiB / 2.7 TiB avail; 19 MiB/s wr, 2.44k op/s 2026-02-24T08:26:22.034 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:22.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 3 128 26091 25963 67.6068 68.6016 0.0124962 0.0147483 2026-02-24T08:26:22.187 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:22.304 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:22.302+0000 7f0db7832640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:22.305 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:22.302+0000 7f0db7832640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:22.326 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:22.326 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:22.339 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:22.339 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:22.352 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:22.352 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:22.366 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:22.367 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:22.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:22 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1818708655' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:23.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 4 128 34446 34318 67.0222 65.2734 0.0235144 0.014866 2026-02-24T08:26:23.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:23 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:26:23.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:23 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:26:23.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:23 trial105 ceph-mon[39442]: pgmap v219: 17 pgs: 17 active+clean; 90 MiB data, 5.8 GiB used, 2.7 TiB / 2.7 TiB avail; 15 MiB/s wr, 1.91k op/s 2026-02-24T08:26:24.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 5 127 42692 42565 66.5028 64.4297 0.022604 0.0150095 2026-02-24T08:26:24.411 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:24.571 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:24.703 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:24.700+0000 7fc30ff95640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:24.703 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:24.701+0000 7fc30ff95640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:24.723 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:24.724 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:24.738 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:24.739 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:24.752 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:24.752 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:24.767 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:24.767 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:25.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 6 127 51382 51255 66.7332 67.8906 0.0139278 0.014963 2026-02-24T08:26:25.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1583437575' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:25.431 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:25.431 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:25.431 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T08:26:25.432 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:26:25.592 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:25.724 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:25.721+0000 7f4e5f038640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:25.724 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:25.721+0000 7f4e5f038640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:25.899 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:26:25.900 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:26:25.946 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2026-02-24T08:26:24.736962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":94446112,"num_objects":1435,"num_object_clones":0,"num_object_copies":4305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1435,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":11592,"num_write_kb":93806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11556,"ondisk_log_size":11556,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6083996,"kb_used_data":144140,"kb_used_omap":112,"kb_used_meta":5939663,"kb_avail":2929928804,"statfs":{"total":3006477107200,"available":3000247095296,"internally_reserved":0,"allocated":147599360,"data_stored":146052432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115270,"internal_metadata":6082215354},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,5],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":93855744,"num_objects":1433,"num_object_clones":0,"num_object_copies":4299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11457,"num_write_kb":91656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.678742"},"pg_stats":[{"pgid":"5.f","version":"65'648","reported_seq":660,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.492898+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:26:20.492898+0000","last_peered":"2026-02-24T08:26:20.492898+0000","last_clean":"2026-02-24T08:26:20.492898+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:26:20.492898+0000","last_undegraded":"2026-02-24T08:26:20.492898+0000","last_fullsized":"2026-02-24T08:26:20.492898+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"65'672","reported_seq":686,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.510005+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:26:20.510005+0000","last_peered":"2026-02-24T08:26:20.510005+0000","last_clean":"2026-02-24T08:26:20.510005+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:26:20.510005+0000","last_undegraded":"2026-02-24T08:26:20.510005+0000","last_fullsized":"2026-02-24T08:26:20.510005+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"65'576","reported_seq":590,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.343014+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:26:20.343014+0000","last_peered":"2026-02-24T08:26:20.343014+0000","last_clean":"2026-02-24T08:26:20.343014+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:26:20.343014+0000","last_undegraded":"2026-02-24T08:26:20.343014+0000","last_fullsized":"2026-02-24T08:26:20.343014+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'1016","reported_seq":1030,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.691874+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:26:20.691874+0000","last_peered":"2026-02-24T08:26:20.691874+0000","last_clean":"2026-02-24T08:26:20.691874+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:26:20.691874+0000","last_undegraded":"2026-02-24T08:26:20.691874+0000","last_fullsized":"2026-02-24T08:26:20.691874+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"65'504","reported_seq":518,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.342439+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:26:20.342439+0000","last_peered":"2026-02-24T08:26:20.342439+0000","last_clean":"2026-02-24T08:26:20.342439+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:26:20.342439+0000","last_undegraded":"2026-02-24T08:26:20.342439+0000","last_fullsized":"2026-02-24T08:26:20.342439+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"65'704","reported_seq":718,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.342769+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:26:20.342769+0000","last_peered":"2026-02-24T08:26:20.342769+0000","last_clean":"2026-02-24T08:26:20.342769+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:26:20.342769+0000","last_undegraded":"2026-02-24T08:26:20.342769+0000","last_fullsized":"2026-02-24T08:26:20.342769+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"65'672","reported_seq":686,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.524977+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:26:20.524977+0000","last_peered":"2026-02-24T08:26:20.524977+0000","last_clean":"2026-02-24T08:26:20.524977+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:26:20.524977+0000","last_undegraded":"2026-02-24T08:26:20.524977+0000","last_fullsized":"2026-02-24T08:26:20.524977+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"65'770","reported_seq":779,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.341994+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:26:20.341994+0000","last_peered":"2026-02-24T08:26:20.341994+0000","last_clean":"2026-02-24T08:26:20.341994+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:26:20.341994+0000","last_undegraded":"2026-02-24T08:26:20.341994+0000","last_fullsized":"2026-02-24T08:26:20.341994+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6307840,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"65'664","reported_seq":678,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.515039+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:26:20.515039+0000","last_peered":"2026-02-24T08:26:20.515039+0000","last_clean":"2026-02-24T08:26:20.515039+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:26:20.515039+0000","last_undegraded":"2026-02-24T08:26:20.515039+0000","last_fullsized":"2026-02-24T08:26:20.515039+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"65'832","reported_seq":846,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.647920+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:26:20.647920+0000","last_peered":"2026-02-24T08:26:20.647920+0000","last_clean":"2026-02-24T08:26:20.647920+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:26:20.647920+0000","last_undegraded":"2026-02-24T08:26:20.647920+0000","last_fullsized":"2026-02-24T08:26:20.647920+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"65'800","reported_seq":814,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.327465+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:26:20.327465+0000","last_peered":"2026-02-24T08:26:20.327465+0000","last_clean":"2026-02-24T08:26:20.327465+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:26:20.327465+0000","last_undegraded":"2026-02-24T08:26:20.327465+0000","last_fullsized":"2026-02-24T08:26:20.327465+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"65'632","reported_seq":646,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.321867+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:26:20.321867+0000","last_peered":"2026-02-24T08:26:20.321867+0000","last_clean":"2026-02-24T08:26:20.321867+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:26:20.321867+0000","last_undegraded":"2026-02-24T08:26:20.321867+0000","last_fullsized":"2026-02-24T08:26:20.321867+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"65'752","reported_seq":765,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.527895+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:26:20.527895+0000","last_peered":"2026-02-24T08:26:20.527895+0000","last_clean":"2026-02-24T08:26:20.527895+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:26:20.527895+0000","last_undegraded":"2026-02-24T08:26:20.527895+0000","last_fullsized":"2026-02-24T08:26:20.527895+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'799","reported_seq":791,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.527359+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:26:20.527359+0000","last_peered":"2026-02-24T08:26:20.527359+0000","last_clean":"2026-02-24T08:26:20.527359+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:26:20.527359+0000","last_undegraded":"2026-02-24T08:26:20.527359+0000","last_fullsized":"2026-02-24T08:26:20.527359+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6545408,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"65'616","reported_seq":620,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.341104+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:26:20.341104+0000","last_peered":"2026-02-24T08:26:20.341104+0000","last_clean":"2026-02-24T08:26:20.341104+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:26:20.341104+0000","last_undegraded":"2026-02-24T08:26:20.341104+0000","last_fullsized":"2026-02-24T08:26:20.341104+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"65'800","reported_seq":814,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:20.457009+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:26:20.457009+0000","last_peered":"2026-02-24T08:26:20.457009+0000","last_clean":"2026-02-24T08:26:20.457009+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:26:20.457009+0000","last_undegraded":"2026-02-24T08:26:20.457009+0000","last_fullsized":"2026-02-24T08:26:20.457009+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":157,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:19.158006+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:26:19.158006+0000","last_peered":"2026-02-24T08:26:19.158006+0000","last_clean":"2026-02-24T08:26:19.158006+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:26:19.158006+0000","last_undegraded":"2026-02-24T08:26:19.158006+0000","last_fullsized":"2026-02-24T08:26:19.158006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":93855744,"num_objects":1433,"num_object_clones":0,"num_object_copies":4299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11457,"num_write_kb":91656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":290422784,"data_stored":290422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11457,"ondisk_log_size":11457,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9216,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1775300,"kb_used_data":29872,"kb_used_omap":22,"kb_used_meta":1745385,"kb_avail":732227900,"statfs":{"total":751619276800,"available":749801369600,"internally_reserved":0,"allocated":30588928,"data_stored":30201308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22935,"internal_metadata":1787274857},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444108,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":933092,"kb_used_data":32784,"kb_used_omap":7,"kb_used_meta":900280,"kb_avail":733070108,"statfs":{"total":751619276800,"available":750663790592,"internally_reserved":0,"allocated":33570816,"data_stored":33183196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7710,"internal_metadata":921887202},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,5],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1649024,"kb_used_data":48108,"kb_used_omap":39,"kb_used_meta":1600856,"kb_avail":732354176,"statfs":{"total":751619276800,"available":749930676224,"internally_reserved":0,"allocated":49262592,"data_stored":48878524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40685,"internal_metadata":1639276819},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705744,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1726580,"kb_used_data":33376,"kb_used_omap":42,"kb_used_meta":1693141,"kb_avail":732276620,"statfs":{"total":751619276800,"available":749851258880,"internally_reserved":0,"allocated":34177024,"data_stored":33789404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43940,"internal_metadata":1733776476},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9216,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69025792,"data_stored":69025792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":70123520,"data_stored":70123520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65560576,"data_stored":65560576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":85712896,"data_stored":85712896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:26:25.946 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:26:25.946 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 26 2026-02-24T08:26:25.974 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:25 trial105 ceph-mon[39442]: pgmap v220: 17 pgs: 17 active+clean; 90 MiB data, 5.8 GiB used, 2.7 TiB / 2.7 TiB avail; 12 MiB/s wr, 1.49k op/s 2026-02-24T08:26:26.101 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:26.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 7 128 59646 59518 66.4213 64.5547 0.00697474 0.0150313 2026-02-24T08:26:26.227 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:26.224+0000 7f612177c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:26.227 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:26.225+0000 7f612177c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:26.395 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:26:26.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:26:26.814 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:26.978 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:27.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:26 trial105 ceph-mon[39442]: from='client.14923 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:26:27.048 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2821357579' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T08:26:27.109 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:27.106+0000 7f97d75f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:27.109 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:27.106+0000 7f97d75f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:27.130 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:27.130 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:27.143 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:27.144 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:27.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 8 128 67397 67269 65.6873 60.5547 0.0183893 0.0152038 2026-02-24T08:26:27.158 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:27.158 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:27.175 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:27.175 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:28.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 9 128 74647 74519 64.6817 56.6406 0.00859075 0.0154315 2026-02-24T08:26:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:27 trial105 ceph-mon[39442]: pgmap v221: 17 pgs: 17 active+clean; 422 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 49 MiB/s wr, 6.21k op/s 2026-02-24T08:26:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4137027062' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:29.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 10 128 81640 81512 63.6763 54.6328 0.0128638 0.0156773 2026-02-24T08:26:29.224 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:29.387 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:29.512 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:29.509+0000 7f88b4fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:29.512 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:29.510+0000 7f88b4fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:29.532 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:29.532 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:29.546 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:29.546 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:29.561 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:29.567 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:29.579 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:29.579 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:29.794 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:26:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:26:29] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-24T08:26:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:26:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:26:29.552Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:26:30.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 11 128 87027 86899 61.7133 42.0859 0.0206624 0.0161873 2026-02-24T08:26:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:29 trial105 ceph-mon[39442]: pgmap v222: 17 pgs: 17 active+clean; 422 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 42 MiB/s wr, 5.39k op/s 2026-02-24T08:26:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:26:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/854435920' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:31.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 12 127 92947 92820 60.425 46.2578 0.033623 0.0165172 2026-02-24T08:26:31.442 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:31.442 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:31.443 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T08:26:31.443 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:26:31.600 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:31.985 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:31 trial105 ceph-mon[39442]: pgmap v223: 17 pgs: 17 active+clean; 694 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 59 MiB/s wr, 7.61k op/s 2026-02-24T08:26:32.031 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:31.982+0000 7f120faf0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:32.032 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:31.983+0000 7f120faf0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:32.150 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:26:32.150 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:26:32.157 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 13 127 98029 97902 58.8308 39.7031 0.00751376 0.0169717 2026-02-24T08:26:32.279 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:32.505 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2026-02-24T08:26:30.737796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":727900704,"num_objects":11104,"num_object_clones":0,"num_object_copies":33312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11104,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":88918,"num_write_kb":712414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88882,"ondisk_log_size":88882,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6549420,"kb_used_data":2089244,"kb_used_omap":57,"kb_used_meta":4460038,"kb_avail":2929463380,"statfs":{"total":3006477107200,"available":2999770501120,"internally_reserved":0,"allocated":2139385856,"data_stored":2137838928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58628,"internal_metadata":4567079676},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,1,6],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":727310336,"num_objects":11102,"num_object_clones":0,"num_object_copies":33306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88783,"num_write_kb":710264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.671626"},"pg_stats":[{"pgid":"5.f","version":"65'5539","reported_seq":5551,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.498583+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:26:30.498583+0000","last_peered":"2026-02-24T08:26:30.498583+0000","last_clean":"2026-02-24T08:26:30.498583+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:26:30.498583+0000","last_undegraded":"2026-02-24T08:26:30.498583+0000","last_fullsized":"2026-02-24T08:26:30.498583+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5539,"log_dups_size":0,"ondisk_log_size":5539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45375488,"num_objects":693,"num_object_clones":0,"num_object_copies":2079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5539,"num_write_kb":44312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"65'5520","reported_seq":5534,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.508943+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:26:30.508943+0000","last_peered":"2026-02-24T08:26:30.508943+0000","last_clean":"2026-02-24T08:26:30.508943+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:26:30.508943+0000","last_undegraded":"2026-02-24T08:26:30.508943+0000","last_fullsized":"2026-02-24T08:26:30.508943+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5520,"log_dups_size":0,"ondisk_log_size":5520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45219840,"num_objects":690,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":690,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5520,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"65'5016","reported_seq":5030,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.345116+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:26:30.345116+0000","last_peered":"2026-02-24T08:26:30.345116+0000","last_clean":"2026-02-24T08:26:30.345116+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:26:30.345116+0000","last_undegraded":"2026-02-24T08:26:30.345116+0000","last_fullsized":"2026-02-24T08:26:30.345116+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5016,"log_dups_size":0,"ondisk_log_size":5016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41091072,"num_objects":627,"num_object_clones":0,"num_object_copies":1881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5016,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'6113","reported_seq":6124,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.705815+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:26:30.705815+0000","last_peered":"2026-02-24T08:26:30.705815+0000","last_clean":"2026-02-24T08:26:30.705815+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:26:30.705815+0000","last_undegraded":"2026-02-24T08:26:30.705815+0000","last_fullsized":"2026-02-24T08:26:30.705815+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":6113,"log_dups_size":0,"ondisk_log_size":6113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50077696,"num_objects":765,"num_object_clones":0,"num_object_copies":2295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":765,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6113,"num_write_kb":48904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"65'5248","reported_seq":5262,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.333316+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:26:30.333316+0000","last_peered":"2026-02-24T08:26:30.333316+0000","last_clean":"2026-02-24T08:26:30.333316+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:26:30.333316+0000","last_undegraded":"2026-02-24T08:26:30.333316+0000","last_fullsized":"2026-02-24T08:26:30.333316+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5248,"log_dups_size":0,"ondisk_log_size":5248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42991616,"num_objects":656,"num_object_clones":0,"num_object_copies":1968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":656,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5248,"num_write_kb":41984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"65'5280","reported_seq":5294,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.334992+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:26:30.334992+0000","last_peered":"2026-02-24T08:26:30.334992+0000","last_clean":"2026-02-24T08:26:30.334992+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:26:30.334992+0000","last_undegraded":"2026-02-24T08:26:30.334992+0000","last_fullsized":"2026-02-24T08:26:30.334992+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5280,"log_dups_size":0,"ondisk_log_size":5280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43253760,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":660,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5280,"num_write_kb":42240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"65'5544","reported_seq":5558,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.530354+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:26:30.530354+0000","last_peered":"2026-02-24T08:26:30.530354+0000","last_clean":"2026-02-24T08:26:30.530354+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:26:30.530354+0000","last_undegraded":"2026-02-24T08:26:30.530354+0000","last_fullsized":"2026-02-24T08:26:30.530354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5544,"log_dups_size":0,"ondisk_log_size":5544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45416448,"num_objects":693,"num_object_clones":0,"num_object_copies":2079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5544,"num_write_kb":44352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"65'5672","reported_seq":5686,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.334118+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:26:30.334118+0000","last_peered":"2026-02-24T08:26:30.334118+0000","last_clean":"2026-02-24T08:26:30.334118+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:26:30.334118+0000","last_undegraded":"2026-02-24T08:26:30.334118+0000","last_fullsized":"2026-02-24T08:26:30.334118+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5672,"log_dups_size":0,"ondisk_log_size":5672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46465024,"num_objects":709,"num_object_clones":0,"num_object_copies":2127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5672,"num_write_kb":45376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"65'5880","reported_seq":5894,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.529301+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:26:30.529301+0000","last_peered":"2026-02-24T08:26:30.529301+0000","last_clean":"2026-02-24T08:26:30.529301+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:26:30.529301+0000","last_undegraded":"2026-02-24T08:26:30.529301+0000","last_fullsized":"2026-02-24T08:26:30.529301+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5880,"log_dups_size":0,"ondisk_log_size":5880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48168960,"num_objects":735,"num_object_clones":0,"num_object_copies":2205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5880,"num_write_kb":47040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"65'5956","reported_seq":5968,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.704317+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:26:30.704317+0000","last_peered":"2026-02-24T08:26:30.704317+0000","last_clean":"2026-02-24T08:26:30.704317+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:26:30.704317+0000","last_undegraded":"2026-02-24T08:26:30.704317+0000","last_fullsized":"2026-02-24T08:26:30.704317+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5956,"log_dups_size":0,"ondisk_log_size":5956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48791552,"num_objects":745,"num_object_clones":0,"num_object_copies":2235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5956,"num_write_kb":47648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"65'5497","reported_seq":5508,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.351740+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:26:30.351740+0000","last_peered":"2026-02-24T08:26:30.351740+0000","last_clean":"2026-02-24T08:26:30.351740+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:26:30.351740+0000","last_undegraded":"2026-02-24T08:26:30.351740+0000","last_fullsized":"2026-02-24T08:26:30.351740+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5497,"log_dups_size":0,"ondisk_log_size":5497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45031424,"num_objects":688,"num_object_clones":0,"num_object_copies":2064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":688,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5497,"num_write_kb":43976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"65'5379","reported_seq":5392,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.352835+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:26:30.352835+0000","last_peered":"2026-02-24T08:26:30.352835+0000","last_clean":"2026-02-24T08:26:30.352835+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:26:30.352835+0000","last_undegraded":"2026-02-24T08:26:30.352835+0000","last_fullsized":"2026-02-24T08:26:30.352835+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5379,"log_dups_size":0,"ondisk_log_size":5379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44064768,"num_objects":673,"num_object_clones":0,"num_object_copies":2019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5379,"num_write_kb":43032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"65'5437","reported_seq":5450,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.538707+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:26:30.538707+0000","last_peered":"2026-02-24T08:26:30.538707+0000","last_clean":"2026-02-24T08:26:30.538707+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:26:30.538707+0000","last_undegraded":"2026-02-24T08:26:30.538707+0000","last_fullsized":"2026-02-24T08:26:30.538707+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5437,"log_dups_size":0,"ondisk_log_size":5437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44539904,"num_objects":680,"num_object_clones":0,"num_object_copies":2040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":680,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5437,"num_write_kb":43496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'5822","reported_seq":5834,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.536076+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:26:30.536076+0000","last_peered":"2026-02-24T08:26:30.536076+0000","last_clean":"2026-02-24T08:26:30.536076+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:26:30.536076+0000","last_undegraded":"2026-02-24T08:26:30.536076+0000","last_fullsized":"2026-02-24T08:26:30.536076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5822,"log_dups_size":0,"ondisk_log_size":5822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47693824,"num_objects":728,"num_object_clones":0,"num_object_copies":2184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5822,"num_write_kb":46576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"65'5360","reported_seq":5374,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.344650+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:26:30.344650+0000","last_peered":"2026-02-24T08:26:30.344650+0000","last_clean":"2026-02-24T08:26:30.344650+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:26:30.344650+0000","last_undegraded":"2026-02-24T08:26:30.344650+0000","last_fullsized":"2026-02-24T08:26:30.344650+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5360,"log_dups_size":0,"ondisk_log_size":5360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909120,"num_objects":670,"num_object_clones":0,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5360,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"65'5520","reported_seq":5534,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:30.502322+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:26:30.502322+0000","last_peered":"2026-02-24T08:26:30.502322+0000","last_clean":"2026-02-24T08:26:30.502322+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:26:30.502322+0000","last_undegraded":"2026-02-24T08:26:30.502322+0000","last_fullsized":"2026-02-24T08:26:30.502322+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":5520,"log_dups_size":0,"ondisk_log_size":5520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45219840,"num_objects":690,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":690,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5520,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":158,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:19.158084+0000","last_change":"2026-02-24T08:25:19.691209+0000","last_active":"2026-02-24T08:26:19.158084+0000","last_peered":"2026-02-24T08:26:19.158084+0000","last_clean":"2026-02-24T08:26:19.158084+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:26:19.158084+0000","last_undegraded":"2026-02-24T08:26:19.158084+0000","last_fullsized":"2026-02-24T08:26:19.158084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:25:19.691163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:25:19.691163+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:26:34.404228+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":727310336,"num_objects":11102,"num_object_clones":0,"num_object_copies":33306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88783,"num_write_kb":710264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2187141120,"data_stored":2187141120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88783,"ondisk_log_size":88783,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1699,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1499980,"kb_used_data":620664,"kb_used_omap":4,"kb_used_meta":879291,"kb_avail":732503220,"statfs":{"total":751619276800,"available":750083297280,"internally_reserved":0,"allocated":635559936,"data_stored":635172316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4472,"internal_metadata":900394632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1496620,"kb_used_data":469976,"kb_used_omap":8,"kb_used_meta":1026615,"kb_avail":732506580,"statfs":{"total":751619276800,"available":750086737920,"internally_reserved":0,"allocated":481255424,"data_stored":480867804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8362,"internal_metadata":1051254614},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,1,6],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2104160,"kb_used_data":449100,"kb_used_omap":40,"kb_used_meta":1654999,"kb_avail":731899040,"statfs":{"total":751619276800,"available":749464616960,"internally_reserved":0,"allocated":459878400,"data_stored":459494332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41336,"internal_metadata":1694719624},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1448660,"kb_used_data":549504,"kb_used_omap":4,"kb_used_meta":899131,"kb_avail":732554540,"statfs":{"total":751619276800,"available":750135848960,"internally_reserved":0,"allocated":562692096,"data_stored":562304476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4458,"internal_metadata":920710806},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1699,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":583483392,"data_stored":583483392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466911232,"data_stored":466911232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":499499008,"data_stored":499499008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":637247488,"data_stored":637247488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:26:32.508 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:26:32.508 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 36 2026-02-24T08:26:32.509 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:32.627 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:32.624+0000 7f57ac32a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:32.627 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:32.624+0000 7f57ac32a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:32.648 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:32.649 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:32.659 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:32.662 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:32.663 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:32.677 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:32.677 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:32.692 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:32.693 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:32.790 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:32.787+0000 7f5f19d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:32.790 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:32.787+0000 7f5f19d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:32.951 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:26:32.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:26:33.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 14 128 102945 102817 57.3711 38.3984 0.00620842 0.017404 2026-02-24T08:26:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:33 trial105 ceph-mon[39442]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:26:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2339931226' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:33.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:33 trial105 ceph-mon[39442]: pgmap v224: 17 pgs: 17 active+clean; 694 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.44k op/s 2026-02-24T08:26:33.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1173796749' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T08:26:34.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 15 127 108573 108446 56.4779 43.9766 0.0101585 0.0176861 2026-02-24T08:26:34.745 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:34.900 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:35.029 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:35.026+0000 7fbdd6666640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:35.030 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:35.028+0000 7fbdd6666640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:35.049 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:35.050 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:35.064 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:35.065 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:35.084 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:35.085 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:35.102 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:35.102 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:35.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 16 128 113863 113735 55.5304 41.3203 0.0100493 0.017987 2026-02-24T08:26:36.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 17 128 119053 118925 54.6488 40.5469 0.0342382 0.018275 2026-02-24T08:26:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:35 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:26:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:35 trial105 ceph-mon[39442]: pgmap v225: 17 pgs: 17 active+clean; 694 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.44k op/s 2026-02-24T08:26:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:35 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:26:36.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/760664814' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:37.152 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:37.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 18 128 123877 123749 53.7064 37.6875 0.0420335 0.018604 2026-02-24T08:26:37.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:26:37.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:26:37.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:26:37.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:26:37.177 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:26:37.302 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:37.761 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:37.749+0000 7f7ed726a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:37.761 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:37.750+0000 7f7ed726a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:37.767 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:37.767 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:37.780 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:37.781 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:37.796 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:37.796 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:37.810 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:37.810 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:37.995 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:37.995 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:37.996 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_3 2026-02-24T08:26:37.996 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:26:38.023 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:37 trial105 ceph-mon[39442]: pgmap v226: 17 pgs: 17 active+clean; 903 MiB data, 6.9 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.67k op/s 2026-02-24T08:26:38.023 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1655204149' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:38.150 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:38.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 19 128 128117 127989 52.623 33.125 0.0221972 0.0189813 2026-02-24T08:26:38.282 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:38.279+0000 7f6180384640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:38.282 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:38.279+0000 7f6180384640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:38.438 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:26:38.438 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:26:38.490 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2026-02-24T08:26:36.738645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":946807328,"num_objects":14445,"num_object_clones":0,"num_object_copies":43335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14445,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":115640,"num_write_kb":926190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115604,"ondisk_log_size":115604,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7278396,"kb_used_data":2728108,"kb_used_omap":57,"kb_used_meta":4550150,"kb_avail":2928734404,"statfs":{"total":3006477107200,"available":2999024029696,"internally_reserved":0,"allocated":2793582592,"data_stored":2792035664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58690,"internal_metadata":4659354302},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":852361216,"num_objects":13010,"num_object_clones":0,"num_object_copies":39030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13010,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104048,"num_write_kb":832384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001682"},"pg_stats":[{"pgid":"5.f","version":"65'7138","reported_seq":7150,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.500621+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:26:35.500621+0000","last_peered":"2026-02-24T08:26:35.500621+0000","last_clean":"2026-02-24T08:26:35.500621+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:26:35.500621+0000","last_undegraded":"2026-02-24T08:26:35.500621+0000","last_fullsized":"2026-02-24T08:26:35.500621+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7138,"log_dups_size":0,"ondisk_log_size":7138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58474496,"num_objects":893,"num_object_clones":0,"num_object_copies":2679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":893,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7138,"num_write_kb":57104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"65'7096","reported_seq":7110,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.532108+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:26:35.532108+0000","last_peered":"2026-02-24T08:26:35.532108+0000","last_clean":"2026-02-24T08:26:35.532108+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:26:35.532108+0000","last_undegraded":"2026-02-24T08:26:35.532108+0000","last_fullsized":"2026-02-24T08:26:35.532108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7096,"log_dups_size":0,"ondisk_log_size":7096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58130432,"num_objects":887,"num_object_clones":0,"num_object_copies":2661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":887,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7096,"num_write_kb":56768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"65'6620","reported_seq":6631,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.359468+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:26:35.359468+0000","last_peered":"2026-02-24T08:26:35.359468+0000","last_clean":"2026-02-24T08:26:35.359468+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:26:35.359468+0000","last_undegraded":"2026-02-24T08:26:35.359468+0000","last_fullsized":"2026-02-24T08:26:35.359468+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":6620,"log_dups_size":0,"ondisk_log_size":6620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54231040,"num_objects":828,"num_object_clones":0,"num_object_copies":2484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":828,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6620,"num_write_kb":52960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'7851","reported_seq":7863,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.699672+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:26:35.699672+0000","last_peered":"2026-02-24T08:26:35.699672+0000","last_clean":"2026-02-24T08:26:35.699672+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:26:35.699672+0000","last_undegraded":"2026-02-24T08:26:35.699672+0000","last_fullsized":"2026-02-24T08:26:35.699672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7851,"log_dups_size":0,"ondisk_log_size":7851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64315392,"num_objects":982,"num_object_clones":0,"num_object_copies":2946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":982,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7851,"num_write_kb":62808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"65'6771","reported_seq":6782,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.359586+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:26:35.359586+0000","last_peered":"2026-02-24T08:26:35.359586+0000","last_clean":"2026-02-24T08:26:35.359586+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:26:35.359586+0000","last_undegraded":"2026-02-24T08:26:35.359586+0000","last_fullsized":"2026-02-24T08:26:35.359586+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":6771,"log_dups_size":0,"ondisk_log_size":6771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55468032,"num_objects":847,"num_object_clones":0,"num_object_copies":2541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":847,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6771,"num_write_kb":54168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"65'7099","reported_seq":7111,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.354357+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:26:35.354357+0000","last_peered":"2026-02-24T08:26:35.354357+0000","last_clean":"2026-02-24T08:26:35.354357+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:26:35.354357+0000","last_undegraded":"2026-02-24T08:26:35.354357+0000","last_fullsized":"2026-02-24T08:26:35.354357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7099,"log_dups_size":0,"ondisk_log_size":7099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58155008,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":888,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7099,"num_write_kb":56792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"65'7016","reported_seq":7030,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.527798+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:26:35.527798+0000","last_peered":"2026-02-24T08:26:35.527798+0000","last_clean":"2026-02-24T08:26:35.527798+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:26:35.527798+0000","last_undegraded":"2026-02-24T08:26:35.527798+0000","last_fullsized":"2026-02-24T08:26:35.527798+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7016,"log_dups_size":0,"ondisk_log_size":7016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57475072,"num_objects":877,"num_object_clones":0,"num_object_copies":2631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":877,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7016,"num_write_kb":56128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"65'7520","reported_seq":7534,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.349279+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:26:35.349279+0000","last_peered":"2026-02-24T08:26:35.349279+0000","last_clean":"2026-02-24T08:26:35.349279+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:26:35.349279+0000","last_undegraded":"2026-02-24T08:26:35.349279+0000","last_fullsized":"2026-02-24T08:26:35.349279+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7520,"log_dups_size":0,"ondisk_log_size":7520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61603840,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7520,"num_write_kb":60160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"65'7550","reported_seq":7564,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.551178+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:26:35.551178+0000","last_peered":"2026-02-24T08:26:35.551178+0000","last_clean":"2026-02-24T08:26:35.551178+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:26:35.551178+0000","last_undegraded":"2026-02-24T08:26:35.551178+0000","last_fullsized":"2026-02-24T08:26:35.551178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7550,"log_dups_size":0,"ondisk_log_size":7550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61849600,"num_objects":944,"num_object_clones":0,"num_object_copies":2832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":944,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7550,"num_write_kb":60400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"65'7632","reported_seq":7646,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.680365+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:26:35.680365+0000","last_peered":"2026-02-24T08:26:35.680365+0000","last_clean":"2026-02-24T08:26:35.680365+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:26:35.680365+0000","last_undegraded":"2026-02-24T08:26:35.680365+0000","last_fullsized":"2026-02-24T08:26:35.680365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7632,"log_dups_size":0,"ondisk_log_size":7632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62521344,"num_objects":954,"num_object_clones":0,"num_object_copies":2862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7632,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"65'7064","reported_seq":7078,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.303082+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:26:35.303082+0000","last_peered":"2026-02-24T08:26:35.303082+0000","last_clean":"2026-02-24T08:26:35.303082+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:26:35.303082+0000","last_undegraded":"2026-02-24T08:26:35.303082+0000","last_fullsized":"2026-02-24T08:26:35.303082+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7064,"log_dups_size":0,"ondisk_log_size":7064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57868288,"num_objects":883,"num_object_clones":0,"num_object_copies":2649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7064,"num_write_kb":56512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"65'6920","reported_seq":6933,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.365059+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:26:35.365059+0000","last_peered":"2026-02-24T08:26:35.365059+0000","last_clean":"2026-02-24T08:26:35.365059+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:26:35.365059+0000","last_undegraded":"2026-02-24T08:26:35.365059+0000","last_fullsized":"2026-02-24T08:26:35.365059+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":6920,"log_dups_size":0,"ondisk_log_size":6920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56688640,"num_objects":865,"num_object_clones":0,"num_object_copies":2595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":865,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6920,"num_write_kb":55360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"65'6993","reported_seq":7007,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.549601+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:26:35.549601+0000","last_peered":"2026-02-24T08:26:35.549601+0000","last_clean":"2026-02-24T08:26:35.549601+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:26:35.549601+0000","last_undegraded":"2026-02-24T08:26:35.549601+0000","last_fullsized":"2026-02-24T08:26:35.549601+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":6993,"log_dups_size":0,"ondisk_log_size":6993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57286656,"num_objects":875,"num_object_clones":0,"num_object_copies":2625,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":875,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6993,"num_write_kb":55944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'7763","reported_seq":7775,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.517293+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:26:35.517293+0000","last_peered":"2026-02-24T08:26:35.517293+0000","last_clean":"2026-02-24T08:26:35.517293+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:26:35.517293+0000","last_undegraded":"2026-02-24T08:26:35.517293+0000","last_fullsized":"2026-02-24T08:26:35.517293+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7763,"log_dups_size":0,"ondisk_log_size":7763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63594496,"num_objects":971,"num_object_clones":0,"num_object_copies":2913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":971,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7763,"num_write_kb":62104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"65'7064","reported_seq":7078,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.362278+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:26:35.362278+0000","last_peered":"2026-02-24T08:26:35.362278+0000","last_clean":"2026-02-24T08:26:35.362278+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:26:35.362278+0000","last_undegraded":"2026-02-24T08:26:35.362278+0000","last_fullsized":"2026-02-24T08:26:35.362278+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7064,"log_dups_size":0,"ondisk_log_size":7064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57868288,"num_objects":883,"num_object_clones":0,"num_object_copies":2649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7064,"num_write_kb":56512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"65'7408","reported_seq":7422,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:35.507259+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:26:35.507259+0000","last_peered":"2026-02-24T08:26:35.507259+0000","last_clean":"2026-02-24T08:26:35.507259+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:26:35.507259+0000","last_undegraded":"2026-02-24T08:26:35.507259+0000","last_fullsized":"2026-02-24T08:26:35.507259+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7408,"log_dups_size":0,"ondisk_log_size":7408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60686336,"num_objects":926,"num_object_clones":0,"num_object_copies":2778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":926,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7408,"num_write_kb":59264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:34.981400+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:26:34.981400+0000","last_peered":"2026-02-24T08:26:34.981400+0000","last_clean":"2026-02-24T08:26:34.981400+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:26:34.981400+0000","last_undegraded":"2026-02-24T08:26:34.981400+0000","last_fullsized":"2026-02-24T08:26:34.981400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":946216960,"num_objects":14443,"num_object_clones":0,"num_object_copies":43329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115505,"num_write_kb":924040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2844467200,"data_stored":2844467200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115505,"ondisk_log_size":115505,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1761,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247885,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1721924,"kb_used_data":806640,"kb_used_omap":4,"kb_used_meta":915259,"kb_avail":732281276,"statfs":{"total":751619276800,"available":749856026624,"internally_reserved":0,"allocated":825999360,"data_stored":825611740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4534,"internal_metadata":937225802},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1658516,"kb_used_data":613824,"kb_used_omap":8,"kb_used_meta":1044663,"kb_avail":732344684,"statfs":{"total":751619276800,"available":749920956416,"internally_reserved":0,"allocated":628555776,"data_stored":628168156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8362,"internal_metadata":1069735766},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2258920,"kb_used_data":585812,"kb_used_omap":40,"kb_used_meta":1673047,"kb_avail":731744280,"statfs":{"total":751619276800,"available":749306142720,"internally_reserved":0,"allocated":599871488,"data_stored":599487420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41336,"internal_metadata":1713200776},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1639036,"kb_used_data":721832,"kb_used_omap":4,"kb_used_meta":917179,"kb_avail":732364164,"statfs":{"total":751619276800,"available":749940903936,"internally_reserved":0,"allocated":739155968,"data_stored":738768348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4458,"internal_metadata":939191958},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1761,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":762388480,"data_stored":762388480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":606478336,"data_stored":606478336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":649003008,"data_stored":649003008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":826597376,"data_stored":826597376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:26:38.492 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_3 pgp_num 36 2026-02-24T08:26:38.688 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:38.823 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:38.821+0000 7fd4e7f12640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:38.823 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:38.821+0000 7fd4e7f12640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:38.981 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:26:39.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:26:39.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:26:39.156914+0000 min lat: 0.000698887 max lat: 0.143724 avg lat: 0.0192782 2026-02-24T08:26:39.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:26:39.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 20 128 132657 132529 51.7651 35.4688 0.0286982 0.0192782 2026-02-24T08:26:39.843 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:26:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:26:39.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:26:39.893 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:39.918 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:39 trial105 ceph-mon[39442]: from='client.14941 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:26:39.918 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:39 trial105 ceph-mon[39442]: pgmap v227: 17 pgs: 17 active+clean; 903 MiB data, 6.9 GiB used, 2.7 TiB / 2.7 TiB avail; 40 MiB/s wr, 5.13k op/s 2026-02-24T08:26:39.918 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:39 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2864899364' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pgp_num", "val": "36"} : dispatch 2026-02-24T08:26:39.918 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:26:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:26:39] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-24T08:26:40.037 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:40.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 21 128 136955 136827 50.8989 33.5781 0.00485907 0.0196143 2026-02-24T08:26:40.162 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:40.159+0000 7f8aa03b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:40.163 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:40.160+0000 7f8aa03b0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:40.181 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:40.181 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:40.197 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:40.197 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:40.212 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:40.212 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:40.226 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:40.226 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:41.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 22 128 141082 140954 50.0508 32.2422 0.0171548 0.0199515 2026-02-24T08:26:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3004347048' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:42.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 23 128 145251 145123 49.2907 32.5703 0.0319118 0.0202709 2026-02-24T08:26:42.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:41 trial105 ceph-mon[39442]: pgmap v228: 17 pgs: 17 active+clean; 1.1 GiB data, 7.6 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 7.03k op/s 2026-02-24T08:26:42.272 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:42.419 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:42.550 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:42.547+0000 7f9f22fa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:42.550 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:42.547+0000 7f9f22fa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:42.566 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:42.566 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:42.580 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:42.580 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:42.593 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:42.593 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:42.608 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:42.608 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:42.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:42 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/516765484' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:43.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 24 128 149236 149108 48.534 31.1328 0.0434989 0.0205866 2026-02-24T08:26:44.024 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:44.024 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:44.025 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:26:44.051 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:43 trial105 ceph-mon[39442]: pgmap v229: 17 pgs: 17 active+clean; 1.1 GiB data, 7.6 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.13k op/s 2026-02-24T08:26:44.158 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 25 128 153180 153052 47.825 30.8125 0.0152385 0.0208838 2026-02-24T08:26:44.169 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:44.504 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:44.501+0000 7f18a13f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:44.505 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:44.501+0000 7f18a13f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:44.654 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:44.665 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:26:44.666 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:26:44.717 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2026-02-24T08:26:42.739587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1133601312,"num_objects":17292,"num_object_clones":0,"num_object_copies":51876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17292,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":138442,"num_write_kb":1108606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138406,"ondisk_log_size":138406,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7988220,"kb_used_data":3257452,"kb_used_omap":57,"kb_used_meta":4730630,"kb_avail":2928024580,"statfs":{"total":3006477107200,"available":2998297169920,"internally_reserved":0,"allocated":3335630848,"data_stored":3334083920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58690,"internal_metadata":4844165822},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,6,29,18,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":405700608,"num_objects":6188,"num_object_clones":0,"num_object_copies":18564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49524,"num_write_kb":396192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001791"},"pg_stats":[{"pgid":"5.f","version":"65'8448","reported_seq":8462,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.508277+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:26:40.508277+0000","last_peered":"2026-02-24T08:26:40.508277+0000","last_clean":"2026-02-24T08:26:40.508277+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:26:40.508277+0000","last_undegraded":"2026-02-24T08:26:40.508277+0000","last_fullsized":"2026-02-24T08:26:40.508277+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8448,"log_dups_size":0,"ondisk_log_size":8448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69206016,"num_objects":1056,"num_object_clones":0,"num_object_copies":3168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1056,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8448,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"65'8621","reported_seq":8629,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.560177+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:26:40.560177+0000","last_peered":"2026-02-24T08:26:40.560177+0000","last_clean":"2026-02-24T08:26:40.560177+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:26:40.560177+0000","last_undegraded":"2026-02-24T08:26:40.560177+0000","last_fullsized":"2026-02-24T08:26:40.560177+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8621,"log_dups_size":0,"ondisk_log_size":8621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70623232,"num_objects":1078,"num_object_clones":0,"num_object_copies":3234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8621,"num_write_kb":68968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"65'7960","reported_seq":7974,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.373992+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:26:40.373992+0000","last_peered":"2026-02-24T08:26:40.373992+0000","last_clean":"2026-02-24T08:26:40.373992+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:26:40.373992+0000","last_undegraded":"2026-02-24T08:26:40.373992+0000","last_fullsized":"2026-02-24T08:26:40.373992+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":7960,"log_dups_size":0,"ondisk_log_size":7960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65208320,"num_objects":995,"num_object_clones":0,"num_object_copies":2985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7960,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'9184","reported_seq":9198,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.540549+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:26:40.540549+0000","last_peered":"2026-02-24T08:26:40.540549+0000","last_clean":"2026-02-24T08:26:40.540549+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:26:40.540549+0000","last_undegraded":"2026-02-24T08:26:40.540549+0000","last_fullsized":"2026-02-24T08:26:40.540549+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9184,"log_dups_size":0,"ondisk_log_size":9184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75235328,"num_objects":1148,"num_object_clones":0,"num_object_copies":3444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9184,"num_write_kb":73472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"65'8248","reported_seq":8262,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.294246+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:26:40.294246+0000","last_peered":"2026-02-24T08:26:40.294246+0000","last_clean":"2026-02-24T08:26:40.294246+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:26:40.294246+0000","last_undegraded":"2026-02-24T08:26:40.294246+0000","last_fullsized":"2026-02-24T08:26:40.294246+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8248,"log_dups_size":0,"ondisk_log_size":8248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67567616,"num_objects":1031,"num_object_clones":0,"num_object_copies":3093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8248,"num_write_kb":65984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"65'8720","reported_seq":8734,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.343686+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:26:40.343686+0000","last_peered":"2026-02-24T08:26:40.343686+0000","last_clean":"2026-02-24T08:26:40.343686+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:26:40.343686+0000","last_undegraded":"2026-02-24T08:26:40.343686+0000","last_fullsized":"2026-02-24T08:26:40.343686+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8720,"log_dups_size":0,"ondisk_log_size":8720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71434240,"num_objects":1090,"num_object_clones":0,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1090,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8720,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"65'8432","reported_seq":8446,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.555149+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:26:40.555149+0000","last_peered":"2026-02-24T08:26:40.555149+0000","last_clean":"2026-02-24T08:26:40.555149+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:26:40.555149+0000","last_undegraded":"2026-02-24T08:26:40.555149+0000","last_fullsized":"2026-02-24T08:26:40.555149+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8432,"log_dups_size":0,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69074944,"num_objects":1054,"num_object_clones":0,"num_object_copies":3162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1054,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8432,"num_write_kb":67456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"65'8859","reported_seq":8872,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.373350+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:26:40.373350+0000","last_peered":"2026-02-24T08:26:40.373350+0000","last_clean":"2026-02-24T08:26:40.373350+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:26:40.373350+0000","last_undegraded":"2026-02-24T08:26:40.373350+0000","last_fullsized":"2026-02-24T08:26:40.373350+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8859,"log_dups_size":0,"ondisk_log_size":8859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72572928,"num_objects":1108,"num_object_clones":0,"num_object_copies":3324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8859,"num_write_kb":70872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"65'8907","reported_seq":8914,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.555563+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:26:40.555563+0000","last_peered":"2026-02-24T08:26:40.555563+0000","last_clean":"2026-02-24T08:26:40.555563+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:26:40.555563+0000","last_undegraded":"2026-02-24T08:26:40.555563+0000","last_fullsized":"2026-02-24T08:26:40.555563+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8907,"log_dups_size":0,"ondisk_log_size":8907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72966144,"num_objects":1114,"num_object_clones":0,"num_object_copies":3342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8907,"num_write_kb":71256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"65'9400","reported_seq":9414,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.678435+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:26:40.678435+0000","last_peered":"2026-02-24T08:26:40.678435+0000","last_clean":"2026-02-24T08:26:40.678435+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:26:40.678435+0000","last_undegraded":"2026-02-24T08:26:40.678435+0000","last_fullsized":"2026-02-24T08:26:40.678435+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9400,"log_dups_size":0,"ondisk_log_size":9400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77004800,"num_objects":1175,"num_object_clones":0,"num_object_copies":3525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9400,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"65'8416","reported_seq":8430,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.362204+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:26:40.362204+0000","last_peered":"2026-02-24T08:26:40.362204+0000","last_clean":"2026-02-24T08:26:40.362204+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:26:40.362204+0000","last_undegraded":"2026-02-24T08:26:40.362204+0000","last_fullsized":"2026-02-24T08:26:40.362204+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8416,"log_dups_size":0,"ondisk_log_size":8416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68943872,"num_objects":1052,"num_object_clones":0,"num_object_copies":3156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8416,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"65'8344","reported_seq":8358,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.359601+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:26:40.359601+0000","last_peered":"2026-02-24T08:26:40.359601+0000","last_clean":"2026-02-24T08:26:40.359601+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:26:40.359601+0000","last_undegraded":"2026-02-24T08:26:40.359601+0000","last_fullsized":"2026-02-24T08:26:40.359601+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8344,"log_dups_size":0,"ondisk_log_size":8344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68354048,"num_objects":1043,"num_object_clones":0,"num_object_copies":3129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8344,"num_write_kb":66752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"65'8328","reported_seq":8342,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.393988+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:26:40.393988+0000","last_peered":"2026-02-24T08:26:40.393988+0000","last_clean":"2026-02-24T08:26:40.393988+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:26:40.393988+0000","last_undegraded":"2026-02-24T08:26:40.393988+0000","last_fullsized":"2026-02-24T08:26:40.393988+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8328,"log_dups_size":0,"ondisk_log_size":8328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68222976,"num_objects":1041,"num_object_clones":0,"num_object_copies":3123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1041,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8328,"num_write_kb":66624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'9184","reported_seq":9198,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.536977+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:26:40.536977+0000","last_peered":"2026-02-24T08:26:40.536977+0000","last_clean":"2026-02-24T08:26:40.536977+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:26:40.536977+0000","last_undegraded":"2026-02-24T08:26:40.536977+0000","last_fullsized":"2026-02-24T08:26:40.536977+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9184,"log_dups_size":0,"ondisk_log_size":9184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75235328,"num_objects":1148,"num_object_clones":0,"num_object_copies":3444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9184,"num_write_kb":73472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"65'8488","reported_seq":8502,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.367561+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:26:40.367561+0000","last_peered":"2026-02-24T08:26:40.367561+0000","last_clean":"2026-02-24T08:26:40.367561+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:26:40.367561+0000","last_undegraded":"2026-02-24T08:26:40.367561+0000","last_fullsized":"2026-02-24T08:26:40.367561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8488,"log_dups_size":0,"ondisk_log_size":8488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69533696,"num_objects":1061,"num_object_clones":0,"num_object_copies":3183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":67904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"65'8768","reported_seq":8782,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:40.494408+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:26:40.494408+0000","last_peered":"2026-02-24T08:26:40.494408+0000","last_clean":"2026-02-24T08:26:40.494408+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:26:40.494408+0000","last_undegraded":"2026-02-24T08:26:40.494408+0000","last_fullsized":"2026-02-24T08:26:40.494408+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":8768,"log_dups_size":0,"ondisk_log_size":8768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71827456,"num_objects":1096,"num_object_clones":0,"num_object_copies":3288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8768,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:34.981400+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:26:34.981400+0000","last_peered":"2026-02-24T08:26:34.981400+0000","last_clean":"2026-02-24T08:26:34.981400+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:26:34.981400+0000","last_undegraded":"2026-02-24T08:26:34.981400+0000","last_fullsized":"2026-02-24T08:26:34.981400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1133010944,"num_objects":17290,"num_object_clones":0,"num_object_copies":51870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138307,"num_write_kb":1106456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3401990144,"data_stored":3401990144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138307,"ondisk_log_size":138307,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1761,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1909692,"kb_used_data":940264,"kb_used_omap":4,"kb_used_meta":969403,"kb_avail":732093508,"statfs":{"total":751619276800,"available":749663752192,"internally_reserved":0,"allocated":962830336,"data_stored":962442716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4534,"internal_metadata":992669258},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1805220,"kb_used_data":742480,"kb_used_omap":8,"kb_used_meta":1062711,"kb_avail":732197980,"statfs":{"total":751619276800,"available":749770731520,"internally_reserved":0,"allocated":760299520,"data_stored":759911900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8362,"internal_metadata":1088216918},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2428080,"kb_used_data":700828,"kb_used_omap":40,"kb_used_meta":1727191,"kb_avail":731575120,"statfs":{"total":751619276800,"available":749132922880,"internally_reserved":0,"allocated":717647872,"data_stored":717263804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41336,"internal_metadata":1768644232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1845228,"kb_used_data":873880,"kb_used_omap":4,"kb_used_meta":971323,"kb_avail":732157972,"statfs":{"total":751619276800,"available":749729763328,"internally_reserved":0,"allocated":894853120,"data_stored":894465500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4458,"internal_metadata":994635414},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,6,29,18,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1761,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":912719872,"data_stored":912719872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":723460096,"data_stored":723460096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":776306688,"data_stored":776306688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":989503488,"data_stored":989503488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:26:44.802 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:44.926 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:44.923+0000 7f1b2a5b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:44.926 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:44.923+0000 7f1b2a5b9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:44.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:26:44.941 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:44.941 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:44.955 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:44.955 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:44.967 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:44.967 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:44.981 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:44.981 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:45.159 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 26 128 156625 156497 47.0207 26.9141 0.0814677 0.0212453 2026-02-24T08:26:46.159 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 27 127 160301 160174 46.343 28.7266 0.00924514 0.0215622 2026-02-24T08:26:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:45 trial105 ceph-mon[39442]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:26:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:45 trial105 ceph-mon[39442]: pgmap v230: 17 pgs: 17 active+clean; 1.1 GiB data, 7.6 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.13k op/s 2026-02-24T08:26:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2385793821' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:47.028 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:47.159 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 28 128 163975 163847 45.7127 28.6953 0.0173617 0.0218573 2026-02-24T08:26:47.171 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:47.295 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:47.291+0000 7f262bf75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:47.295 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:47.291+0000 7f262bf75640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:47.309 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:47.309 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:47.322 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:47.322 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:47.334 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:47.335 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:47.346 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:47.346 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:48.159 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 29 128 167620 167492 45.1183 28.4766 0.0261162 0.0221338 2026-02-24T08:26:48.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:47 trial105 ceph-mon[39442]: pgmap v231: 17 pgs: 17 active+clean; 1.2 GiB data, 8.2 GiB used, 2.7 TiB / 2.7 TiB avail; 45 MiB/s wr, 5.75k op/s 2026-02-24T08:26:48.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:47 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3186110922' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:49.159 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 30 128 171046 170918 44.5064 26.7656 0.022967 0.0224482 2026-02-24T08:26:49.388 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:49.540 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:49.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:26:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:26:49] "GET /metrics HTTP/1.1" 200 4216 "" "Prometheus/3.6.0" 2026-02-24T08:26:49.718 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:49.718 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:49.719 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T08:26:49.719 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:26:49.757 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:49.753+0000 7f08e4a28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:49.757 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:49.753+0000 7f08e4a28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:49.774 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:49.774 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:49.789 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:49.789 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:49.804 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:49.804 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:49.818 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:49.818 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:26:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:26:49.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:26:49.981 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:50.079 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:49 trial105 ceph-mon[39442]: pgmap v232: 17 pgs: 17 active+clean; 1.2 GiB data, 8.2 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.53k op/s 2026-02-24T08:26:50.079 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1744231388' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:50.159 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 31 128 174302 174174 43.8913 25.4375 0.014456 0.0227672 2026-02-24T08:26:50.210 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:50.206+0000 7f9e9e9a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:50.210 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:50.206+0000 7f9e9e9a8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:50.364 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:26:50.364 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:26:50.408 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2026-02-24T08:26:48.740386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1293509152,"num_objects":19733,"num_object_clones":0,"num_object_copies":59199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19733,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":157962,"num_write_kb":1264766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156726,"ondisk_log_size":156726,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8571996,"kb_used_data":3732940,"kb_used_omap":57,"kb_used_meta":4838918,"kb_avail":2927440804,"statfs":{"total":3006477107200,"available":2997699383296,"internally_reserved":0,"allocated":3822530560,"data_stored":3820983632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58690,"internal_metadata":4955052734},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,6,10,22,33,25,46,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":346701824,"num_objects":5288,"num_object_clones":0,"num_object_copies":15864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42322,"num_write_kb":338576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001741"},"pg_stats":[{"pgid":"5.f","version":"65'9713","reported_seq":9726,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.529325+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:26:45.529325+0000","last_peered":"2026-02-24T08:26:45.529325+0000","last_clean":"2026-02-24T08:26:45.529325+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:26:45.529325+0000","last_undegraded":"2026-02-24T08:26:45.529325+0000","last_fullsized":"2026-02-24T08:26:45.529325+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9713,"log_dups_size":0,"ondisk_log_size":9713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79568896,"num_objects":1215,"num_object_clones":0,"num_object_copies":3645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9713,"num_write_kb":77704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"65'9880","reported_seq":9894,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.549221+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:26:45.549221+0000","last_peered":"2026-02-24T08:26:45.549221+0000","last_clean":"2026-02-24T08:26:45.549221+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:26:45.549221+0000","last_undegraded":"2026-02-24T08:26:45.549221+0000","last_fullsized":"2026-02-24T08:26:45.549221+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9880,"log_dups_size":0,"ondisk_log_size":9880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80936960,"num_objects":1235,"num_object_clones":0,"num_object_copies":3705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1235,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9880,"num_write_kb":79040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"65'9144","reported_seq":9158,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.348347+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:26:45.348347+0000","last_peered":"2026-02-24T08:26:45.348347+0000","last_clean":"2026-02-24T08:26:45.348347+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:26:45.348347+0000","last_undegraded":"2026-02-24T08:26:45.348347+0000","last_fullsized":"2026-02-24T08:26:45.348347+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9144,"log_dups_size":0,"ondisk_log_size":9144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74907648,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9144,"num_write_kb":73152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'10214","reported_seq":10215,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.728641+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:26:45.728641+0000","last_peered":"2026-02-24T08:26:45.728641+0000","last_clean":"2026-02-24T08:26:45.728641+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:26:45.728641+0000","last_undegraded":"2026-02-24T08:26:45.728641+0000","last_fullsized":"2026-02-24T08:26:45.728641+0000","mapping_epoch":63,"log_start":"65'200","ondisk_log_start":"65'200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83673088,"num_objects":1277,"num_object_clones":0,"num_object_copies":3831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10214,"num_write_kb":81712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"65'9480","reported_seq":9494,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.347077+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:26:45.347077+0000","last_peered":"2026-02-24T08:26:45.347077+0000","last_clean":"2026-02-24T08:26:45.347077+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:26:45.347077+0000","last_undegraded":"2026-02-24T08:26:45.347077+0000","last_fullsized":"2026-02-24T08:26:45.347077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9480,"log_dups_size":0,"ondisk_log_size":9480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77660160,"num_objects":1185,"num_object_clones":0,"num_object_copies":3555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9480,"num_write_kb":75840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"65'10136","reported_seq":10146,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.388531+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:26:45.388531+0000","last_peered":"2026-02-24T08:26:45.388531+0000","last_clean":"2026-02-24T08:26:45.388531+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:26:45.388531+0000","last_undegraded":"2026-02-24T08:26:45.388531+0000","last_fullsized":"2026-02-24T08:26:45.388531+0000","mapping_epoch":63,"log_start":"65'100","ondisk_log_start":"65'100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83034112,"num_objects":1267,"num_object_clones":0,"num_object_copies":3801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10136,"num_write_kb":81088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"65'9568","reported_seq":9582,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.551215+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:26:45.551215+0000","last_peered":"2026-02-24T08:26:45.551215+0000","last_clean":"2026-02-24T08:26:45.551215+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:26:45.551215+0000","last_undegraded":"2026-02-24T08:26:45.551215+0000","last_fullsized":"2026-02-24T08:26:45.551215+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9568,"log_dups_size":0,"ondisk_log_size":9568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78381056,"num_objects":1196,"num_object_clones":0,"num_object_copies":3588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9568,"num_write_kb":76544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"65'10096","reported_seq":10110,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.378572+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:26:45.378572+0000","last_peered":"2026-02-24T08:26:45.378572+0000","last_clean":"2026-02-24T08:26:45.378572+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:26:45.378572+0000","last_undegraded":"2026-02-24T08:26:45.378572+0000","last_fullsized":"2026-02-24T08:26:45.378572+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82706432,"num_objects":1262,"num_object_clones":0,"num_object_copies":3786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10096,"num_write_kb":80768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"65'10176","reported_seq":10190,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.577731+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:26:45.577731+0000","last_peered":"2026-02-24T08:26:45.577731+0000","last_clean":"2026-02-24T08:26:45.577731+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:26:45.577731+0000","last_undegraded":"2026-02-24T08:26:45.577731+0000","last_fullsized":"2026-02-24T08:26:45.577731+0000","mapping_epoch":63,"log_start":"65'100","ondisk_log_start":"65'100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83361792,"num_objects":1272,"num_object_clones":0,"num_object_copies":3816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1272,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10176,"num_write_kb":81408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"65'10488","reported_seq":10502,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.730598+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:26:45.730598+0000","last_peered":"2026-02-24T08:26:45.730598+0000","last_clean":"2026-02-24T08:26:45.730598+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:26:45.730598+0000","last_undegraded":"2026-02-24T08:26:45.730598+0000","last_fullsized":"2026-02-24T08:26:45.730598+0000","mapping_epoch":63,"log_start":"65'400","ondisk_log_start":"65'400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85917696,"num_objects":1311,"num_object_clones":0,"num_object_copies":3933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10488,"num_write_kb":83904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"65'9652","reported_seq":9662,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.387623+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:26:45.387623+0000","last_peered":"2026-02-24T08:26:45.387623+0000","last_clean":"2026-02-24T08:26:45.387623+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:26:45.387623+0000","last_undegraded":"2026-02-24T08:26:45.387623+0000","last_fullsized":"2026-02-24T08:26:45.387623+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9652,"log_dups_size":0,"ondisk_log_size":9652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79069184,"num_objects":1207,"num_object_clones":0,"num_object_copies":3621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9652,"num_write_kb":77216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"65'9728","reported_seq":9742,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.386600+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:26:45.386600+0000","last_peered":"2026-02-24T08:26:45.386600+0000","last_clean":"2026-02-24T08:26:45.386600+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:26:45.386600+0000","last_undegraded":"2026-02-24T08:26:45.386600+0000","last_fullsized":"2026-02-24T08:26:45.386600+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9728,"log_dups_size":0,"ondisk_log_size":9728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":1216,"num_object_clones":0,"num_object_copies":3648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9728,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"65'9520","reported_seq":9534,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.465991+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:26:45.465991+0000","last_peered":"2026-02-24T08:26:45.465991+0000","last_clean":"2026-02-24T08:26:45.465991+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:26:45.465991+0000","last_undegraded":"2026-02-24T08:26:45.465991+0000","last_fullsized":"2026-02-24T08:26:45.465991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9520,"log_dups_size":0,"ondisk_log_size":9520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77987840,"num_objects":1190,"num_object_clones":0,"num_object_copies":3570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9520,"num_write_kb":76160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'10475","reported_seq":10487,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.573860+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:26:45.573860+0000","last_peered":"2026-02-24T08:26:45.573860+0000","last_clean":"2026-02-24T08:26:45.573860+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:26:45.573860+0000","last_undegraded":"2026-02-24T08:26:45.573860+0000","last_fullsized":"2026-02-24T08:26:45.573860+0000","mapping_epoch":63,"log_start":"65'400","ondisk_log_start":"65'400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85811200,"num_objects":1310,"num_object_clones":0,"num_object_copies":3930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10475,"num_write_kb":83800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"65'9536","reported_seq":9550,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.360015+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:26:45.360015+0000","last_peered":"2026-02-24T08:26:45.360015+0000","last_clean":"2026-02-24T08:26:45.360015+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:26:45.360015+0000","last_undegraded":"2026-02-24T08:26:45.360015+0000","last_fullsized":"2026-02-24T08:26:45.360015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":9536,"log_dups_size":0,"ondisk_log_size":9536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78118912,"num_objects":1192,"num_object_clones":0,"num_object_copies":3576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9536,"num_write_kb":76288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"65'10021","reported_seq":10034,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:45.528579+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:26:45.528579+0000","last_peered":"2026-02-24T08:26:45.528579+0000","last_clean":"2026-02-24T08:26:45.528579+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:26:45.528579+0000","last_undegraded":"2026-02-24T08:26:45.528579+0000","last_fullsized":"2026-02-24T08:26:45.528579+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82092032,"num_objects":1253,"num_object_clones":0,"num_object_copies":3759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10021,"num_write_kb":80168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:34.981400+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:26:34.981400+0000","last_peered":"2026-02-24T08:26:34.981400+0000","last_clean":"2026-02-24T08:26:34.981400+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:26:34.981400+0000","last_undegraded":"2026-02-24T08:26:34.981400+0000","last_fullsized":"2026-02-24T08:26:34.981400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1292918784,"num_objects":19731,"num_object_clones":0,"num_object_copies":59193,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157827,"num_write_kb":1262616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3881476096,"data_stored":3881476096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156627,"ondisk_log_size":156627,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1761,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247887,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2070988,"kb_used_data":1083512,"kb_used_omap":4,"kb_used_meta":987451,"kb_avail":731932212,"statfs":{"total":751619276800,"available":749498585088,"internally_reserved":0,"allocated":1109516288,"data_stored":1109128668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4534,"internal_metadata":1011150410},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,0,2,11,1,16,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1933036,"kb_used_data":852248,"kb_used_omap":8,"kb_used_meta":1080759,"kb_avail":732070164,"statfs":{"total":751619276800,"available":749639847936,"internally_reserved":0,"allocated":872701952,"data_stored":872314332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8362,"internal_metadata":1106698070},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,6,1,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2559432,"kb_used_data":796084,"kb_used_omap":40,"kb_used_meta":1763287,"kb_avail":731443768,"statfs":{"total":751619276800,"available":748998418432,"internally_reserved":0,"allocated":815190016,"data_stored":814805948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41336,"internal_metadata":1805606536},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,3,3,6,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705749,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2008540,"kb_used_data":1001096,"kb_used_omap":4,"kb_used_meta":1007419,"kb_avail":731994660,"statfs":{"total":751619276800,"available":749562531840,"internally_reserved":0,"allocated":1025122304,"data_stored":1024734684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4458,"internal_metadata":1031597718},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,1,16,16,17,30],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1761,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1044578304,"data_stored":1044578304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":820789248,"data_stored":820789248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":883302400,"data_stored":883302400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1132806144,"data_stored":1132806144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:26:50.409 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:26:50.409 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 46 2026-02-24T08:26:50.545 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:50.679 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:50.676+0000 7f1660766640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:50.680 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:50.676+0000 7f1660766640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:50.833 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:26:50.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:26:51.159 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 32 128 177768 177640 43.3658 27.0781 0.0365551 0.0230412 2026-02-24T08:26:52.109 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:52.131 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:51 trial105 ceph-mon[39442]: from='client.14957 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:26:52.131 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:51 trial105 ceph-mon[39442]: pgmap v233: 17 pgs: 17 active+clean; 1.3 GiB data, 8.6 GiB used, 2.7 TiB / 2.7 TiB avail; 38 MiB/s wr, 4.81k op/s 2026-02-24T08:26:52.131 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4087707186' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T08:26:52.159 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 33 127 181276 181149 42.8824 27.4141 0.129343 0.0232858 2026-02-24T08:26:52.244 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:52.372 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:52.368+0000 7f093d26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:52.372 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:52.368+0000 7f093d26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:52.389 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:52.389 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:52.403 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:52.408 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:52.416 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:52.416 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:52.432 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:52.432 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:53.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 34 128 184678 184550 42.4025 26.5703 0.0228004 0.0235644 2026-02-24T08:26:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:53 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:26:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:53 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:26:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:53 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/671757527' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:53 trial105 ceph-mon[39442]: pgmap v234: 17 pgs: 17 active+clean; 1.3 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.09k op/s 2026-02-24T08:26:54.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 35 128 188222 188094 41.9815 27.6875 0.0146902 0.0238009 2026-02-24T08:26:54.482 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:54.624 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:54.740 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:54.736+0000 7f5f69479640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:54.740 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:54.737+0000 7f5f69479640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:54.760 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:54.761 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:54.776 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:54.776 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:54.790 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:54.791 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:54.805 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:54.805 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:55.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 36 128 191762 191634 41.5835 27.6562 0.0536704 0.0240315 2026-02-24T08:26:55.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/398285617' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:55.874 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:26:55.875 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:26:55.875 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:26:56.019 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:56.078 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:55 trial105 ceph-mon[39442]: pgmap v235: 17 pgs: 17 active+clean; 1.3 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.09k op/s 2026-02-24T08:26:56.158 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:56.154+0000 7f7eb9271640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:56.159 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:56.154+0000 7f7eb9271640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:56.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 37 128 195456 195328 41.2395 28.8594 0.0272661 0.0242312 2026-02-24T08:26:56.313 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:26:56.314 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:26:56.361 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2026-02-24T08:26:54.741232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1437884960,"num_objects":21936,"num_object_clones":0,"num_object_copies":65808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21936,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":175586,"num_write_kb":1405758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161050,"ondisk_log_size":161050,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9075820,"kb_used_data":4160284,"kb_used_omap":57,"kb_used_meta":4915398,"kb_avail":2926936980,"statfs":{"total":3006477107200,"available":2997183467520,"internally_reserved":0,"allocated":4260130816,"data_stored":4258583888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58690,"internal_metadata":5033368254},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,1,9,9,3,30,34],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":304283648,"num_objects":4644,"num_object_clones":0,"num_object_copies":13932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37144,"num_write_kb":297152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001644"},"pg_stats":[{"pgid":"5.f","version":"65'10736","reported_seq":10750,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.521297+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:26:50.521297+0000","last_peered":"2026-02-24T08:26:50.521297+0000","last_clean":"2026-02-24T08:26:50.521297+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:26:50.521297+0000","last_undegraded":"2026-02-24T08:26:50.521297+0000","last_fullsized":"2026-02-24T08:26:50.521297+0000","mapping_epoch":63,"log_start":"65'700","ondisk_log_start":"65'700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87949312,"num_objects":1342,"num_object_clones":0,"num_object_copies":4026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10736,"num_write_kb":85888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"65'11088","reported_seq":11094,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.585561+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:26:50.585561+0000","last_peered":"2026-02-24T08:26:50.585561+0000","last_clean":"2026-02-24T08:26:50.585561+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:26:50.585561+0000","last_undegraded":"2026-02-24T08:26:50.585561+0000","last_fullsized":"2026-02-24T08:26:50.585561+0000","mapping_epoch":63,"log_start":"65'1000","ondisk_log_start":"65'1000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90832896,"num_objects":1386,"num_object_clones":0,"num_object_copies":4158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1386,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11088,"num_write_kb":88704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"65'10192","reported_seq":10206,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.401373+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:26:50.401373+0000","last_peered":"2026-02-24T08:26:50.401373+0000","last_clean":"2026-02-24T08:26:50.401373+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:26:50.401373+0000","last_undegraded":"2026-02-24T08:26:50.401373+0000","last_fullsized":"2026-02-24T08:26:50.401373+0000","mapping_epoch":63,"log_start":"65'100","ondisk_log_start":"65'100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83492864,"num_objects":1274,"num_object_clones":0,"num_object_copies":3822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10192,"num_write_kb":81536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'11294","reported_seq":11302,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.753104+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:26:50.753104+0000","last_peered":"2026-02-24T08:26:50.753104+0000","last_clean":"2026-02-24T08:26:50.753104+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:26:50.753104+0000","last_undegraded":"2026-02-24T08:26:50.753104+0000","last_fullsized":"2026-02-24T08:26:50.753104+0000","mapping_epoch":63,"log_start":"65'1200","ondisk_log_start":"65'1200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92520448,"num_objects":1412,"num_object_clones":0,"num_object_copies":4236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11294,"num_write_kb":90352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"65'10422","reported_seq":10436,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.402791+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:26:50.402791+0000","last_peered":"2026-02-24T08:26:50.402791+0000","last_clean":"2026-02-24T08:26:50.402791+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:26:50.402791+0000","last_undegraded":"2026-02-24T08:26:50.402791+0000","last_fullsized":"2026-02-24T08:26:50.402791+0000","mapping_epoch":63,"log_start":"65'400","ondisk_log_start":"65'400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85377024,"num_objects":1303,"num_object_clones":0,"num_object_copies":3909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1303,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10422,"num_write_kb":83376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"65'11184","reported_seq":11198,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.347789+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:26:50.347789+0000","last_peered":"2026-02-24T08:26:50.347789+0000","last_clean":"2026-02-24T08:26:50.347789+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:26:50.347789+0000","last_undegraded":"2026-02-24T08:26:50.347789+0000","last_fullsized":"2026-02-24T08:26:50.347789+0000","mapping_epoch":63,"log_start":"65'1100","ondisk_log_start":"65'1100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91619328,"num_objects":1398,"num_object_clones":0,"num_object_copies":4194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11184,"num_write_kb":89472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"65'10584","reported_seq":10598,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.550823+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:26:50.550823+0000","last_peered":"2026-02-24T08:26:50.550823+0000","last_clean":"2026-02-24T08:26:50.550823+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:26:50.550823+0000","last_undegraded":"2026-02-24T08:26:50.550823+0000","last_fullsized":"2026-02-24T08:26:50.550823+0000","mapping_epoch":63,"log_start":"65'500","ondisk_log_start":"65'500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86704128,"num_objects":1323,"num_object_clones":0,"num_object_copies":3969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10584,"num_write_kb":84672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"65'11224","reported_seq":11238,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.389280+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:26:50.389280+0000","last_peered":"2026-02-24T08:26:50.389280+0000","last_clean":"2026-02-24T08:26:50.389280+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:26:50.389280+0000","last_undegraded":"2026-02-24T08:26:50.389280+0000","last_fullsized":"2026-02-24T08:26:50.389280+0000","mapping_epoch":63,"log_start":"65'1200","ondisk_log_start":"65'1200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91947008,"num_objects":1403,"num_object_clones":0,"num_object_copies":4209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11224,"num_write_kb":89792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"65'11417","reported_seq":11429,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.586336+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:26:50.586336+0000","last_peered":"2026-02-24T08:26:50.586336+0000","last_clean":"2026-02-24T08:26:50.586336+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:26:50.586336+0000","last_undegraded":"2026-02-24T08:26:50.586336+0000","last_fullsized":"2026-02-24T08:26:50.586336+0000","mapping_epoch":63,"log_start":"65'1400","ondisk_log_start":"65'1400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93528064,"num_objects":1428,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11417,"num_write_kb":91336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"65'11667","reported_seq":11681,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.739053+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:26:50.739053+0000","last_peered":"2026-02-24T08:26:50.739053+0000","last_clean":"2026-02-24T08:26:50.739053+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:26:50.739053+0000","last_undegraded":"2026-02-24T08:26:50.739053+0000","last_fullsized":"2026-02-24T08:26:50.739053+0000","mapping_epoch":63,"log_start":"65'1600","ondisk_log_start":"65'1600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95576064,"num_objects":1459,"num_object_clones":0,"num_object_copies":4377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11667,"num_write_kb":93336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"65'10712","reported_seq":10726,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.348189+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:26:50.348189+0000","last_peered":"2026-02-24T08:26:50.348189+0000","last_clean":"2026-02-24T08:26:50.348189+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:26:50.348189+0000","last_undegraded":"2026-02-24T08:26:50.348189+0000","last_fullsized":"2026-02-24T08:26:50.348189+0000","mapping_epoch":63,"log_start":"65'700","ondisk_log_start":"65'700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87752704,"num_objects":1339,"num_object_clones":0,"num_object_copies":4017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1339,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10712,"num_write_kb":85696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"65'10968","reported_seq":10982,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.384397+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:26:50.384397+0000","last_peered":"2026-02-24T08:26:50.384397+0000","last_clean":"2026-02-24T08:26:50.384397+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:26:50.384397+0000","last_undegraded":"2026-02-24T08:26:50.384397+0000","last_fullsized":"2026-02-24T08:26:50.384397+0000","mapping_epoch":63,"log_start":"65'900","ondisk_log_start":"65'900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89849856,"num_objects":1371,"num_object_clones":0,"num_object_copies":4113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10968,"num_write_kb":87744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"65'10664","reported_seq":10676,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.580300+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:26:50.580300+0000","last_peered":"2026-02-24T08:26:50.580300+0000","last_clean":"2026-02-24T08:26:50.580300+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:26:50.580300+0000","last_undegraded":"2026-02-24T08:26:50.580300+0000","last_fullsized":"2026-02-24T08:26:50.580300+0000","mapping_epoch":63,"log_start":"65'600","ondisk_log_start":"65'600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87359488,"num_objects":1333,"num_object_clones":0,"num_object_copies":3999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10664,"num_write_kb":85312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'11760","reported_seq":11771,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.584122+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:26:50.584122+0000","last_peered":"2026-02-24T08:26:50.584122+0000","last_clean":"2026-02-24T08:26:50.584122+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:26:50.584122+0000","last_undegraded":"2026-02-24T08:26:50.584122+0000","last_fullsized":"2026-02-24T08:26:50.584122+0000","mapping_epoch":63,"log_start":"65'1700","ondisk_log_start":"65'1700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96337920,"num_objects":1470,"num_object_clones":0,"num_object_copies":4410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11760,"num_write_kb":94080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"65'10566","reported_seq":10577,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.398678+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:26:50.398678+0000","last_peered":"2026-02-24T08:26:50.398678+0000","last_clean":"2026-02-24T08:26:50.398678+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:26:50.398678+0000","last_undegraded":"2026-02-24T08:26:50.398678+0000","last_fullsized":"2026-02-24T08:26:50.398678+0000","mapping_epoch":63,"log_start":"65'500","ondisk_log_start":"65'500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86556672,"num_objects":1321,"num_object_clones":0,"num_object_copies":3963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1321,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10566,"num_write_kb":84528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"65'10973","reported_seq":10984,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:50.542744+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:26:50.542744+0000","last_peered":"2026-02-24T08:26:50.542744+0000","last_clean":"2026-02-24T08:26:50.542744+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:26:50.542744+0000","last_undegraded":"2026-02-24T08:26:50.542744+0000","last_fullsized":"2026-02-24T08:26:50.542744+0000","mapping_epoch":63,"log_start":"65'900","ondisk_log_start":"65'900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89890816,"num_objects":1372,"num_object_clones":0,"num_object_copies":4116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1372,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10973,"num_write_kb":87784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-24T08:26:34.981400+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:26:34.981400+0000","last_peered":"2026-02-24T08:26:34.981400+0000","last_clean":"2026-02-24T08:26:34.981400+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:26:34.981400+0000","last_undegraded":"2026-02-24T08:26:34.981400+0000","last_fullsized":"2026-02-24T08:26:34.981400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1437294592,"num_objects":21934,"num_object_clones":0,"num_object_copies":65802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175451,"num_write_kb":1403608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4314529792,"data_stored":4314529792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160951,"ondisk_log_size":160951,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1761,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247888,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2236572,"kb_used_data":1213000,"kb_used_omap":4,"kb_used_meta":1023547,"kb_avail":731766628,"statfs":{"total":751619276800,"available":749329027072,"internally_reserved":0,"allocated":1242112000,"data_stored":1241724380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4534,"internal_metadata":1048112714},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444114,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2033364,"kb_used_data":948288,"kb_used_omap":8,"kb_used_meta":1085047,"kb_avail":731969836,"statfs":{"total":751619276800,"available":749537112064,"internally_reserved":0,"allocated":971046912,"data_stored":970659292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8362,"internal_metadata":1111088982},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,4,5,1,7,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2663568,"kb_used_data":882172,"kb_used_omap":40,"kb_used_meta":1781335,"kb_avail":731339632,"statfs":{"total":751619276800,"available":748891783168,"internally_reserved":0,"allocated":903344128,"data_stored":902960060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41336,"internal_metadata":1824087688},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,5,4,2,23,20],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2142316,"kb_used_data":1116824,"kb_used_omap":4,"kb_used_meta":1025467,"kb_avail":731860884,"statfs":{"total":751619276800,"available":749425545216,"internally_reserved":0,"allocated":1143627776,"data_stored":1143240156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4458,"internal_metadata":1050078870},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1761,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1162641408,"data_stored":1162641408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":910835712,"data_stored":910835712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":981311488,"data_stored":981311488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1259741184,"data_stored":1259741184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:26:56.850 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:26:57.001 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:57.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:57.119+0000 7ff4ab6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:57.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:57.120+0000 7ff4ab6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:57.143 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:57.144 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:57.158 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:57.159 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:57.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 38 128 199093 198965 40.902 28.4141 0.0663715 0.024432 2026-02-24T08:26:57.174 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:57.174 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:57.188 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:57.188 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:58.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 39 128 202718 202590 40.5793 28.3203 0.0230254 0.0246267 2026-02-24T08:26:58.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:57 trial105 ceph-mon[39442]: from='client.14965 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:26:58.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:57 trial105 ceph-mon[39442]: pgmap v236: 17 pgs: 17 active+clean; 1.5 GiB data, 7.8 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.56k op/s 2026-02-24T08:26:58.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1469401102' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:26:59.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:26:59.158925+0000 min lat: 0.000698887 max lat: 0.163265 avg lat: 0.0248293 2026-02-24T08:26:59.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:26:59.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 40 128 206241 206113 40.2529 27.5234 0.0240474 0.0248293 2026-02-24T08:26:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:58 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:26:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:58 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:26:59.235 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:26:59.381 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:26:59.503 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:59.500+0000 7f46baf0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:59.503 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:26:59.500+0000 7f46baf0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:26:59.526 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:26:59.527 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:26:59.542 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:26:59.542 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:26:59.558 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:26:59.558 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:26:59.575 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:26:59.576 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:26:59.799 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:26:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:26:59] "GET /metrics HTTP/1.1" 200 4203 "" "Prometheus/3.6.0" 2026-02-24T08:26:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:26:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:26:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:27:00.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 41 128 209825 209697 39.954 28 0.0174007 0.0250061 2026-02-24T08:27:00.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:59 trial105 ceph-mon[39442]: pgmap v237: 17 pgs: 17 active+clean; 1.5 GiB data, 7.8 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.93k op/s 2026-02-24T08:27:00.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:27:00.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:26:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3363837717' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:01.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 42 128 213352 213224 39.6587 27.5547 0.0333339 0.0251953 2026-02-24T08:27:01.364 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:27:01.365 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:27:01.532 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:01.625 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:01.659 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:01.656+0000 7f2932168640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:01.659 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:01.656+0000 7f2932168640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:01.779 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:01.906 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:01.903+0000 7fe340868640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:01.906 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:01.903+0000 7fe340868640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:01.922 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:01.922 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:01.922 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:01 trial105 ceph-mon[39442]: pgmap v238: 17 pgs: 17 active+clean; 1.6 GiB data, 8.2 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.25k op/s 2026-02-24T08:27:01.937 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:01.937 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:01.953 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:01.953 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:01.968 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:01.968 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:02.160 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 43 128 216749 216621 39.3535 26.5391 0.053898 0.0253929 2026-02-24T08:27:02.804 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:27:02.846 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:27:02.996 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:03.051 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4170425568' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:27:03.051 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/949805101' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:03.117 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:03.114+0000 7fbd864aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:03.117 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:03.114+0000 7fbd864aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:03.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 44 127 220137 220010 39.0608 26.4766 0.0255144 0.0255857 2026-02-24T08:27:03.807 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:27:03.852 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:27:03.999 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:04.015 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:04.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:03 trial105 ceph-mon[39442]: pgmap v239: 17 pgs: 17 active+clean; 1.6 GiB data, 8.3 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.16k op/s 2026-02-24T08:27:04.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4170425568' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:27:04.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:03 trial105 ceph-mon[39442]: osdmap e66: 4 total, 4 up, 4 in 2026-02-24T08:27:04.058 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2588070301' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:27:04.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:04.119+0000 7f9a6e3c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:04.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:04.119+0000 7f9a6e3c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:04.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 45 128 223399 223271 38.7589 25.4766 0.0207994 0.0257791 2026-02-24T08:27:04.174 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:04.309 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:04.306+0000 7f6251d9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:04.309 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:04.306+0000 7f6251d9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:04.325 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:04.326 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:04.339 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:04.339 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:04.352 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:04.352 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:04.366 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:04.366 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:04.808 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:27:04.855 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:27:05.002 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:05.062 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:04 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2588070301' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:27:05.062 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:04 trial105 ceph-mon[39442]: osdmap e67: 4 total, 4 up, 4 in 2026-02-24T08:27:05.062 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:04 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3014665777' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:27:05.062 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:04 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1177640375' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:05.128 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:05.124+0000 7fbf9f25f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:05.128 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:05.125+0000 7fbf9f25f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:05.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 46 128 226863 226735 38.5046 27.0625 0.0377456 0.0259527 2026-02-24T08:27:05.809 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:27:05.859 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:27:05.860 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:05.997 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:06.063 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:05 trial105 ceph-mon[39442]: pgmap v242: 17 pgs: 17 active+clean; 1.6 GiB data, 8.3 GiB used, 2.7 TiB / 2.7 TiB avail; 18 MiB/s wr, 2.26k op/s 2026-02-24T08:27:06.064 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:05 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3014665777' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:27:06.064 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:05 trial105 ceph-mon[39442]: osdmap e68: 4 total, 4 up, 4 in 2026-02-24T08:27:06.064 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:05 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2502856887' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:27:06.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:06.120+0000 7fdc44216640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:06.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:06.120+0000 7fdc44216640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:06.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 47 128 230462 230334 38.2836 28.1172 0.0282478 0.0261072 2026-02-24T08:27:06.275 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:06.276 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:06.318 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2026-02-24T08:27:05.807507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1869980192,"num_objects":28528,"num_object_clones":0,"num_object_copies":85584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28528,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":228332,"num_write_kb":1827726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160896,"ondisk_log_size":160896,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8722716,"kb_used_data":5420740,"kb_used_omap":28,"kb_used_meta":3301859,"kb_avail":2927290084,"statfs":{"total":3006477107200,"available":2997545046016,"internally_reserved":0,"allocated":5550837760,"data_stored":5549212042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29627,"internal_metadata":3381103685},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":158375936,"num_objects":2413,"num_object_clones":0,"num_object_copies":7239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2413,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19333,"num_write_kb":154664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.065493"},"pg_stats":[{"pgid":"5.f","version":"68'14144","reported_seq":14164,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.553061+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:27:05.553061+0000","last_peered":"2026-02-24T08:27:05.553061+0000","last_clean":"2026-02-24T08:27:05.553061+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:05.553061+0000","last_undegraded":"2026-02-24T08:27:05.553061+0000","last_fullsized":"2026-02-24T08:27:05.553061+0000","mapping_epoch":63,"log_start":"65'4100","ondisk_log_start":"65'4100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115867648,"num_objects":1768,"num_object_clones":0,"num_object_copies":5304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14144,"num_write_kb":113152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'14328","reported_seq":14348,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.623023+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:27:05.623023+0000","last_peered":"2026-02-24T08:27:05.623023+0000","last_clean":"2026-02-24T08:27:05.623023+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:05.623023+0000","last_undegraded":"2026-02-24T08:27:05.623023+0000","last_fullsized":"2026-02-24T08:27:05.623023+0000","mapping_epoch":63,"log_start":"65'4300","ondisk_log_start":"65'4300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117374976,"num_objects":1791,"num_object_clones":0,"num_object_copies":5373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14328,"num_write_kb":114624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"68'13560","reported_seq":13580,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.405032+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:27:05.405032+0000","last_peered":"2026-02-24T08:27:05.405032+0000","last_clean":"2026-02-24T08:27:05.405032+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:05.405032+0000","last_undegraded":"2026-02-24T08:27:05.405032+0000","last_fullsized":"2026-02-24T08:27:05.405032+0000","mapping_epoch":63,"log_start":"65'3500","ondisk_log_start":"65'3500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111083520,"num_objects":1695,"num_object_clones":0,"num_object_copies":5085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13560,"num_write_kb":108480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"68'14448","reported_seq":14468,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.670353+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:27:05.670353+0000","last_peered":"2026-02-24T08:27:05.670353+0000","last_clean":"2026-02-24T08:27:05.670353+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:05.670353+0000","last_undegraded":"2026-02-24T08:27:05.670353+0000","last_fullsized":"2026-02-24T08:27:05.670353+0000","mapping_epoch":63,"log_start":"65'4400","ondisk_log_start":"65'4400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118358016,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14448,"num_write_kb":115584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"68'13632","reported_seq":13652,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.403895+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:27:05.403895+0000","last_peered":"2026-02-24T08:27:05.403895+0000","last_clean":"2026-02-24T08:27:05.403895+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:05.403895+0000","last_undegraded":"2026-02-24T08:27:05.403895+0000","last_fullsized":"2026-02-24T08:27:05.403895+0000","mapping_epoch":63,"log_start":"65'3600","ondisk_log_start":"65'3600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111673344,"num_objects":1704,"num_object_clones":0,"num_object_copies":5112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13632,"num_write_kb":109056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"68'14480","reported_seq":14498,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.421149+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:27:05.421149+0000","last_peered":"2026-02-24T08:27:05.421149+0000","last_clean":"2026-02-24T08:27:05.421149+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:05.421149+0000","last_undegraded":"2026-02-24T08:27:05.421149+0000","last_fullsized":"2026-02-24T08:27:05.421149+0000","mapping_epoch":63,"log_start":"65'4400","ondisk_log_start":"65'4400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118620160,"num_objects":1810,"num_object_clones":0,"num_object_copies":5430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14480,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"68'13877","reported_seq":13895,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.620675+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:27:05.620675+0000","last_peered":"2026-02-24T08:27:05.620675+0000","last_clean":"2026-02-24T08:27:05.620675+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:05.620675+0000","last_undegraded":"2026-02-24T08:27:05.620675+0000","last_fullsized":"2026-02-24T08:27:05.620675+0000","mapping_epoch":63,"log_start":"65'3800","ondisk_log_start":"65'3800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113680384,"num_objects":1735,"num_object_clones":0,"num_object_copies":5205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13877,"num_write_kb":111016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"68'14736","reported_seq":14756,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.436989+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:27:05.436989+0000","last_peered":"2026-02-24T08:27:05.436989+0000","last_clean":"2026-02-24T08:27:05.436989+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:05.436989+0000","last_undegraded":"2026-02-24T08:27:05.436989+0000","last_fullsized":"2026-02-24T08:27:05.436989+0000","mapping_epoch":63,"log_start":"65'4700","ondisk_log_start":"65'4700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120717312,"num_objects":1842,"num_object_clones":0,"num_object_copies":5526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14736,"num_write_kb":117888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"68'14768","reported_seq":14788,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.624029+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:27:05.624029+0000","last_peered":"2026-02-24T08:27:05.624029+0000","last_clean":"2026-02-24T08:27:05.624029+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:05.624029+0000","last_undegraded":"2026-02-24T08:27:05.624029+0000","last_fullsized":"2026-02-24T08:27:05.624029+0000","mapping_epoch":63,"log_start":"65'4700","ondisk_log_start":"65'4700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120979456,"num_objects":1846,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1846,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14768,"num_write_kb":118144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"68'14656","reported_seq":14676,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.758304+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:27:05.758304+0000","last_peered":"2026-02-24T08:27:05.758304+0000","last_clean":"2026-02-24T08:27:05.758304+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:05.758304+0000","last_undegraded":"2026-02-24T08:27:05.758304+0000","last_fullsized":"2026-02-24T08:27:05.758304+0000","mapping_epoch":63,"log_start":"65'4600","ondisk_log_start":"65'4600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120061952,"num_objects":1832,"num_object_clones":0,"num_object_copies":5496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14656,"num_write_kb":117248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"68'14152","reported_seq":14169,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.449794+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:27:05.449794+0000","last_peered":"2026-02-24T08:27:05.449794+0000","last_clean":"2026-02-24T08:27:05.449794+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:05.449794+0000","last_undegraded":"2026-02-24T08:27:05.449794+0000","last_fullsized":"2026-02-24T08:27:05.449794+0000","mapping_epoch":63,"log_start":"65'4100","ondisk_log_start":"65'4100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115933184,"num_objects":1769,"num_object_clones":0,"num_object_copies":5307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14152,"num_write_kb":113216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"68'13976","reported_seq":13995,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.450394+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:27:05.450394+0000","last_peered":"2026-02-24T08:27:05.450394+0000","last_clean":"2026-02-24T08:27:05.450394+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:05.450394+0000","last_undegraded":"2026-02-24T08:27:05.450394+0000","last_fullsized":"2026-02-24T08:27:05.450394+0000","mapping_epoch":63,"log_start":"65'3900","ondisk_log_start":"65'3900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114491392,"num_objects":1747,"num_object_clones":0,"num_object_copies":5241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13976,"num_write_kb":111808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"68'13850","reported_seq":13868,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.620655+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:27:05.620655+0000","last_peered":"2026-02-24T08:27:05.620655+0000","last_clean":"2026-02-24T08:27:05.620655+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:05.620655+0000","last_undegraded":"2026-02-24T08:27:05.620655+0000","last_fullsized":"2026-02-24T08:27:05.620655+0000","mapping_epoch":63,"log_start":"65'3800","ondisk_log_start":"65'3800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113459200,"num_objects":1732,"num_object_clones":0,"num_object_copies":5196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13850,"num_write_kb":110800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"68'15184","reported_seq":15204,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.584326+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:27:05.584326+0000","last_peered":"2026-02-24T08:27:05.584326+0000","last_clean":"2026-02-24T08:27:05.584326+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:05.584326+0000","last_undegraded":"2026-02-24T08:27:05.584326+0000","last_fullsized":"2026-02-24T08:27:05.584326+0000","mapping_epoch":63,"log_start":"65'5100","ondisk_log_start":"65'5100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124387328,"num_objects":1898,"num_object_clones":0,"num_object_copies":5694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1898,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15184,"num_write_kb":121472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"68'13904","reported_seq":13924,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.306770+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:27:05.306770+0000","last_peered":"2026-02-24T08:27:05.306770+0000","last_clean":"2026-02-24T08:27:05.306770+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:05.306770+0000","last_undegraded":"2026-02-24T08:27:05.306770+0000","last_fullsized":"2026-02-24T08:27:05.306770+0000","mapping_epoch":63,"log_start":"65'3900","ondisk_log_start":"65'3900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113901568,"num_objects":1738,"num_object_clones":0,"num_object_copies":5214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13904,"num_write_kb":111232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"68'14502","reported_seq":14513,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.568349+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:27:05.568349+0000","last_peered":"2026-02-24T08:27:05.568349+0000","last_clean":"2026-02-24T08:27:05.568349+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:05.568349+0000","last_undegraded":"2026-02-24T08:27:05.568349+0000","last_fullsized":"2026-02-24T08:27:05.568349+0000","mapping_epoch":63,"log_start":"65'4500","ondisk_log_start":"65'4500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118800384,"num_objects":1813,"num_object_clones":0,"num_object_copies":5439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14502,"num_write_kb":116016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:04.809398+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:27:04.809398+0000","last_peered":"2026-02-24T08:27:04.809398+0000","last_clean":"2026-02-24T08:27:04.809398+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:04.809398+0000","last_undegraded":"2026-02-24T08:27:04.809398+0000","last_fullsized":"2026-02-24T08:27:04.809398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1869389824,"num_objects":28526,"num_object_clones":0,"num_object_copies":85578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228197,"num_write_kb":1825576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5611872256,"data_stored":5611872256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160797,"ondisk_log_size":160797,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2589,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247891,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2214484,"kb_used_data":1579704,"kb_used_omap":6,"kb_used_meta":634745,"kb_avail":731788716,"statfs":{"total":751619276800,"available":749351645184,"internally_reserved":0,"allocated":1617616896,"data_stored":1617213518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6487,"internal_metadata":649979561},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444117,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1940680,"kb_used_data":1232308,"kb_used_omap":10,"kb_used_meta":708341,"kb_avail":732062520,"statfs":{"total":751619276800,"available":749632020480,"internally_reserved":0,"allocated":1261883392,"data_stored":1261472135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10318,"internal_metadata":725342130},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2027308,"kb_used_data":1148120,"kb_used_omap":6,"kb_used_meta":879161,"kb_avail":731975892,"statfs":{"total":751619276800,"available":749543313408,"internally_reserved":0,"allocated":1175674880,"data_stored":1175267175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6408,"internal_metadata":900261624},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2540244,"kb_used_data":1460608,"kb_used_omap":6,"kb_used_meta":1079609,"kb_avail":731462956,"statfs":{"total":751619276800,"available":749018066944,"internally_reserved":0,"allocated":1495662592,"data_stored":1495259214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6414,"internal_metadata":1105520370},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2589,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1514840064,"data_stored":1514840064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1182367744,"data_stored":1182367744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1275682816,"data_stored":1275682816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1638981632,"data_stored":1638981632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:06.320 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:06.416 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:06.467 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:06.791 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:06.874 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:06 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2502856887' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:27:06.874 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:06 trial105 ceph-mon[39442]: osdmap e69: 4 total, 4 up, 4 in 2026-02-24T08:27:06.945 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:06.942+0000 7fa794207640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:06.946 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:06.942+0000 7fa794207640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:07.053 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:07.050+0000 7f07f6198640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:07.054 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:07.051+0000 7f07f6198640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:07.069 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:07.069 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:07.082 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:07.083 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:07.096 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:07.096 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:07.097 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:07.097 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:07.111 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:07.112 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:07.143 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2026-02-24T08:27:06.742852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1869980192,"num_objects":28528,"num_object_clones":0,"num_object_copies":85584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28528,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":228332,"num_write_kb":1827726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160896,"ondisk_log_size":160896,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8722716,"kb_used_data":5420740,"kb_used_omap":28,"kb_used_meta":3301859,"kb_avail":2927290084,"statfs":{"total":3006477107200,"available":2997545046016,"internally_reserved":0,"allocated":5550837760,"data_stored":5549212042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29627,"internal_metadata":3381103685},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":140165120,"num_objects":2136,"num_object_clones":0,"num_object_copies":6408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17110,"num_write_kb":136880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000527"},"pg_stats":[{"pgid":"5.f","version":"68'14144","reported_seq":14164,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.553061+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:27:05.553061+0000","last_peered":"2026-02-24T08:27:05.553061+0000","last_clean":"2026-02-24T08:27:05.553061+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:05.553061+0000","last_undegraded":"2026-02-24T08:27:05.553061+0000","last_fullsized":"2026-02-24T08:27:05.553061+0000","mapping_epoch":63,"log_start":"65'4100","ondisk_log_start":"65'4100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115867648,"num_objects":1768,"num_object_clones":0,"num_object_copies":5304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14144,"num_write_kb":113152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'14328","reported_seq":14348,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.623023+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:27:05.623023+0000","last_peered":"2026-02-24T08:27:05.623023+0000","last_clean":"2026-02-24T08:27:05.623023+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:05.623023+0000","last_undegraded":"2026-02-24T08:27:05.623023+0000","last_fullsized":"2026-02-24T08:27:05.623023+0000","mapping_epoch":63,"log_start":"65'4300","ondisk_log_start":"65'4300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117374976,"num_objects":1791,"num_object_clones":0,"num_object_copies":5373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14328,"num_write_kb":114624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"68'13560","reported_seq":13580,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.405032+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:27:05.405032+0000","last_peered":"2026-02-24T08:27:05.405032+0000","last_clean":"2026-02-24T08:27:05.405032+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:05.405032+0000","last_undegraded":"2026-02-24T08:27:05.405032+0000","last_fullsized":"2026-02-24T08:27:05.405032+0000","mapping_epoch":63,"log_start":"65'3500","ondisk_log_start":"65'3500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111083520,"num_objects":1695,"num_object_clones":0,"num_object_copies":5085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13560,"num_write_kb":108480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"68'14448","reported_seq":14468,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.670353+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:27:05.670353+0000","last_peered":"2026-02-24T08:27:05.670353+0000","last_clean":"2026-02-24T08:27:05.670353+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:05.670353+0000","last_undegraded":"2026-02-24T08:27:05.670353+0000","last_fullsized":"2026-02-24T08:27:05.670353+0000","mapping_epoch":63,"log_start":"65'4400","ondisk_log_start":"65'4400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118358016,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14448,"num_write_kb":115584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"68'13632","reported_seq":13652,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.403895+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:27:05.403895+0000","last_peered":"2026-02-24T08:27:05.403895+0000","last_clean":"2026-02-24T08:27:05.403895+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:05.403895+0000","last_undegraded":"2026-02-24T08:27:05.403895+0000","last_fullsized":"2026-02-24T08:27:05.403895+0000","mapping_epoch":63,"log_start":"65'3600","ondisk_log_start":"65'3600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111673344,"num_objects":1704,"num_object_clones":0,"num_object_copies":5112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13632,"num_write_kb":109056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"68'14480","reported_seq":14498,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.421149+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:27:05.421149+0000","last_peered":"2026-02-24T08:27:05.421149+0000","last_clean":"2026-02-24T08:27:05.421149+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:05.421149+0000","last_undegraded":"2026-02-24T08:27:05.421149+0000","last_fullsized":"2026-02-24T08:27:05.421149+0000","mapping_epoch":63,"log_start":"65'4400","ondisk_log_start":"65'4400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118620160,"num_objects":1810,"num_object_clones":0,"num_object_copies":5430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14480,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"68'13877","reported_seq":13895,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.620675+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:27:05.620675+0000","last_peered":"2026-02-24T08:27:05.620675+0000","last_clean":"2026-02-24T08:27:05.620675+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:05.620675+0000","last_undegraded":"2026-02-24T08:27:05.620675+0000","last_fullsized":"2026-02-24T08:27:05.620675+0000","mapping_epoch":63,"log_start":"65'3800","ondisk_log_start":"65'3800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113680384,"num_objects":1735,"num_object_clones":0,"num_object_copies":5205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13877,"num_write_kb":111016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"68'14736","reported_seq":14756,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.436989+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:27:05.436989+0000","last_peered":"2026-02-24T08:27:05.436989+0000","last_clean":"2026-02-24T08:27:05.436989+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:05.436989+0000","last_undegraded":"2026-02-24T08:27:05.436989+0000","last_fullsized":"2026-02-24T08:27:05.436989+0000","mapping_epoch":63,"log_start":"65'4700","ondisk_log_start":"65'4700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120717312,"num_objects":1842,"num_object_clones":0,"num_object_copies":5526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14736,"num_write_kb":117888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"68'14768","reported_seq":14788,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.624029+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:27:05.624029+0000","last_peered":"2026-02-24T08:27:05.624029+0000","last_clean":"2026-02-24T08:27:05.624029+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:05.624029+0000","last_undegraded":"2026-02-24T08:27:05.624029+0000","last_fullsized":"2026-02-24T08:27:05.624029+0000","mapping_epoch":63,"log_start":"65'4700","ondisk_log_start":"65'4700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120979456,"num_objects":1846,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1846,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14768,"num_write_kb":118144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"68'14656","reported_seq":14676,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.758304+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:27:05.758304+0000","last_peered":"2026-02-24T08:27:05.758304+0000","last_clean":"2026-02-24T08:27:05.758304+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:05.758304+0000","last_undegraded":"2026-02-24T08:27:05.758304+0000","last_fullsized":"2026-02-24T08:27:05.758304+0000","mapping_epoch":63,"log_start":"65'4600","ondisk_log_start":"65'4600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120061952,"num_objects":1832,"num_object_clones":0,"num_object_copies":5496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14656,"num_write_kb":117248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"68'14152","reported_seq":14169,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.449794+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:27:05.449794+0000","last_peered":"2026-02-24T08:27:05.449794+0000","last_clean":"2026-02-24T08:27:05.449794+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:05.449794+0000","last_undegraded":"2026-02-24T08:27:05.449794+0000","last_fullsized":"2026-02-24T08:27:05.449794+0000","mapping_epoch":63,"log_start":"65'4100","ondisk_log_start":"65'4100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115933184,"num_objects":1769,"num_object_clones":0,"num_object_copies":5307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14152,"num_write_kb":113216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"68'13976","reported_seq":13995,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.450394+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:27:05.450394+0000","last_peered":"2026-02-24T08:27:05.450394+0000","last_clean":"2026-02-24T08:27:05.450394+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:05.450394+0000","last_undegraded":"2026-02-24T08:27:05.450394+0000","last_fullsized":"2026-02-24T08:27:05.450394+0000","mapping_epoch":63,"log_start":"65'3900","ondisk_log_start":"65'3900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114491392,"num_objects":1747,"num_object_clones":0,"num_object_copies":5241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13976,"num_write_kb":111808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"68'13850","reported_seq":13868,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.620655+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:27:05.620655+0000","last_peered":"2026-02-24T08:27:05.620655+0000","last_clean":"2026-02-24T08:27:05.620655+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:05.620655+0000","last_undegraded":"2026-02-24T08:27:05.620655+0000","last_fullsized":"2026-02-24T08:27:05.620655+0000","mapping_epoch":63,"log_start":"65'3800","ondisk_log_start":"65'3800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113459200,"num_objects":1732,"num_object_clones":0,"num_object_copies":5196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13850,"num_write_kb":110800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"68'15184","reported_seq":15204,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.584326+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:27:05.584326+0000","last_peered":"2026-02-24T08:27:05.584326+0000","last_clean":"2026-02-24T08:27:05.584326+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:05.584326+0000","last_undegraded":"2026-02-24T08:27:05.584326+0000","last_fullsized":"2026-02-24T08:27:05.584326+0000","mapping_epoch":63,"log_start":"65'5100","ondisk_log_start":"65'5100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124387328,"num_objects":1898,"num_object_clones":0,"num_object_copies":5694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1898,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15184,"num_write_kb":121472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"68'13904","reported_seq":13924,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.306770+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:27:05.306770+0000","last_peered":"2026-02-24T08:27:05.306770+0000","last_clean":"2026-02-24T08:27:05.306770+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:05.306770+0000","last_undegraded":"2026-02-24T08:27:05.306770+0000","last_fullsized":"2026-02-24T08:27:05.306770+0000","mapping_epoch":63,"log_start":"65'3900","ondisk_log_start":"65'3900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113901568,"num_objects":1738,"num_object_clones":0,"num_object_copies":5214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13904,"num_write_kb":111232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"68'14502","reported_seq":14513,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.568349+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:27:05.568349+0000","last_peered":"2026-02-24T08:27:05.568349+0000","last_clean":"2026-02-24T08:27:05.568349+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:05.568349+0000","last_undegraded":"2026-02-24T08:27:05.568349+0000","last_fullsized":"2026-02-24T08:27:05.568349+0000","mapping_epoch":63,"log_start":"65'4500","ondisk_log_start":"65'4500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118800384,"num_objects":1813,"num_object_clones":0,"num_object_copies":5439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14502,"num_write_kb":116016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:04.809398+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:27:04.809398+0000","last_peered":"2026-02-24T08:27:04.809398+0000","last_clean":"2026-02-24T08:27:04.809398+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:04.809398+0000","last_undegraded":"2026-02-24T08:27:04.809398+0000","last_fullsized":"2026-02-24T08:27:04.809398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1869389824,"num_objects":28526,"num_object_clones":0,"num_object_copies":85578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228197,"num_write_kb":1825576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5611872256,"data_stored":5611872256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160797,"ondisk_log_size":160797,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2589,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247891,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2214484,"kb_used_data":1579704,"kb_used_omap":6,"kb_used_meta":634745,"kb_avail":731788716,"statfs":{"total":751619276800,"available":749351645184,"internally_reserved":0,"allocated":1617616896,"data_stored":1617213518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6487,"internal_metadata":649979561},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444117,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1940680,"kb_used_data":1232308,"kb_used_omap":10,"kb_used_meta":708341,"kb_avail":732062520,"statfs":{"total":751619276800,"available":749632020480,"internally_reserved":0,"allocated":1261883392,"data_stored":1261472135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10318,"internal_metadata":725342130},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2027308,"kb_used_data":1148120,"kb_used_omap":6,"kb_used_meta":879161,"kb_avail":731975892,"statfs":{"total":751619276800,"available":749543313408,"internally_reserved":0,"allocated":1175674880,"data_stored":1175267175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6408,"internal_metadata":900261624},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2540244,"kb_used_data":1460608,"kb_used_omap":6,"kb_used_meta":1079609,"kb_avail":731462956,"statfs":{"total":751619276800,"available":749018066944,"internally_reserved":0,"allocated":1495662592,"data_stored":1495259214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6414,"internal_metadata":1105520370},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2589,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1514840064,"data_stored":1514840064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1182367744,"data_stored":1182367744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1275682816,"data_stored":1275682816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1638981632,"data_stored":1638981632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:07.145 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:27:07.145 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:27:07.145 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_3 2026-02-24T08:27:07.146 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:07.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 48 128 233438 233310 37.9703 23.25 0.0935825 0.0263162 2026-02-24T08:27:07.300 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:07.431 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:07.428+0000 7face874e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:07.431 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:07.428+0000 7face874e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:07.579 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:07.579 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:07.623 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2026-02-24T08:27:06.742852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1869980192,"num_objects":28528,"num_object_clones":0,"num_object_copies":85584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28528,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":228332,"num_write_kb":1827726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160896,"ondisk_log_size":160896,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8722716,"kb_used_data":5420740,"kb_used_omap":28,"kb_used_meta":3301859,"kb_avail":2927290084,"statfs":{"total":3006477107200,"available":2997545046016,"internally_reserved":0,"allocated":5550837760,"data_stored":5549212042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29627,"internal_metadata":3381103685},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":140165120,"num_objects":2136,"num_object_clones":0,"num_object_copies":6408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17110,"num_write_kb":136880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000527"},"pg_stats":[{"pgid":"5.f","version":"68'14144","reported_seq":14164,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.553061+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:27:05.553061+0000","last_peered":"2026-02-24T08:27:05.553061+0000","last_clean":"2026-02-24T08:27:05.553061+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:05.553061+0000","last_undegraded":"2026-02-24T08:27:05.553061+0000","last_fullsized":"2026-02-24T08:27:05.553061+0000","mapping_epoch":63,"log_start":"65'4100","ondisk_log_start":"65'4100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115867648,"num_objects":1768,"num_object_clones":0,"num_object_copies":5304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14144,"num_write_kb":113152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'14328","reported_seq":14348,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.623023+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:27:05.623023+0000","last_peered":"2026-02-24T08:27:05.623023+0000","last_clean":"2026-02-24T08:27:05.623023+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:05.623023+0000","last_undegraded":"2026-02-24T08:27:05.623023+0000","last_fullsized":"2026-02-24T08:27:05.623023+0000","mapping_epoch":63,"log_start":"65'4300","ondisk_log_start":"65'4300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117374976,"num_objects":1791,"num_object_clones":0,"num_object_copies":5373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14328,"num_write_kb":114624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"68'13560","reported_seq":13580,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.405032+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:27:05.405032+0000","last_peered":"2026-02-24T08:27:05.405032+0000","last_clean":"2026-02-24T08:27:05.405032+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:05.405032+0000","last_undegraded":"2026-02-24T08:27:05.405032+0000","last_fullsized":"2026-02-24T08:27:05.405032+0000","mapping_epoch":63,"log_start":"65'3500","ondisk_log_start":"65'3500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111083520,"num_objects":1695,"num_object_clones":0,"num_object_copies":5085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13560,"num_write_kb":108480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"68'14448","reported_seq":14468,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.670353+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:27:05.670353+0000","last_peered":"2026-02-24T08:27:05.670353+0000","last_clean":"2026-02-24T08:27:05.670353+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:05.670353+0000","last_undegraded":"2026-02-24T08:27:05.670353+0000","last_fullsized":"2026-02-24T08:27:05.670353+0000","mapping_epoch":63,"log_start":"65'4400","ondisk_log_start":"65'4400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118358016,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14448,"num_write_kb":115584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"68'13632","reported_seq":13652,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.403895+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:27:05.403895+0000","last_peered":"2026-02-24T08:27:05.403895+0000","last_clean":"2026-02-24T08:27:05.403895+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:05.403895+0000","last_undegraded":"2026-02-24T08:27:05.403895+0000","last_fullsized":"2026-02-24T08:27:05.403895+0000","mapping_epoch":63,"log_start":"65'3600","ondisk_log_start":"65'3600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111673344,"num_objects":1704,"num_object_clones":0,"num_object_copies":5112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13632,"num_write_kb":109056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"68'14480","reported_seq":14498,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.421149+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:27:05.421149+0000","last_peered":"2026-02-24T08:27:05.421149+0000","last_clean":"2026-02-24T08:27:05.421149+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:05.421149+0000","last_undegraded":"2026-02-24T08:27:05.421149+0000","last_fullsized":"2026-02-24T08:27:05.421149+0000","mapping_epoch":63,"log_start":"65'4400","ondisk_log_start":"65'4400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118620160,"num_objects":1810,"num_object_clones":0,"num_object_copies":5430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14480,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"68'13877","reported_seq":13895,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.620675+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:27:05.620675+0000","last_peered":"2026-02-24T08:27:05.620675+0000","last_clean":"2026-02-24T08:27:05.620675+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:05.620675+0000","last_undegraded":"2026-02-24T08:27:05.620675+0000","last_fullsized":"2026-02-24T08:27:05.620675+0000","mapping_epoch":63,"log_start":"65'3800","ondisk_log_start":"65'3800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113680384,"num_objects":1735,"num_object_clones":0,"num_object_copies":5205,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1735,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13877,"num_write_kb":111016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"68'14736","reported_seq":14756,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.436989+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:27:05.436989+0000","last_peered":"2026-02-24T08:27:05.436989+0000","last_clean":"2026-02-24T08:27:05.436989+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:05.436989+0000","last_undegraded":"2026-02-24T08:27:05.436989+0000","last_fullsized":"2026-02-24T08:27:05.436989+0000","mapping_epoch":63,"log_start":"65'4700","ondisk_log_start":"65'4700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120717312,"num_objects":1842,"num_object_clones":0,"num_object_copies":5526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14736,"num_write_kb":117888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"68'14768","reported_seq":14788,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.624029+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:27:05.624029+0000","last_peered":"2026-02-24T08:27:05.624029+0000","last_clean":"2026-02-24T08:27:05.624029+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:05.624029+0000","last_undegraded":"2026-02-24T08:27:05.624029+0000","last_fullsized":"2026-02-24T08:27:05.624029+0000","mapping_epoch":63,"log_start":"65'4700","ondisk_log_start":"65'4700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120979456,"num_objects":1846,"num_object_clones":0,"num_object_copies":5538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1846,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14768,"num_write_kb":118144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"68'14656","reported_seq":14676,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.758304+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:27:05.758304+0000","last_peered":"2026-02-24T08:27:05.758304+0000","last_clean":"2026-02-24T08:27:05.758304+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:05.758304+0000","last_undegraded":"2026-02-24T08:27:05.758304+0000","last_fullsized":"2026-02-24T08:27:05.758304+0000","mapping_epoch":63,"log_start":"65'4600","ondisk_log_start":"65'4600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120061952,"num_objects":1832,"num_object_clones":0,"num_object_copies":5496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1832,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14656,"num_write_kb":117248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"68'14152","reported_seq":14169,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.449794+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:27:05.449794+0000","last_peered":"2026-02-24T08:27:05.449794+0000","last_clean":"2026-02-24T08:27:05.449794+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:05.449794+0000","last_undegraded":"2026-02-24T08:27:05.449794+0000","last_fullsized":"2026-02-24T08:27:05.449794+0000","mapping_epoch":63,"log_start":"65'4100","ondisk_log_start":"65'4100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115933184,"num_objects":1769,"num_object_clones":0,"num_object_copies":5307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14152,"num_write_kb":113216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"68'13976","reported_seq":13995,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.450394+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:27:05.450394+0000","last_peered":"2026-02-24T08:27:05.450394+0000","last_clean":"2026-02-24T08:27:05.450394+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:05.450394+0000","last_undegraded":"2026-02-24T08:27:05.450394+0000","last_fullsized":"2026-02-24T08:27:05.450394+0000","mapping_epoch":63,"log_start":"65'3900","ondisk_log_start":"65'3900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114491392,"num_objects":1747,"num_object_clones":0,"num_object_copies":5241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13976,"num_write_kb":111808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"68'13850","reported_seq":13868,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.620655+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:27:05.620655+0000","last_peered":"2026-02-24T08:27:05.620655+0000","last_clean":"2026-02-24T08:27:05.620655+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:05.620655+0000","last_undegraded":"2026-02-24T08:27:05.620655+0000","last_fullsized":"2026-02-24T08:27:05.620655+0000","mapping_epoch":63,"log_start":"65'3800","ondisk_log_start":"65'3800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113459200,"num_objects":1732,"num_object_clones":0,"num_object_copies":5196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13850,"num_write_kb":110800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"68'15184","reported_seq":15204,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.584326+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:27:05.584326+0000","last_peered":"2026-02-24T08:27:05.584326+0000","last_clean":"2026-02-24T08:27:05.584326+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:05.584326+0000","last_undegraded":"2026-02-24T08:27:05.584326+0000","last_fullsized":"2026-02-24T08:27:05.584326+0000","mapping_epoch":63,"log_start":"65'5100","ondisk_log_start":"65'5100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124387328,"num_objects":1898,"num_object_clones":0,"num_object_copies":5694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1898,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15184,"num_write_kb":121472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"68'13904","reported_seq":13924,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.306770+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:27:05.306770+0000","last_peered":"2026-02-24T08:27:05.306770+0000","last_clean":"2026-02-24T08:27:05.306770+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:05.306770+0000","last_undegraded":"2026-02-24T08:27:05.306770+0000","last_fullsized":"2026-02-24T08:27:05.306770+0000","mapping_epoch":63,"log_start":"65'3900","ondisk_log_start":"65'3900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113901568,"num_objects":1738,"num_object_clones":0,"num_object_copies":5214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13904,"num_write_kb":111232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"68'14502","reported_seq":14513,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.568349+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:27:05.568349+0000","last_peered":"2026-02-24T08:27:05.568349+0000","last_clean":"2026-02-24T08:27:05.568349+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:05.568349+0000","last_undegraded":"2026-02-24T08:27:05.568349+0000","last_fullsized":"2026-02-24T08:27:05.568349+0000","mapping_epoch":63,"log_start":"65'4500","ondisk_log_start":"65'4500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118800384,"num_objects":1813,"num_object_clones":0,"num_object_copies":5439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14502,"num_write_kb":116016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-24T08:27:04.809398+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:27:04.809398+0000","last_peered":"2026-02-24T08:27:04.809398+0000","last_clean":"2026-02-24T08:27:04.809398+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:04.809398+0000","last_undegraded":"2026-02-24T08:27:04.809398+0000","last_fullsized":"2026-02-24T08:27:04.809398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1869389824,"num_objects":28526,"num_object_clones":0,"num_object_copies":85578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228197,"num_write_kb":1825576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5611872256,"data_stored":5611872256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160797,"ondisk_log_size":160797,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2589,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247891,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2214484,"kb_used_data":1579704,"kb_used_omap":6,"kb_used_meta":634745,"kb_avail":731788716,"statfs":{"total":751619276800,"available":749351645184,"internally_reserved":0,"allocated":1617616896,"data_stored":1617213518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6487,"internal_metadata":649979561},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444117,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1940680,"kb_used_data":1232308,"kb_used_omap":10,"kb_used_meta":708341,"kb_avail":732062520,"statfs":{"total":751619276800,"available":749632020480,"internally_reserved":0,"allocated":1261883392,"data_stored":1261472135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10318,"internal_metadata":725342130},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2027308,"kb_used_data":1148120,"kb_used_omap":6,"kb_used_meta":879161,"kb_avail":731975892,"statfs":{"total":751619276800,"available":749543313408,"internally_reserved":0,"allocated":1175674880,"data_stored":1175267175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6408,"internal_metadata":900261624},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2540244,"kb_used_data":1460608,"kb_used_omap":6,"kb_used_meta":1079609,"kb_avail":731462956,"statfs":{"total":751619276800,"available":749018066944,"internally_reserved":0,"allocated":1495662592,"data_stored":1495259214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6414,"internal_metadata":1105520370},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2589,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1514840064,"data_stored":1514840064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1182367744,"data_stored":1182367744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1275682816,"data_stored":1275682816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1638981632,"data_stored":1638981632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:07.626 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_3 pgp_num 46 2026-02-24T08:27:07.767 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:07.899 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:07.896+0000 7f5ad98a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:07.899 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:07.896+0000 7f5ad98a2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:07.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:07 trial105 ceph-mon[39442]: from='client.14983 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:07.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:07 trial105 ceph-mon[39442]: pgmap v245: 17 pgs: 17 active+clean; 1.7 GiB data, 8.3 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.28k op/s 2026-02-24T08:27:07.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1951473560' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:08.050 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:27:08.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:08.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 49 128 236791 236663 37.73 26.1953 0.0146831 0.0264908 2026-02-24T08:27:09.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 50 128 240313 240185 37.5257 27.5156 0.0293454 0.0266322 2026-02-24T08:27:09.163 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:09.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:08 trial105 ceph-mon[39442]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:09.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:08 trial105 ceph-mon[39442]: from='client.14989 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:09.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2325537786' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pgp_num", "val": "46"} : dispatch 2026-02-24T08:27:09.310 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:09.425 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:09.422+0000 7f14e826f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:09.425 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:09.422+0000 7f14e826f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:09.441 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:09.441 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:09.456 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:09.456 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:09.468 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:09.469 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:09.482 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:09.482 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:09.816 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:27:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:27:09] "GET /metrics HTTP/1.1" 200 4203 "" "Prometheus/3.6.0" 2026-02-24T08:27:09.842 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:27:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:27:09.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:27:10.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 51 128 243660 243532 37.3026 26.1484 0.0388621 0.0267954 2026-02-24T08:27:10.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:09 trial105 ceph-mon[39442]: pgmap v246: 17 pgs: 17 active+clean; 1.7 GiB data, 8.3 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.88k op/s 2026-02-24T08:27:10.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:09 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1342014303' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:11.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 52 127 247128 247001 37.1063 27.1016 0.0218899 0.0269375 2026-02-24T08:27:11.548 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:11.693 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:11.821 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:11.818+0000 7efc15122640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:11.821 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:11.818+0000 7efc15122640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:11.837 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:11.837 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:11.838 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:11 trial105 ceph-mon[39442]: pgmap v247: 17 pgs: 17 active+clean; 1.9 GiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.58k op/s 2026-02-24T08:27:11.850 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:11.851 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:11.862 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:11.862 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:11.874 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:11.874 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:12.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 53 128 250463 250335 36.8976 26.0469 0.0661923 0.0270882 2026-02-24T08:27:13.095 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:27:13.095 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:27:13.095 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:27:13.095 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:13.118 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:12 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/575454762' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:13.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 54 128 253880 253752 36.7087 26.6953 0.0505919 0.0272235 2026-02-24T08:27:13.238 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:13.362 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:13.359+0000 7f3c69756640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:13.362 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:13.359+0000 7f3c69756640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:13.511 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:13.512 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:13.558 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2026-02-24T08:27:12.743657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2007646752,"num_objects":30629,"num_object_clones":0,"num_object_copies":91887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30629,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":245137,"num_write_kb":1962166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160601,"ondisk_log_size":160601,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9203924,"kb_used_data":5842116,"kb_used_omap":32,"kb_used_meta":3361695,"kb_avail":2926808876,"statfs":{"total":3006477107200,"available":2997052289024,"internally_reserved":0,"allocated":5982326784,"data_stored":5980653792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33064,"internal_metadata":3442376408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,2,3,2,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":277831680,"num_objects":4237,"num_object_clones":0,"num_object_copies":12711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33915,"num_write_kb":271320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001072"},"pg_stats":[{"pgid":"5.f","version":"69'15237","reported_seq":15252,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.582436+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:27:10.582436+0000","last_peered":"2026-02-24T08:27:10.582436+0000","last_clean":"2026-02-24T08:27:10.582436+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:10.582436+0000","last_undegraded":"2026-02-24T08:27:10.582436+0000","last_fullsized":"2026-02-24T08:27:10.582436+0000","mapping_epoch":63,"log_start":"65'5200","ondisk_log_start":"65'5200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124821504,"num_objects":1905,"num_object_clones":0,"num_object_copies":5715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15237,"num_write_kb":121896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"69'15223","reported_seq":15242,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.634795+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:27:10.634795+0000","last_peered":"2026-02-24T08:27:10.634795+0000","last_clean":"2026-02-24T08:27:10.634795+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:10.634795+0000","last_undegraded":"2026-02-24T08:27:10.634795+0000","last_fullsized":"2026-02-24T08:27:10.634795+0000","mapping_epoch":63,"log_start":"65'5200","ondisk_log_start":"65'5200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124706816,"num_objects":1903,"num_object_clones":0,"num_object_copies":5709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15223,"num_write_kb":121784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"69'14544","reported_seq":14566,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.446316+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:27:10.446316+0000","last_peered":"2026-02-24T08:27:10.446316+0000","last_clean":"2026-02-24T08:27:10.446316+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:10.446316+0000","last_undegraded":"2026-02-24T08:27:10.446316+0000","last_fullsized":"2026-02-24T08:27:10.446316+0000","mapping_epoch":63,"log_start":"65'4500","ondisk_log_start":"65'4500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119144448,"num_objects":1818,"num_object_clones":0,"num_object_copies":5454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1818,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14544,"num_write_kb":116352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"69'15516","reported_seq":15536,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.777062+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:27:10.777062+0000","last_peered":"2026-02-24T08:27:10.777062+0000","last_clean":"2026-02-24T08:27:10.777062+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:10.777062+0000","last_undegraded":"2026-02-24T08:27:10.777062+0000","last_fullsized":"2026-02-24T08:27:10.777062+0000","mapping_epoch":63,"log_start":"65'5500","ondisk_log_start":"65'5500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127107072,"num_objects":1940,"num_object_clones":0,"num_object_copies":5820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15516,"num_write_kb":124128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"69'14504","reported_seq":14526,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.385021+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:27:10.385021+0000","last_peered":"2026-02-24T08:27:10.385021+0000","last_clean":"2026-02-24T08:27:10.385021+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:10.385021+0000","last_undegraded":"2026-02-24T08:27:10.385021+0000","last_fullsized":"2026-02-24T08:27:10.385021+0000","mapping_epoch":63,"log_start":"65'4500","ondisk_log_start":"65'4500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118816768,"num_objects":1813,"num_object_clones":0,"num_object_copies":5439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14504,"num_write_kb":116032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"69'15709","reported_seq":15720,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.459600+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:27:10.459600+0000","last_peered":"2026-02-24T08:27:10.459600+0000","last_clean":"2026-02-24T08:27:10.459600+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:10.459600+0000","last_undegraded":"2026-02-24T08:27:10.459600+0000","last_fullsized":"2026-02-24T08:27:10.459600+0000","mapping_epoch":63,"log_start":"65'5700","ondisk_log_start":"65'5700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128688128,"num_objects":1964,"num_object_clones":0,"num_object_copies":5892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1964,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15709,"num_write_kb":125672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"69'14976","reported_seq":14990,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.632622+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:27:10.632622+0000","last_peered":"2026-02-24T08:27:10.632622+0000","last_clean":"2026-02-24T08:27:10.632622+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:10.632622+0000","last_undegraded":"2026-02-24T08:27:10.632622+0000","last_fullsized":"2026-02-24T08:27:10.632622+0000","mapping_epoch":63,"log_start":"65'4900","ondisk_log_start":"65'4900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122683392,"num_objects":1872,"num_object_clones":0,"num_object_copies":5616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1872,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14976,"num_write_kb":119808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"69'15712","reported_seq":15734,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.415175+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:27:10.415175+0000","last_peered":"2026-02-24T08:27:10.415175+0000","last_clean":"2026-02-24T08:27:10.415175+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:10.415175+0000","last_undegraded":"2026-02-24T08:27:10.415175+0000","last_fullsized":"2026-02-24T08:27:10.415175+0000","mapping_epoch":63,"log_start":"65'5700","ondisk_log_start":"65'5700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128712704,"num_objects":1964,"num_object_clones":0,"num_object_copies":5892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1964,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15712,"num_write_kb":125696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"69'15808","reported_seq":15828,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.644484+0000","last_change":"2026-02-24T08:26:18.067769+0000","last_active":"2026-02-24T08:27:10.644484+0000","last_peered":"2026-02-24T08:27:10.644484+0000","last_clean":"2026-02-24T08:27:10.644484+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:10.644484+0000","last_undegraded":"2026-02-24T08:27:10.644484+0000","last_fullsized":"2026-02-24T08:27:10.644484+0000","mapping_epoch":63,"log_start":"65'5800","ondisk_log_start":"65'5800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:17.885768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129499136,"num_objects":1976,"num_object_clones":0,"num_object_copies":5928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15808,"num_write_kb":126464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"69'15744","reported_seq":15766,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.778783+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:27:10.778783+0000","last_peered":"2026-02-24T08:27:10.778783+0000","last_clean":"2026-02-24T08:27:10.778783+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:10.778783+0000","last_undegraded":"2026-02-24T08:27:10.778783+0000","last_fullsized":"2026-02-24T08:27:10.778783+0000","mapping_epoch":63,"log_start":"65'5700","ondisk_log_start":"65'5700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128974848,"num_objects":1968,"num_object_clones":0,"num_object_copies":5904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15744,"num_write_kb":125952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"69'15304","reported_seq":15326,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.433211+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:27:10.433211+0000","last_peered":"2026-02-24T08:27:10.433211+0000","last_clean":"2026-02-24T08:27:10.433211+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:10.433211+0000","last_undegraded":"2026-02-24T08:27:10.433211+0000","last_fullsized":"2026-02-24T08:27:10.433211+0000","mapping_epoch":63,"log_start":"65'5300","ondisk_log_start":"65'5300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125370368,"num_objects":1913,"num_object_clones":0,"num_object_copies":5739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1913,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15304,"num_write_kb":122432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"69'14965","reported_seq":14987,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.461599+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:27:10.461599+0000","last_peered":"2026-02-24T08:27:10.461599+0000","last_clean":"2026-02-24T08:27:10.461599+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:10.461599+0000","last_undegraded":"2026-02-24T08:27:10.461599+0000","last_fullsized":"2026-02-24T08:27:10.461599+0000","mapping_epoch":63,"log_start":"65'4900","ondisk_log_start":"65'4900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122593280,"num_objects":1871,"num_object_clones":0,"num_object_copies":5613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14965,"num_write_kb":119720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"69'14928","reported_seq":14950,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.619309+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:27:10.619309+0000","last_peered":"2026-02-24T08:27:10.619309+0000","last_clean":"2026-02-24T08:27:10.619309+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:10.619309+0000","last_undegraded":"2026-02-24T08:27:10.619309+0000","last_fullsized":"2026-02-24T08:27:10.619309+0000","mapping_epoch":63,"log_start":"65'4900","ondisk_log_start":"65'4900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122290176,"num_objects":1866,"num_object_clones":0,"num_object_copies":5598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1866,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14928,"num_write_kb":119424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"69'16336","reported_seq":16358,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.614374+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:27:10.614374+0000","last_peered":"2026-02-24T08:27:10.614374+0000","last_clean":"2026-02-24T08:27:10.614374+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:10.614374+0000","last_undegraded":"2026-02-24T08:27:10.614374+0000","last_fullsized":"2026-02-24T08:27:10.614374+0000","mapping_epoch":63,"log_start":"65'6300","ondisk_log_start":"65'6300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133824512,"num_objects":2042,"num_object_clones":0,"num_object_copies":6126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2042,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16336,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"69'14952","reported_seq":14974,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.441059+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:27:10.441059+0000","last_peered":"2026-02-24T08:27:10.441059+0000","last_clean":"2026-02-24T08:27:10.441059+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:10.441059+0000","last_undegraded":"2026-02-24T08:27:10.441059+0000","last_fullsized":"2026-02-24T08:27:10.441059+0000","mapping_epoch":63,"log_start":"65'4900","ondisk_log_start":"65'4900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122486784,"num_objects":1869,"num_object_clones":0,"num_object_copies":5607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1869,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14952,"num_write_kb":119616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"69'15544","reported_seq":15566,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:10.495055+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:27:10.495055+0000","last_peered":"2026-02-24T08:27:10.495055+0000","last_clean":"2026-02-24T08:27:10.495055+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:10.495055+0000","last_undegraded":"2026-02-24T08:27:10.495055+0000","last_fullsized":"2026-02-24T08:27:10.495055+0000","mapping_epoch":63,"log_start":"65'5500","ondisk_log_start":"65'5500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127336448,"num_objects":1943,"num_object_clones":0,"num_object_copies":5829,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1943,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15544,"num_write_kb":124352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":174,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-24T08:27:05.810120+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:27:05.810120+0000","last_peered":"2026-02-24T08:27:05.810120+0000","last_clean":"2026-02-24T08:27:05.810120+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:05.810120+0000","last_undegraded":"2026-02-24T08:27:05.810120+0000","last_fullsized":"2026-02-24T08:27:05.810120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2007056384,"num_objects":30627,"num_object_clones":0,"num_object_copies":91881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":245002,"num_write_kb":1960016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6022643712,"data_stored":6022643712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160502,"ondisk_log_size":160502,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2647,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2349948,"kb_used_data":1697128,"kb_used_omap":7,"kb_used_meta":652792,"kb_avail":731653252,"statfs":{"total":751619276800,"available":749212930048,"internally_reserved":0,"allocated":1737859072,"data_stored":1737439936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7316,"internal_metadata":668459884},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444118,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2051468,"kb_used_data":1325048,"kb_used_omap":10,"kb_used_meta":726389,"kb_avail":731951732,"statfs":{"total":751619276800,"available":749518573568,"internally_reserved":0,"allocated":1356849152,"data_stored":1356430016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10970,"internal_metadata":743822630},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,2,3,2,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2130224,"kb_used_data":1232988,"kb_used_omap":6,"kb_used_meta":897209,"kb_avail":731872976,"statfs":{"total":751619276800,"available":749437927424,"internally_reserved":0,"allocated":1262579712,"data_stored":1262164128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7060,"internal_metadata":918742124},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705754,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2672284,"kb_used_data":1586952,"kb_used_omap":7,"kb_used_meta":1085304,"kb_avail":731330916,"statfs":{"total":751619276800,"available":748882857984,"internally_reserved":0,"allocated":1625038848,"data_stored":1624619712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7718,"internal_metadata":1111351770},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2647,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1625825280,"data_stored":1625825280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1268211712,"data_stored":1268211712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1369595904,"data_stored":1369595904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1759010816,"data_stored":1759010816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:13.561 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 131 2026-02-24T08:27:13.736 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:13.857 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:13.854+0000 7f7a3812d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:13.857 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:13.854+0000 7f7a3812d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:13.920 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:14.003 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:27:14.019 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:13 trial105 ceph-mon[39442]: pgmap v248: 17 pgs: 17 active+clean; 1.9 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.24k op/s 2026-02-24T08:27:14.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:14.069 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:14.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 55 128 257028 256900 36.4884 24.5938 0.0397974 0.0273914 2026-02-24T08:27:14.200 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:14.197+0000 7ffbc492f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:14.200 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:14.197+0000 7ffbc492f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:14.214 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:14.215 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:14.229 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:14.229 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:14.243 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:14.243 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:14.258 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:14.258 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:15.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 56 128 260433 260305 36.3118 26.6016 0.0163879 0.0275269 2026-02-24T08:27:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:14 trial105 ceph-mon[39442]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:27:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:14 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1733521705' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "131"} : dispatch 2026-02-24T08:27:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:14 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1150872482' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:16.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 57 128 263769 263641 36.1319 26.0625 0.0150178 0.0276578 2026-02-24T08:27:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:15 trial105 ceph-mon[39442]: pgmap v249: 17 pgs: 17 active+clean; 1.9 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.41k op/s 2026-02-24T08:27:16.302 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:16.441 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:16.553 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:16.550+0000 7f87da53b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:16.554 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:16.551+0000 7f87da53b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:16.569 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:16.569 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:16.583 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:16.584 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:16.596 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:16.597 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:16.610 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:16.610 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:16.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2620807689' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:17.161 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 58 128 266958 266830 35.9385 24.9141 0.0198796 0.0278143 2026-02-24T08:27:18.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 59 128 270342 270214 35.7774 26.4375 0.0855438 0.027935 2026-02-24T08:27:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:17 trial105 ceph-mon[39442]: pgmap v250: 17 pgs: 17 active+clean; 2.0 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.08k op/s 2026-02-24T08:27:18.656 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:18.803 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:18.913 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:18.910+0000 7f24f8136640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:18.913 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:18.911+0000 7f24f8136640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:18.928 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:18.928 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:18.944 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:18.945 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:18.959 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:18.959 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:18.974 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:18.974 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:19.048 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:27:19.049 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:27:19.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:27:19.160455+0000 min lat: 0.000698887 max lat: 0.233817 avg lat: 0.0280642 2026-02-24T08:27:19.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:27:19.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 60 128 273678 273550 35.6155 26.0625 0.0208085 0.0280642 2026-02-24T08:27:19.198 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:19.318 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:19.315+0000 7f805b8f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:19.319 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:19.315+0000 7f805b8f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:19.825 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:27:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:27:19] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T08:27:19.827 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:27:19.894 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:27:19.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:27:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:27:19.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:27:20.037 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:20.094 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:19 trial105 ceph-mon[39442]: pgmap v251: 17 pgs: 17 active+clean; 2.0 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.81k op/s 2026-02-24T08:27:20.095 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1324258910' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:20.095 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4139687299' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:27:20.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 61 128 276815 276687 35.4333 24.5078 0.0191235 0.0282034 2026-02-24T08:27:20.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:20.164+0000 7f5ef4b45640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:20.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:20.164+0000 7f5ef4b45640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:20.827 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:27:20.877 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:27:21.016 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:21.020 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:21.078 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:20 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4139687299' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:27:21.078 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:20 trial105 ceph-mon[39442]: osdmap e70: 4 total, 4 up, 4 in 2026-02-24T08:27:21.078 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:20 trial105 ceph-mon[39442]: 5.7 scrub starts 2026-02-24T08:27:21.078 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:20 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1893496830' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:27:21.078 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:20 trial105 ceph-mon[39442]: 5.7 scrub ok 2026-02-24T08:27:21.140 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:21.137+0000 7f26aca97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:21.140 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:21.138+0000 7f26aca97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:21.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 62 128 280216 280088 35.2904 26.5703 0.0889657 0.0283238 2026-02-24T08:27:21.162 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:21.378 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:21.319+0000 7f10d328f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:21.378 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:21.319+0000 7f10d328f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:21.378 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:21.378 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:21.378 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:21.378 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:21.379 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:21.379 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:21.379 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:21.379 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:21.830 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:27:21.880 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:27:22.032 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:22.090 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:21 trial105 ceph-mon[39442]: pgmap v253: 17 pgs: 17 active+clean; 2.1 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.33k op/s 2026-02-24T08:27:22.090 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1893496830' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:27:22.090 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:21 trial105 ceph-mon[39442]: osdmap e71: 4 total, 4 up, 4 in 2026-02-24T08:27:22.090 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/419682983' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:27:22.090 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3540684681' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:22.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 63 128 283476 283348 35.1344 25.4688 0.0192187 0.02845 2026-02-24T08:27:22.164 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:22.162+0000 7fce9c832640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:22.165 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:22.162+0000 7fce9c832640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:22.835 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:27:22.911 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:27:22.911 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:23.047 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:23.102 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:22 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/419682983' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:27:23.103 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:22 trial105 ceph-mon[39442]: osdmap e72: 4 total, 4 up, 4 in 2026-02-24T08:27:23.103 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:22 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/361308075' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:27:23.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 64 128 286917 286789 35.0055 26.8828 0.0325692 0.0285535 2026-02-24T08:27:23.176 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:23.173+0000 7f1648dcb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:23.176 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:23.173+0000 7f1648dcb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:23.332 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:23.332 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:23.375 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2026-02-24T08:27:22.833292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2280055328,"num_objects":34786,"num_object_clones":0,"num_object_copies":104358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34786,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":278390,"num_write_kb":2228190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161154,"ondisk_log_size":161154,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9699744,"kb_used_data":6641808,"kb_used_omap":34,"kb_used_meta":3057821,"kb_avail":2926313056,"statfs":{"total":3006477107200,"available":2996544569344,"internally_reserved":0,"allocated":6801211392,"data_stored":6799514763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35020,"internal_metadata":3131209524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,9,6,7,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":134045696,"num_objects":2046,"num_object_clones":0,"num_object_copies":6138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2046,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16363,"num_write_kb":130904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.088813"},"pg_stats":[{"pgid":"5.f","version":"70'17336","reported_seq":17360,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.616917+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:27:20.616917+0000","last_peered":"2026-02-24T08:27:20.616917+0000","last_clean":"2026-02-24T08:27:20.616917+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:20.616917+0000","last_undegraded":"2026-02-24T08:27:20.616917+0000","last_fullsized":"2026-02-24T08:27:20.616917+0000","mapping_epoch":63,"log_start":"65'7300","ondisk_log_start":"65'7300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142016512,"num_objects":2167,"num_object_clones":0,"num_object_copies":6501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17336,"num_write_kb":138688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"70'17178","reported_seq":17202,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.687869+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:27:20.687869+0000","last_peered":"2026-02-24T08:27:20.687869+0000","last_clean":"2026-02-24T08:27:20.687869+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:20.687869+0000","last_undegraded":"2026-02-24T08:27:20.687869+0000","last_fullsized":"2026-02-24T08:27:20.687869+0000","mapping_epoch":63,"log_start":"65'7100","ondisk_log_start":"65'7100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140722176,"num_objects":2148,"num_object_clones":0,"num_object_copies":6444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17178,"num_write_kb":137424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"70'16639","reported_seq":16657,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.424179+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:27:20.424179+0000","last_peered":"2026-02-24T08:27:20.424179+0000","last_clean":"2026-02-24T08:27:20.424179+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:20.424179+0000","last_undegraded":"2026-02-24T08:27:20.424179+0000","last_fullsized":"2026-02-24T08:27:20.424179+0000","mapping_epoch":63,"log_start":"65'6600","ondisk_log_start":"65'6600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136306688,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16639,"num_write_kb":133112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"70'17623","reported_seq":17641,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.752576+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:27:20.752576+0000","last_peered":"2026-02-24T08:27:20.752576+0000","last_clean":"2026-02-24T08:27:20.752576+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:20.752576+0000","last_undegraded":"2026-02-24T08:27:20.752576+0000","last_fullsized":"2026-02-24T08:27:20.752576+0000","mapping_epoch":63,"log_start":"65'7600","ondisk_log_start":"65'7600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144367616,"num_objects":2203,"num_object_clones":0,"num_object_copies":6609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17623,"num_write_kb":140984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"70'16600","reported_seq":16624,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.486140+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:27:20.486140+0000","last_peered":"2026-02-24T08:27:20.486140+0000","last_clean":"2026-02-24T08:27:20.486140+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:20.486140+0000","last_undegraded":"2026-02-24T08:27:20.486140+0000","last_fullsized":"2026-02-24T08:27:20.486140+0000","mapping_epoch":63,"log_start":"65'6500","ondisk_log_start":"65'6500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135987200,"num_objects":2075,"num_object_clones":0,"num_object_copies":6225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16600,"num_write_kb":132800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"70'17784","reported_seq":17803,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.486636+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:27:20.486636+0000","last_peered":"2026-02-24T08:27:20.486636+0000","last_clean":"2026-02-24T08:27:20.486636+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:20.486636+0000","last_undegraded":"2026-02-24T08:27:20.486636+0000","last_fullsized":"2026-02-24T08:27:20.486636+0000","mapping_epoch":63,"log_start":"65'7700","ondisk_log_start":"65'7700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145686528,"num_objects":2223,"num_object_clones":0,"num_object_copies":6669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17784,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"70'17176","reported_seq":17200,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.663338+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:27:20.663338+0000","last_peered":"2026-02-24T08:27:20.663338+0000","last_clean":"2026-02-24T08:27:20.663338+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:20.663338+0000","last_undegraded":"2026-02-24T08:27:20.663338+0000","last_fullsized":"2026-02-24T08:27:20.663338+0000","mapping_epoch":63,"log_start":"65'7100","ondisk_log_start":"65'7100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140705792,"num_objects":2147,"num_object_clones":0,"num_object_copies":6441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17176,"num_write_kb":137408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"70'17672","reported_seq":17696,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.349038+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:27:20.349038+0000","last_peered":"2026-02-24T08:27:20.349038+0000","last_clean":"2026-02-24T08:27:20.349038+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:20.349038+0000","last_undegraded":"2026-02-24T08:27:20.349038+0000","last_fullsized":"2026-02-24T08:27:20.349038+0000","mapping_epoch":63,"log_start":"65'7600","ondisk_log_start":"65'7600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144769024,"num_objects":2209,"num_object_clones":0,"num_object_copies":6627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17672,"num_write_kb":141376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"70'17851","reported_seq":17904,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.670438+0000","last_change":"2026-02-24T08:27:20.408387+0000","last_active":"2026-02-24T08:27:20.670438+0000","last_peered":"2026-02-24T08:27:20.670438+0000","last_clean":"2026-02-24T08:27:20.670438+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:20.670438+0000","last_undegraded":"2026-02-24T08:27:20.670438+0000","last_fullsized":"2026-02-24T08:27:20.670438+0000","mapping_epoch":63,"log_start":"65'7800","ondisk_log_start":"65'7800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'17800","last_scrub_stamp":"2026-02-24T08:27:20.408345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:20.408345+0000","objects_scrubbed":2214,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:27.738857+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146235392,"num_objects":2232,"num_object_clones":0,"num_object_copies":6696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17851,"num_write_kb":142808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"70'17776","reported_seq":17800,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.785027+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:27:20.785027+0000","last_peered":"2026-02-24T08:27:20.785027+0000","last_clean":"2026-02-24T08:27:20.785027+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:20.785027+0000","last_undegraded":"2026-02-24T08:27:20.785027+0000","last_fullsized":"2026-02-24T08:27:20.785027+0000","mapping_epoch":63,"log_start":"65'7700","ondisk_log_start":"65'7700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145620992,"num_objects":2222,"num_object_clones":0,"num_object_copies":6666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17776,"num_write_kb":142208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"70'17640","reported_seq":17664,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.492681+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:27:20.492681+0000","last_peered":"2026-02-24T08:27:20.492681+0000","last_clean":"2026-02-24T08:27:20.492681+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:20.492681+0000","last_undegraded":"2026-02-24T08:27:20.492681+0000","last_fullsized":"2026-02-24T08:27:20.492681+0000","mapping_epoch":63,"log_start":"65'7600","ondisk_log_start":"65'7600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144506880,"num_objects":2205,"num_object_clones":0,"num_object_copies":6615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2205,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17640,"num_write_kb":141120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"70'17088","reported_seq":17099,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.501606+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:27:20.501606+0000","last_peered":"2026-02-24T08:27:20.501606+0000","last_clean":"2026-02-24T08:27:20.501606+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:20.501606+0000","last_undegraded":"2026-02-24T08:27:20.501606+0000","last_fullsized":"2026-02-24T08:27:20.501606+0000","mapping_epoch":63,"log_start":"65'7000","ondisk_log_start":"65'7000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139984896,"num_objects":2136,"num_object_clones":0,"num_object_copies":6408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17088,"num_write_kb":136704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"70'16982","reported_seq":17006,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.681327+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:27:20.681327+0000","last_peered":"2026-02-24T08:27:20.681327+0000","last_clean":"2026-02-24T08:27:20.681327+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:20.681327+0000","last_undegraded":"2026-02-24T08:27:20.681327+0000","last_fullsized":"2026-02-24T08:27:20.681327+0000","mapping_epoch":63,"log_start":"65'6900","ondisk_log_start":"65'6900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139116544,"num_objects":2123,"num_object_clones":0,"num_object_copies":6369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16982,"num_write_kb":135856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"70'18470","reported_seq":18488,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.681477+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:27:20.681477+0000","last_peered":"2026-02-24T08:27:20.681477+0000","last_clean":"2026-02-24T08:27:20.681477+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:20.681477+0000","last_undegraded":"2026-02-24T08:27:20.681477+0000","last_fullsized":"2026-02-24T08:27:20.681477+0000","mapping_epoch":63,"log_start":"65'8400","ondisk_log_start":"65'8400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151306240,"num_objects":2309,"num_object_clones":0,"num_object_copies":6927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18470,"num_write_kb":147760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"70'16976","reported_seq":17000,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.459041+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:27:20.459041+0000","last_peered":"2026-02-24T08:27:20.459041+0000","last_clean":"2026-02-24T08:27:20.459041+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:20.459041+0000","last_undegraded":"2026-02-24T08:27:20.459041+0000","last_fullsized":"2026-02-24T08:27:20.459041+0000","mapping_epoch":63,"log_start":"65'6900","ondisk_log_start":"65'6900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139067392,"num_objects":2122,"num_object_clones":0,"num_object_copies":6366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16976,"num_write_kb":135808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"70'17464","reported_seq":17488,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.603256+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:27:20.603256+0000","last_peered":"2026-02-24T08:27:20.603256+0000","last_clean":"2026-02-24T08:27:20.603256+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:20.603256+0000","last_undegraded":"2026-02-24T08:27:20.603256+0000","last_fullsized":"2026-02-24T08:27:20.603256+0000","mapping_epoch":63,"log_start":"65'7400","ondisk_log_start":"65'7400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143065088,"num_objects":2183,"num_object_clones":0,"num_object_copies":6549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17464,"num_write_kb":139712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":176,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:19.826779+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:27:19.826779+0000","last_peered":"2026-02-24T08:27:19.826779+0000","last_clean":"2026-02-24T08:27:19.826779+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:19.826779+0000","last_undegraded":"2026-02-24T08:27:19.826779+0000","last_fullsized":"2026-02-24T08:27:19.826779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2279464960,"num_objects":34784,"num_object_clones":0,"num_object_copies":104352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34784,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278255,"num_write_kb":2226040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6840516608,"data_stored":6840516608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161055,"ondisk_log_size":161055,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2691,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247894,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2620236,"kb_used_data":1931320,"kb_used_omap":7,"kb_used_meta":688888,"kb_avail":731382964,"statfs":{"total":751619276800,"available":748936155136,"internally_reserved":0,"allocated":1977671680,"data_stored":1977252544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7316,"internal_metadata":705422188},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444120,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2270880,"kb_used_data":1508364,"kb_used_omap":11,"kb_used_meta":762484,"kb_avail":731732320,"statfs":{"total":751619276800,"available":749293895680,"internally_reserved":0,"allocated":1544564736,"data_stored":1544137721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11622,"internal_metadata":780784282},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,9,6,7,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2350204,"kb_used_data":1398824,"kb_used_omap":7,"kb_used_meta":951352,"kb_avail":731652996,"statfs":{"total":751619276800,"available":749212667904,"internally_reserved":0,"allocated":1432395776,"data_stored":1431972313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7712,"internal_metadata":974184928},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,0,0,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2458424,"kb_used_data":1803300,"kb_used_omap":8,"kb_used_meta":655095,"kb_avail":731544776,"statfs":{"total":751619276800,"available":749101850624,"internally_reserved":0,"allocated":1846579200,"data_stored":1846152185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8370,"internal_metadata":670818126},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2691,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1848090624,"data_stored":1848090624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1437138944,"data_stored":1437138944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1557340160,"data_stored":1557340160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1997946880,"data_stored":1997946880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:23.377 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:23.522 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:23.564 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:23.647 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:23.643+0000 7f6283e52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:23.647 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:23.644+0000 7f6283e52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:23.710 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:23.804 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:23.805 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:23.838 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:23.835+0000 7ff22cd0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:23.839 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:23.837+0000 7ff22cd0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:23.854 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2026-02-24T08:27:22.833292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2280055328,"num_objects":34786,"num_object_clones":0,"num_object_copies":104358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34786,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":278390,"num_write_kb":2228190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161154,"ondisk_log_size":161154,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9699744,"kb_used_data":6641808,"kb_used_omap":34,"kb_used_meta":3057821,"kb_avail":2926313056,"statfs":{"total":3006477107200,"available":2996544569344,"internally_reserved":0,"allocated":6801211392,"data_stored":6799514763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35020,"internal_metadata":3131209524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,9,6,7,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":134045696,"num_objects":2046,"num_object_clones":0,"num_object_copies":6138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2046,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16363,"num_write_kb":130904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.088813"},"pg_stats":[{"pgid":"5.f","version":"70'17336","reported_seq":17360,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.616917+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:27:20.616917+0000","last_peered":"2026-02-24T08:27:20.616917+0000","last_clean":"2026-02-24T08:27:20.616917+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:20.616917+0000","last_undegraded":"2026-02-24T08:27:20.616917+0000","last_fullsized":"2026-02-24T08:27:20.616917+0000","mapping_epoch":63,"log_start":"65'7300","ondisk_log_start":"65'7300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142016512,"num_objects":2167,"num_object_clones":0,"num_object_copies":6501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17336,"num_write_kb":138688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"70'17178","reported_seq":17202,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.687869+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:27:20.687869+0000","last_peered":"2026-02-24T08:27:20.687869+0000","last_clean":"2026-02-24T08:27:20.687869+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:20.687869+0000","last_undegraded":"2026-02-24T08:27:20.687869+0000","last_fullsized":"2026-02-24T08:27:20.687869+0000","mapping_epoch":63,"log_start":"65'7100","ondisk_log_start":"65'7100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140722176,"num_objects":2148,"num_object_clones":0,"num_object_copies":6444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17178,"num_write_kb":137424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"70'16639","reported_seq":16657,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.424179+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:27:20.424179+0000","last_peered":"2026-02-24T08:27:20.424179+0000","last_clean":"2026-02-24T08:27:20.424179+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:20.424179+0000","last_undegraded":"2026-02-24T08:27:20.424179+0000","last_fullsized":"2026-02-24T08:27:20.424179+0000","mapping_epoch":63,"log_start":"65'6600","ondisk_log_start":"65'6600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136306688,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16639,"num_write_kb":133112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"70'17623","reported_seq":17641,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.752576+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:27:20.752576+0000","last_peered":"2026-02-24T08:27:20.752576+0000","last_clean":"2026-02-24T08:27:20.752576+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:20.752576+0000","last_undegraded":"2026-02-24T08:27:20.752576+0000","last_fullsized":"2026-02-24T08:27:20.752576+0000","mapping_epoch":63,"log_start":"65'7600","ondisk_log_start":"65'7600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144367616,"num_objects":2203,"num_object_clones":0,"num_object_copies":6609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17623,"num_write_kb":140984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"70'16600","reported_seq":16624,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.486140+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:27:20.486140+0000","last_peered":"2026-02-24T08:27:20.486140+0000","last_clean":"2026-02-24T08:27:20.486140+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:20.486140+0000","last_undegraded":"2026-02-24T08:27:20.486140+0000","last_fullsized":"2026-02-24T08:27:20.486140+0000","mapping_epoch":63,"log_start":"65'6500","ondisk_log_start":"65'6500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135987200,"num_objects":2075,"num_object_clones":0,"num_object_copies":6225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16600,"num_write_kb":132800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"70'17784","reported_seq":17803,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.486636+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:27:20.486636+0000","last_peered":"2026-02-24T08:27:20.486636+0000","last_clean":"2026-02-24T08:27:20.486636+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:20.486636+0000","last_undegraded":"2026-02-24T08:27:20.486636+0000","last_fullsized":"2026-02-24T08:27:20.486636+0000","mapping_epoch":63,"log_start":"65'7700","ondisk_log_start":"65'7700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145686528,"num_objects":2223,"num_object_clones":0,"num_object_copies":6669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17784,"num_write_kb":142272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"70'17176","reported_seq":17200,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.663338+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:27:20.663338+0000","last_peered":"2026-02-24T08:27:20.663338+0000","last_clean":"2026-02-24T08:27:20.663338+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:20.663338+0000","last_undegraded":"2026-02-24T08:27:20.663338+0000","last_fullsized":"2026-02-24T08:27:20.663338+0000","mapping_epoch":63,"log_start":"65'7100","ondisk_log_start":"65'7100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140705792,"num_objects":2147,"num_object_clones":0,"num_object_copies":6441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17176,"num_write_kb":137408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"70'17672","reported_seq":17696,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.349038+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:27:20.349038+0000","last_peered":"2026-02-24T08:27:20.349038+0000","last_clean":"2026-02-24T08:27:20.349038+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:20.349038+0000","last_undegraded":"2026-02-24T08:27:20.349038+0000","last_fullsized":"2026-02-24T08:27:20.349038+0000","mapping_epoch":63,"log_start":"65'7600","ondisk_log_start":"65'7600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144769024,"num_objects":2209,"num_object_clones":0,"num_object_copies":6627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17672,"num_write_kb":141376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"70'17851","reported_seq":17904,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.670438+0000","last_change":"2026-02-24T08:27:20.408387+0000","last_active":"2026-02-24T08:27:20.670438+0000","last_peered":"2026-02-24T08:27:20.670438+0000","last_clean":"2026-02-24T08:27:20.670438+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:20.670438+0000","last_undegraded":"2026-02-24T08:27:20.670438+0000","last_fullsized":"2026-02-24T08:27:20.670438+0000","mapping_epoch":63,"log_start":"65'7800","ondisk_log_start":"65'7800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'17800","last_scrub_stamp":"2026-02-24T08:27:20.408345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:20.408345+0000","objects_scrubbed":2214,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:27.738857+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146235392,"num_objects":2232,"num_object_clones":0,"num_object_copies":6696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17851,"num_write_kb":142808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"70'17776","reported_seq":17800,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.785027+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:27:20.785027+0000","last_peered":"2026-02-24T08:27:20.785027+0000","last_clean":"2026-02-24T08:27:20.785027+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:20.785027+0000","last_undegraded":"2026-02-24T08:27:20.785027+0000","last_fullsized":"2026-02-24T08:27:20.785027+0000","mapping_epoch":63,"log_start":"65'7700","ondisk_log_start":"65'7700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145620992,"num_objects":2222,"num_object_clones":0,"num_object_copies":6666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17776,"num_write_kb":142208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"70'17640","reported_seq":17664,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.492681+0000","last_change":"2026-02-24T08:26:18.067812+0000","last_active":"2026-02-24T08:27:20.492681+0000","last_peered":"2026-02-24T08:27:20.492681+0000","last_clean":"2026-02-24T08:27:20.492681+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:20.492681+0000","last_undegraded":"2026-02-24T08:27:20.492681+0000","last_fullsized":"2026-02-24T08:27:20.492681+0000","mapping_epoch":63,"log_start":"65'7600","ondisk_log_start":"65'7600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:24.377801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144506880,"num_objects":2205,"num_object_clones":0,"num_object_copies":6615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2205,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17640,"num_write_kb":141120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"70'17088","reported_seq":17099,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.501606+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:27:20.501606+0000","last_peered":"2026-02-24T08:27:20.501606+0000","last_clean":"2026-02-24T08:27:20.501606+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:20.501606+0000","last_undegraded":"2026-02-24T08:27:20.501606+0000","last_fullsized":"2026-02-24T08:27:20.501606+0000","mapping_epoch":63,"log_start":"65'7000","ondisk_log_start":"65'7000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139984896,"num_objects":2136,"num_object_clones":0,"num_object_copies":6408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17088,"num_write_kb":136704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"70'16982","reported_seq":17006,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.681327+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:27:20.681327+0000","last_peered":"2026-02-24T08:27:20.681327+0000","last_clean":"2026-02-24T08:27:20.681327+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:20.681327+0000","last_undegraded":"2026-02-24T08:27:20.681327+0000","last_fullsized":"2026-02-24T08:27:20.681327+0000","mapping_epoch":63,"log_start":"65'6900","ondisk_log_start":"65'6900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139116544,"num_objects":2123,"num_object_clones":0,"num_object_copies":6369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16982,"num_write_kb":135856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"70'18470","reported_seq":18488,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.681477+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:27:20.681477+0000","last_peered":"2026-02-24T08:27:20.681477+0000","last_clean":"2026-02-24T08:27:20.681477+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:20.681477+0000","last_undegraded":"2026-02-24T08:27:20.681477+0000","last_fullsized":"2026-02-24T08:27:20.681477+0000","mapping_epoch":63,"log_start":"65'8400","ondisk_log_start":"65'8400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:25.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151306240,"num_objects":2309,"num_object_clones":0,"num_object_copies":6927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18470,"num_write_kb":147760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"70'16976","reported_seq":17000,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.459041+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:27:20.459041+0000","last_peered":"2026-02-24T08:27:20.459041+0000","last_clean":"2026-02-24T08:27:20.459041+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:20.459041+0000","last_undegraded":"2026-02-24T08:27:20.459041+0000","last_fullsized":"2026-02-24T08:27:20.459041+0000","mapping_epoch":63,"log_start":"65'6900","ondisk_log_start":"65'6900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139067392,"num_objects":2122,"num_object_clones":0,"num_object_copies":6366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16976,"num_write_kb":135808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"70'17464","reported_seq":17488,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:20.603256+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:27:20.603256+0000","last_peered":"2026-02-24T08:27:20.603256+0000","last_clean":"2026-02-24T08:27:20.603256+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:20.603256+0000","last_undegraded":"2026-02-24T08:27:20.603256+0000","last_fullsized":"2026-02-24T08:27:20.603256+0000","mapping_epoch":63,"log_start":"65'7400","ondisk_log_start":"65'7400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:23.123949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143065088,"num_objects":2183,"num_object_clones":0,"num_object_copies":6549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2183,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17464,"num_write_kb":139712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":176,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-24T08:27:19.826779+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:27:19.826779+0000","last_peered":"2026-02-24T08:27:19.826779+0000","last_clean":"2026-02-24T08:27:19.826779+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:19.826779+0000","last_undegraded":"2026-02-24T08:27:19.826779+0000","last_fullsized":"2026-02-24T08:27:19.826779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2279464960,"num_objects":34784,"num_object_clones":0,"num_object_copies":104352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34784,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278255,"num_write_kb":2226040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6840516608,"data_stored":6840516608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161055,"ondisk_log_size":161055,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2691,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247894,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2620236,"kb_used_data":1931320,"kb_used_omap":7,"kb_used_meta":688888,"kb_avail":731382964,"statfs":{"total":751619276800,"available":748936155136,"internally_reserved":0,"allocated":1977671680,"data_stored":1977252544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7316,"internal_metadata":705422188},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444120,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2270880,"kb_used_data":1508364,"kb_used_omap":11,"kb_used_meta":762484,"kb_avail":731732320,"statfs":{"total":751619276800,"available":749293895680,"internally_reserved":0,"allocated":1544564736,"data_stored":1544137721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11622,"internal_metadata":780784282},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,9,6,7,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2350204,"kb_used_data":1398824,"kb_used_omap":7,"kb_used_meta":951352,"kb_avail":731652996,"statfs":{"total":751619276800,"available":749212667904,"internally_reserved":0,"allocated":1432395776,"data_stored":1431972313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7712,"internal_metadata":974184928},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,0,0,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2458424,"kb_used_data":1803300,"kb_used_omap":8,"kb_used_meta":655095,"kb_avail":731544776,"statfs":{"total":751619276800,"available":749101850624,"internally_reserved":0,"allocated":1846579200,"data_stored":1846152185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8370,"internal_metadata":670818126},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2691,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1848090624,"data_stored":1848090624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1437138944,"data_stored":1437138944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1557340160,"data_stored":1557340160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1997946880,"data_stored":1997946880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:23.856 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:27:23.857 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:27:23.857 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:27:23.857 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:27:23.858 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:23.859 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:23.872 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:23.872 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:23.885 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:23.885 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:23.898 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:23 trial105 ceph-mon[39442]: pgmap v256: 17 pgs: 17 active+clean; 2.1 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.73k op/s 2026-02-24T08:27:23.899 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/361308075' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:27:23.899 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:23 trial105 ceph-mon[39442]: osdmap e73: 4 total, 4 up, 4 in 2026-02-24T08:27:23.899 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:23.899 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:24.009 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:24.138 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:24.135+0000 7f647c37c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:24.138 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:24.135+0000 7f647c37c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:24.158 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:27:24.159 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:27:24.160 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:27:24.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 65 128 290302 290174 34.8738 26.4453 0.0469352 0.0286593 2026-02-24T08:27:24.224 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:27:24.225 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:27:24.225 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:27:24.369 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:24.493 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:24.490+0000 7fd4dde1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:24.493 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:24.490+0000 7fd4dde1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:24.514 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:27:24.514 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:27:24.514 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:27:24.514 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:27:24.514 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:27:24.515 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:27:24.515 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:27:24.515 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:27:24.515 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:27:24.515 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:27:24.515 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:27:24.515 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:27:24.550 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:27:24.551 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:27:24.551 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:27:24.704 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:24.833 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:24.830+0000 7f523e0e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:24.835 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:24.833+0000 7f523e0e0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:24.863 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:27:24.863 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:27:24.863 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:27:24.863 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:27:24.863 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:27:24.863 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:27:24.863 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:27:24.863 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:27:24.863 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:27:24.864 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:27:24.864 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:27:24.864 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:27:24.903 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:27:24.904 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:27:24.904 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:27:25.049 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:25.074 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:24 trial105 ceph-mon[39442]: from='client.15017 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:25.075 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:24 trial105 ceph-mon[39442]: from='client.15019 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:25.075 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3728326866' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:25.075 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:24 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:27:25.075 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:24 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:27:25.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 66 128 293676 293548 34.7447 26.3594 0.0651058 0.02877 2026-02-24T08:27:25.177 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:25.174+0000 7fbf11424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:25.177 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:25.174+0000 7fbf11424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:25.200 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:27:25.200 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:27:25.200 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:27:25.200 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:27:25.200 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:27:25.200 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:27:25.201 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:27:25.201 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:27:25.201 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:27:25.201 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:27:25.201 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:27:25.201 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:27:25.236 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:27:25.237 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:27:25.953 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:26.096 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:26.122 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:25 trial105 ceph-mon[39442]: pgmap v258: 17 pgs: 17 active+clean; 2.1 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.33k op/s 2026-02-24T08:27:26.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 67 128 297018 296890 34.6158 26.1094 0.0412455 0.0288737 2026-02-24T08:27:26.225 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:26.222+0000 7fc28c4d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:26.225 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:26.223+0000 7fc28c4d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:26.239 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:26.239 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:26.251 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:26.251 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:26.265 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:26.265 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:26.279 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:26.279 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:27.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 68 128 300268 300140 34.4801 25.3906 0.0304558 0.0289854 2026-02-24T08:27:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:26 trial105 ceph-mon[39442]: 5.5 scrub starts 2026-02-24T08:27:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2918219553' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:28.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 69 128 303639 303511 34.3621 26.3359 0.0117816 0.0290842 2026-02-24T08:27:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:27 trial105 ceph-mon[39442]: 5.1 scrub starts 2026-02-24T08:27:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:27 trial105 ceph-mon[39442]: pgmap v259: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.3 GiB data, 9.7 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.16k op/s 2026-02-24T08:27:28.322 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:28.477 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:28.609 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:28.605+0000 7f39c1695640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:28.609 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:28.605+0000 7f39c1695640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:28.627 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:28.628 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:28.642 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:28.642 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:28.656 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:28.656 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:28.671 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:28.672 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:28.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:28 trial105 ceph-mon[39442]: 5.5 scrub ok 2026-02-24T08:27:28.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:28 trial105 ceph-mon[39442]: 5.1 scrub ok 2026-02-24T08:27:28.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4165262705' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:29.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 70 128 307109 306981 34.2584 27.1094 0.0121288 0.0291767 2026-02-24T08:27:29.844 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:27:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:27:29] "GET /metrics HTTP/1.1" 200 4216 "" "Prometheus/3.6.0" 2026-02-24T08:27:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:27:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:27:29.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:27:30.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 71 128 310556 310428 34.1552 26.9297 0.0078154 0.0292613 2026-02-24T08:27:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:29 trial105 ceph-mon[39442]: pgmap v260: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.3 GiB data, 9.7 GiB used, 2.7 TiB / 2.7 TiB avail; 17 MiB/s wr, 2.14k op/s 2026-02-24T08:27:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:27:30.238 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:27:30.238 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:27:30.238 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T08:27:30.238 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:30.389 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:30.515 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:30.511+0000 7ff916ff0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:30.515 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:30.511+0000 7ff916ff0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:30.662 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:30.662 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:30.709 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2026-02-24T08:27:28.745858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2418786848,"num_objects":36905,"num_object_clones":0,"num_object_copies":110715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36905,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":295325,"num_write_kb":2363670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160989,"ondisk_log_size":160989,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10207348,"kb_used_data":7041124,"kb_used_omap":43,"kb_used_meta":3166100,"kb_avail":2925805452,"statfs":{"total":3006477107200,"available":2996024782848,"internally_reserved":0,"allocated":7210110976,"data_stored":7208311920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44625,"internal_metadata":3242086831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,6,8,0,6,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":138731520,"num_objects":2119,"num_object_clones":0,"num_object_copies":6357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16935,"num_write_kb":135480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.919776"},"pg_stats":[{"pgid":"5.f","version":"73'18448","reported_seq":18478,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.603114+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:27:25.603114+0000","last_peered":"2026-02-24T08:27:25.603114+0000","last_clean":"2026-02-24T08:27:25.603114+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:25.603114+0000","last_undegraded":"2026-02-24T08:27:25.603114+0000","last_fullsized":"2026-02-24T08:27:25.603114+0000","mapping_epoch":63,"log_start":"65'8400","ondisk_log_start":"65'8400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151126016,"num_objects":2306,"num_object_clones":0,"num_object_copies":6918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18448,"num_write_kb":147584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"73'18233","reported_seq":18259,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.695219+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:27:25.695219+0000","last_peered":"2026-02-24T08:27:25.695219+0000","last_clean":"2026-02-24T08:27:25.695219+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:25.695219+0000","last_undegraded":"2026-02-24T08:27:25.695219+0000","last_fullsized":"2026-02-24T08:27:25.695219+0000","mapping_epoch":63,"log_start":"65'8200","ondisk_log_start":"65'8200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149364736,"num_objects":2280,"num_object_clones":0,"num_object_copies":6840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18233,"num_write_kb":145864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"73'17595","reported_seq":17623,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.484008+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:27:25.484008+0000","last_peered":"2026-02-24T08:27:25.484008+0000","last_clean":"2026-02-24T08:27:25.484008+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:25.484008+0000","last_undegraded":"2026-02-24T08:27:25.484008+0000","last_fullsized":"2026-02-24T08:27:25.484008+0000","mapping_epoch":63,"log_start":"65'7500","ondisk_log_start":"65'7500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:27.197380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144138240,"num_objects":2200,"num_object_clones":0,"num_object_copies":6600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17595,"num_write_kb":140760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"73'18752","reported_seq":18782,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.775198+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:27:25.775198+0000","last_peered":"2026-02-24T08:27:25.775198+0000","last_clean":"2026-02-24T08:27:25.775198+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:25.775198+0000","last_undegraded":"2026-02-24T08:27:25.775198+0000","last_fullsized":"2026-02-24T08:27:25.775198+0000","mapping_epoch":63,"log_start":"65'8700","ondisk_log_start":"65'8700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153616384,"num_objects":2344,"num_object_clones":0,"num_object_copies":7032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18752,"num_write_kb":150016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"73'17624","reported_seq":17654,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.466911+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:27:25.466911+0000","last_peered":"2026-02-24T08:27:25.466911+0000","last_clean":"2026-02-24T08:27:25.466911+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:25.466911+0000","last_undegraded":"2026-02-24T08:27:25.466911+0000","last_fullsized":"2026-02-24T08:27:25.466911+0000","mapping_epoch":63,"log_start":"65'7600","ondisk_log_start":"65'7600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144375808,"num_objects":2203,"num_object_clones":0,"num_object_copies":6609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17624,"num_write_kb":140992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"73'18988","reported_seq":19018,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.522706+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:27:25.522706+0000","last_peered":"2026-02-24T08:27:25.522706+0000","last_clean":"2026-02-24T08:27:25.522706+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:25.522706+0000","last_undegraded":"2026-02-24T08:27:25.522706+0000","last_fullsized":"2026-02-24T08:27:25.522706+0000","mapping_epoch":63,"log_start":"65'8900","ondisk_log_start":"65'8900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155549696,"num_objects":2374,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2374,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18988,"num_write_kb":151904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"73'18272","reported_seq":18300,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.701295+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:27:25.701295+0000","last_peered":"2026-02-24T08:27:25.701295+0000","last_clean":"2026-02-24T08:27:25.701295+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:25.701295+0000","last_undegraded":"2026-02-24T08:27:25.701295+0000","last_fullsized":"2026-02-24T08:27:25.701295+0000","mapping_epoch":63,"log_start":"65'8200","ondisk_log_start":"65'8200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149684224,"num_objects":2284,"num_object_clones":0,"num_object_copies":6852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18272,"num_write_kb":146176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"73'18840","reported_seq":18870,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.447680+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:27:25.447680+0000","last_peered":"2026-02-24T08:27:25.447680+0000","last_clean":"2026-02-24T08:27:25.447680+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:25.447680+0000","last_undegraded":"2026-02-24T08:27:25.447680+0000","last_fullsized":"2026-02-24T08:27:25.447680+0000","mapping_epoch":63,"log_start":"65'8800","ondisk_log_start":"65'8800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154337280,"num_objects":2355,"num_object_clones":0,"num_object_copies":7065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18840,"num_write_kb":150720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"73'18947","reported_seq":19007,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.707094+0000","last_change":"2026-02-24T08:27:20.408387+0000","last_active":"2026-02-24T08:27:25.707094+0000","last_peered":"2026-02-24T08:27:25.707094+0000","last_clean":"2026-02-24T08:27:25.707094+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:25.707094+0000","last_undegraded":"2026-02-24T08:27:25.707094+0000","last_fullsized":"2026-02-24T08:27:25.707094+0000","mapping_epoch":63,"log_start":"65'8900","ondisk_log_start":"65'8900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'17800","last_scrub_stamp":"2026-02-24T08:27:20.408345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:20.408345+0000","objects_scrubbed":2214,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:27.738857+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155213824,"num_objects":2369,"num_object_clones":0,"num_object_copies":7107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18947,"num_write_kb":151576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"73'18729","reported_seq":18751,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.786907+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:27:25.786907+0000","last_peered":"2026-02-24T08:27:25.786907+0000","last_clean":"2026-02-24T08:27:25.786907+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:25.786907+0000","last_undegraded":"2026-02-24T08:27:25.786907+0000","last_fullsized":"2026-02-24T08:27:25.786907+0000","mapping_epoch":63,"log_start":"65'8700","ondisk_log_start":"65'8700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153427968,"num_objects":2342,"num_object_clones":0,"num_object_copies":7026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2342,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18729,"num_write_kb":149832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"73'18616","reported_seq":18661,"reported_epoch":73,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:27:25.513978+0000","last_change":"2026-02-24T08:27:25.251674+0000","last_active":"2026-02-24T08:27:25.513978+0000","last_peered":"2026-02-24T08:27:25.513978+0000","last_clean":"2026-02-24T08:27:25.513978+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:25.513978+0000","last_undegraded":"2026-02-24T08:27:25.513978+0000","last_fullsized":"2026-02-24T08:27:25.513978+0000","mapping_epoch":63,"log_start":"65'8600","ondisk_log_start":"65'8600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":1099,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152502272,"num_objects":2327,"num_object_clones":0,"num_object_copies":6981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18616,"num_write_kb":148928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"73'18096","reported_seq":18126,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.524588+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:27:25.524588+0000","last_peered":"2026-02-24T08:27:25.524588+0000","last_clean":"2026-02-24T08:27:25.524588+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:25.524588+0000","last_undegraded":"2026-02-24T08:27:25.524588+0000","last_fullsized":"2026-02-24T08:27:25.524588+0000","mapping_epoch":63,"log_start":"65'8000","ondisk_log_start":"65'8000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148242432,"num_objects":2262,"num_object_clones":0,"num_object_copies":6786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18096,"num_write_kb":144768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"73'18200","reported_seq":18230,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.682012+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:27:25.682012+0000","last_peered":"2026-02-24T08:27:25.682012+0000","last_clean":"2026-02-24T08:27:25.682012+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:25.682012+0000","last_undegraded":"2026-02-24T08:27:25.682012+0000","last_fullsized":"2026-02-24T08:27:25.682012+0000","mapping_epoch":63,"log_start":"65'8100","ondisk_log_start":"65'8100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:30.309062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149094400,"num_objects":2275,"num_object_clones":0,"num_object_copies":6825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2275,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18200,"num_write_kb":145600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"73'19476","reported_seq":19502,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.697908+0000","last_change":"2026-02-24T08:26:18.067619+0000","last_active":"2026-02-24T08:27:25.697908+0000","last_peered":"2026-02-24T08:27:25.697908+0000","last_clean":"2026-02-24T08:27:25.697908+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:25.697908+0000","last_undegraded":"2026-02-24T08:27:25.697908+0000","last_fullsized":"2026-02-24T08:27:25.697908+0000","mapping_epoch":63,"log_start":"65'9400","ondisk_log_start":"65'9400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159547392,"num_objects":2435,"num_object_clones":0,"num_object_copies":7305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19476,"num_write_kb":155808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"73'17928","reported_seq":17958,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.523202+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:27:25.523202+0000","last_peered":"2026-02-24T08:27:25.523202+0000","last_clean":"2026-02-24T08:27:25.523202+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:25.523202+0000","last_undegraded":"2026-02-24T08:27:25.523202+0000","last_fullsized":"2026-02-24T08:27:25.523202+0000","mapping_epoch":63,"log_start":"65'7900","ondisk_log_start":"65'7900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146866176,"num_objects":2241,"num_object_clones":0,"num_object_copies":6723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17928,"num_write_kb":143424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"73'18446","reported_seq":18476,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:25.625796+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:27:25.625796+0000","last_peered":"2026-02-24T08:27:25.625796+0000","last_clean":"2026-02-24T08:27:25.625796+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:25.625796+0000","last_undegraded":"2026-02-24T08:27:25.625796+0000","last_fullsized":"2026-02-24T08:27:25.625796+0000","mapping_epoch":63,"log_start":"65'8400","ondisk_log_start":"65'8400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151109632,"num_objects":2306,"num_object_clones":0,"num_object_copies":6918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2306,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18446,"num_write_kb":147568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":182,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:22.835540+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:27:22.835540+0000","last_peered":"2026-02-24T08:27:22.835540+0000","last_clean":"2026-02-24T08:27:22.835540+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:22.835540+0000","last_undegraded":"2026-02-24T08:27:22.835540+0000","last_fullsized":"2026-02-24T08:27:22.835540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2418196480,"num_objects":36903,"num_object_clones":0,"num_object_copies":110709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295190,"num_write_kb":2361520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7256702976,"data_stored":7256702976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160890,"ondisk_log_size":160890,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2777,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247895,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2772300,"kb_used_data":2047288,"kb_used_omap":10,"kb_used_meta":724981,"kb_avail":731230900,"statfs":{"total":751619276800,"available":748780441600,"internally_reserved":0,"allocated":2096422912,"data_stored":2095972260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10401,"internal_metadata":742381407},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444121,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2380316,"kb_used_data":1599752,"kb_used_omap":13,"kb_used_meta":780530,"kb_avail":731622884,"statfs":{"total":751619276800,"available":749181833216,"internally_reserved":0,"allocated":1638146048,"data_stored":1637695396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13578,"internal_metadata":799263478},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,6,8,0,6,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2470240,"kb_used_data":1482764,"kb_used_omap":10,"kb_used_meta":987445,"kb_avail":731532960,"statfs":{"total":751619276800,"available":749089751040,"internally_reserved":0,"allocated":1518350336,"data_stored":1517903236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10320,"internal_metadata":1011144624},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2584492,"kb_used_data":1911320,"kb_used_omap":10,"kb_used_meta":673141,"kb_avail":731418708,"statfs":{"total":751619276800,"available":748972756992,"internally_reserved":0,"allocated":1957191680,"data_stored":1956741028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10326,"internal_metadata":689297322},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2777,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1962139648,"data_stored":1962139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1523884032,"data_stored":1523884032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1650941952,"data_stored":1650941952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2119737344,"data_stored":2119737344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:30.710 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:27:30.710 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 56 2026-02-24T08:27:30.724 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:30.859 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:30.897 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:30.992 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:30.988+0000 7f19ce95c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:30.993 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:30.989+0000 7f19ce95c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:30.997 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:30.994+0000 7f799cdf0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:30.997 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:30.994+0000 7f799cdf0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:31.019 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:31.019 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:31.034 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:31.034 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:31.048 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:31.048 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:31.064 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:31.065 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:31.150 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:27:31.162 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 72 128 313861 313733 34.0394 25.8203 0.0292671 0.0293655 2026-02-24T08:27:31.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:32.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 73 128 317266 317138 33.9375 26.6016 0.0307626 0.0294534 2026-02-24T08:27:32.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:31 trial105 ceph-mon[39442]: from='client.15035 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:32.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:31 trial105 ceph-mon[39442]: pgmap v261: 17 pgs: 17 active+clean; 2.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.59k op/s 2026-02-24T08:27:32.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:31 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1753618306' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:32.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:31 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/401547990' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T08:27:33.113 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:33.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 74 128 320782 320654 33.85 27.4688 0.0290236 0.0295326 2026-02-24T08:27:33.263 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:33.378 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:33 trial105 ceph-mon[39442]: pgmap v262: 17 pgs: 17 active+clean; 2.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.38k op/s 2026-02-24T08:27:33.798 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:33.730+0000 7fb4892dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:33.799 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:33.730+0000 7fb4892dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:33.799 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:33.799 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:33.799 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:33.799 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:33.799 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:33.800 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:33.802 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:33.802 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:34.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 75 128 323503 323375 33.6821 21.2578 0.017918 0.0296763 2026-02-24T08:27:34.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/185150071' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:34.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:34 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:27:34.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:34 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:27:35.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 76 128 326260 326132 33.5223 21.5391 0.0212576 0.0298128 2026-02-24T08:27:35.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:35 trial105 ceph-mon[39442]: 5.4 scrub starts 2026-02-24T08:27:35.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:35 trial105 ceph-mon[39442]: 5.d scrub starts 2026-02-24T08:27:35.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:35 trial105 ceph-mon[39442]: 5.4 scrub ok 2026-02-24T08:27:35.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:35 trial105 ceph-mon[39442]: 5.d scrub ok 2026-02-24T08:27:35.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:35 trial105 ceph-mon[39442]: pgmap v263: 17 pgs: 17 active+clean; 2.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.84k op/s 2026-02-24T08:27:36.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 77 127 329561 329434 33.4219 25.7969 0.0167931 0.0299085 2026-02-24T08:27:36.196 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:27:36.196 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:27:36.196 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:27:36.197 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:36.338 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:36.460 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:36.456+0000 7f6a3ab19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:36.460 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:36.456+0000 7f6a3ab19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:36.505 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:36.612 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:36.613 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:36.664 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2026-02-24T08:27:34.746694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2557198880,"num_objects":39015,"num_object_clones":0,"num_object_copies":117045,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39015,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":312221,"num_write_kb":2498838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160785,"ondisk_log_size":160785,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10720492,"kb_used_data":7445980,"kb_used_omap":43,"kb_used_meta":3274388,"kb_avail":2925292308,"statfs":{"total":3006477107200,"available":2995499323392,"internally_reserved":0,"allocated":7624683520,"data_stored":7622884464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44625,"internal_metadata":3352973743},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,4,1,0,16,8,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":277143552,"num_objects":4229,"num_object_clones":0,"num_object_copies":12687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33831,"num_write_kb":270648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.913402"},"pg_stats":[{"pgid":"5.f","version":"73'19503","reported_seq":19533,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.653650+0000","last_change":"2026-02-24T08:26:18.066550+0000","last_active":"2026-02-24T08:27:30.653650+0000","last_peered":"2026-02-24T08:27:30.653650+0000","last_clean":"2026-02-24T08:27:30.653650+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:30.653650+0000","last_undegraded":"2026-02-24T08:27:30.653650+0000","last_fullsized":"2026-02-24T08:27:30.653650+0000","mapping_epoch":63,"log_start":"65'9500","ondisk_log_start":"65'9500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.222602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159768576,"num_objects":2438,"num_object_clones":0,"num_object_copies":7314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19503,"num_write_kb":156024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"73'19183","reported_seq":19194,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.718334+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:27:30.718334+0000","last_peered":"2026-02-24T08:27:30.718334+0000","last_clean":"2026-02-24T08:27:30.718334+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:30.718334+0000","last_undegraded":"2026-02-24T08:27:30.718334+0000","last_fullsized":"2026-02-24T08:27:30.718334+0000","mapping_epoch":63,"log_start":"65'9100","ondisk_log_start":"65'9100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.708338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157147136,"num_objects":2398,"num_object_clones":0,"num_object_copies":7194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19183,"num_write_kb":153464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"73'18720","reported_seq":18750,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.536850+0000","last_change":"2026-02-24T08:26:18.068061+0000","last_active":"2026-02-24T08:27:30.536850+0000","last_peered":"2026-02-24T08:27:30.536850+0000","last_clean":"2026-02-24T08:27:30.536850+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:30.536850+0000","last_undegraded":"2026-02-24T08:27:30.536850+0000","last_fullsized":"2026-02-24T08:27:30.536850+0000","mapping_epoch":63,"log_start":"65'8700","ondisk_log_start":"65'8700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153354240,"num_objects":2340,"num_object_clones":0,"num_object_copies":7020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18720,"num_write_kb":149760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"73'19726","reported_seq":19754,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.787163+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:27:30.787163+0000","last_peered":"2026-02-24T08:27:30.787163+0000","last_clean":"2026-02-24T08:27:30.787163+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:30.787163+0000","last_undegraded":"2026-02-24T08:27:30.787163+0000","last_fullsized":"2026-02-24T08:27:30.787163+0000","mapping_epoch":63,"log_start":"65'9700","ondisk_log_start":"65'9700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161595392,"num_objects":2466,"num_object_clones":0,"num_object_copies":7398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19726,"num_write_kb":157808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"73'18568","reported_seq":18598,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.483556+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:27:30.483556+0000","last_peered":"2026-02-24T08:27:30.483556+0000","last_clean":"2026-02-24T08:27:30.483556+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:30.483556+0000","last_undegraded":"2026-02-24T08:27:30.483556+0000","last_fullsized":"2026-02-24T08:27:30.483556+0000","mapping_epoch":63,"log_start":"65'8500","ondisk_log_start":"65'8500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152109056,"num_objects":2321,"num_object_clones":0,"num_object_copies":6963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2321,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18568,"num_write_kb":148544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"73'19928","reported_seq":19958,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.526428+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:27:30.526428+0000","last_peered":"2026-02-24T08:27:30.526428+0000","last_clean":"2026-02-24T08:27:30.526428+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:30.526428+0000","last_undegraded":"2026-02-24T08:27:30.526428+0000","last_fullsized":"2026-02-24T08:27:30.526428+0000","mapping_epoch":63,"log_start":"65'9900","ondisk_log_start":"65'9900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163250176,"num_objects":2491,"num_object_clones":0,"num_object_copies":7473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19928,"num_write_kb":159424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"73'19416","reported_seq":19439,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.686156+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:27:30.686156+0000","last_peered":"2026-02-24T08:27:30.686156+0000","last_clean":"2026-02-24T08:27:30.686156+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:30.686156+0000","last_undegraded":"2026-02-24T08:27:30.686156+0000","last_fullsized":"2026-02-24T08:27:30.686156+0000","mapping_epoch":63,"log_start":"65'9400","ondisk_log_start":"65'9400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159055872,"num_objects":2427,"num_object_clones":0,"num_object_copies":7281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19416,"num_write_kb":155328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"73'19872","reported_seq":19902,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.512527+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:27:30.512527+0000","last_peered":"2026-02-24T08:27:30.512527+0000","last_clean":"2026-02-24T08:27:30.512527+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:30.512527+0000","last_undegraded":"2026-02-24T08:27:30.512527+0000","last_fullsized":"2026-02-24T08:27:30.512527+0000","mapping_epoch":63,"log_start":"65'9800","ondisk_log_start":"65'9800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162791424,"num_objects":2484,"num_object_clones":0,"num_object_copies":7452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19872,"num_write_kb":158976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"73'20152","reported_seq":20213,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.638680+0000","last_change":"2026-02-24T08:27:20.408387+0000","last_active":"2026-02-24T08:27:30.638680+0000","last_peered":"2026-02-24T08:27:30.638680+0000","last_clean":"2026-02-24T08:27:30.638680+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:30.638680+0000","last_undegraded":"2026-02-24T08:27:30.638680+0000","last_fullsized":"2026-02-24T08:27:30.638680+0000","mapping_epoch":63,"log_start":"65'10100","ondisk_log_start":"65'10100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'17800","last_scrub_stamp":"2026-02-24T08:27:20.408345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:20.408345+0000","objects_scrubbed":2214,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:27.738857+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165085184,"num_objects":2519,"num_object_clones":0,"num_object_copies":7557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20152,"num_write_kb":161216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"73'19602","reported_seq":19629,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.793495+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:27:30.793495+0000","last_peered":"2026-02-24T08:27:30.793495+0000","last_clean":"2026-02-24T08:27:30.793495+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:30.793495+0000","last_undegraded":"2026-02-24T08:27:30.793495+0000","last_fullsized":"2026-02-24T08:27:30.793495+0000","mapping_epoch":63,"log_start":"65'9600","ondisk_log_start":"65'9600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160579584,"num_objects":2451,"num_object_clones":0,"num_object_copies":7353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19602,"num_write_kb":156816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"73'19706","reported_seq":19769,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.536973+0000","last_change":"2026-02-24T08:27:26.865159+0000","last_active":"2026-02-24T08:27:30.536973+0000","last_peered":"2026-02-24T08:27:30.536973+0000","last_clean":"2026-02-24T08:27:30.536973+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:30.536973+0000","last_undegraded":"2026-02-24T08:27:30.536973+0000","last_fullsized":"2026-02-24T08:27:30.536973+0000","mapping_epoch":63,"log_start":"65'9700","ondisk_log_start":"65'9700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'18960","last_scrub_stamp":"2026-02-24T08:27:26.865105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:26.865105+0000","objects_scrubbed":2335,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:45.774021+0000","scrub_duration":1596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161431552,"num_objects":2464,"num_object_clones":0,"num_object_copies":7392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19706,"num_write_kb":157648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"73'19048","reported_seq":19078,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.501125+0000","last_change":"2026-02-24T08:26:18.067589+0000","last_active":"2026-02-24T08:27:30.501125+0000","last_peered":"2026-02-24T08:27:30.501125+0000","last_clean":"2026-02-24T08:27:30.501125+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:30.501125+0000","last_undegraded":"2026-02-24T08:27:30.501125+0000","last_fullsized":"2026-02-24T08:27:30.501125+0000","mapping_epoch":63,"log_start":"65'9000","ondisk_log_start":"65'9000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:31.649080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156041216,"num_objects":2381,"num_object_clones":0,"num_object_copies":7143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19048,"num_write_kb":152384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"73'19432","reported_seq":19462,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.676332+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:27:30.676332+0000","last_peered":"2026-02-24T08:27:30.676332+0000","last_clean":"2026-02-24T08:27:30.676332+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:30.676332+0000","last_undegraded":"2026-02-24T08:27:30.676332+0000","last_fullsized":"2026-02-24T08:27:30.676332+0000","mapping_epoch":63,"log_start":"65'9400","ondisk_log_start":"65'9400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159186944,"num_objects":2429,"num_object_clones":0,"num_object_copies":7287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19432,"num_write_kb":155456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"73'20560","reported_seq":20623,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.702513+0000","last_change":"2026-02-24T08:27:28.263376+0000","last_active":"2026-02-24T08:27:30.702513+0000","last_peered":"2026-02-24T08:27:30.702513+0000","last_clean":"2026-02-24T08:27:30.702513+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:30.702513+0000","last_undegraded":"2026-02-24T08:27:30.702513+0000","last_fullsized":"2026-02-24T08:27:30.702513+0000","mapping_epoch":63,"log_start":"65'10500","ondisk_log_start":"65'10500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20000","last_scrub_stamp":"2026-02-24T08:27:28.263309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:28.263309+0000","objects_scrubbed":2483,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:47.931229+0000","scrub_duration":1546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168427520,"num_objects":2570,"num_object_clones":0,"num_object_copies":7710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20560,"num_write_kb":164480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"73'19000","reported_seq":19021,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.535109+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:27:30.535109+0000","last_peered":"2026-02-24T08:27:30.535109+0000","last_clean":"2026-02-24T08:27:30.535109+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:30.535109+0000","last_undegraded":"2026-02-24T08:27:30.535109+0000","last_fullsized":"2026-02-24T08:27:30.535109+0000","mapping_epoch":63,"log_start":"65'8900","ondisk_log_start":"65'8900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155648000,"num_objects":2375,"num_object_clones":0,"num_object_copies":7125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2375,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19000,"num_write_kb":152000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"73'19670","reported_seq":19700,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:30.638154+0000","last_change":"2026-02-24T08:26:18.067524+0000","last_active":"2026-02-24T08:27:30.638154+0000","last_peered":"2026-02-24T08:27:30.638154+0000","last_clean":"2026-02-24T08:27:30.638154+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:30.638154+0000","last_undegraded":"2026-02-24T08:27:30.638154+0000","last_fullsized":"2026-02-24T08:27:30.638154+0000","mapping_epoch":63,"log_start":"65'9600","ondisk_log_start":"65'9600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161136640,"num_objects":2459,"num_object_clones":0,"num_object_copies":7377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19670,"num_write_kb":157360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":182,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:22.835540+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:27:22.835540+0000","last_peered":"2026-02-24T08:27:22.835540+0000","last_clean":"2026-02-24T08:27:22.835540+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:22.835540+0000","last_undegraded":"2026-02-24T08:27:22.835540+0000","last_fullsized":"2026-02-24T08:27:22.835540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2556608512,"num_objects":39013,"num_object_clones":0,"num_object_copies":117039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39013,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312086,"num_write_kb":2496688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7672569856,"data_stored":7672569856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160686,"ondisk_log_size":160686,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2777,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2910708,"kb_used_data":2167648,"kb_used_omap":10,"kb_used_meta":743029,"kb_avail":731092492,"statfs":{"total":751619276800,"available":748638711808,"internally_reserved":0,"allocated":2219671552,"data_stored":2219220900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10401,"internal_metadata":760862559},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444122,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2526556,"kb_used_data":1691848,"kb_used_omap":13,"kb_used_meta":834674,"kb_avail":731476644,"statfs":{"total":751619276800,"available":749032083456,"internally_reserved":0,"allocated":1732452352,"data_stored":1732001700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13578,"internal_metadata":854706934},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2553752,"kb_used_data":1566276,"kb_used_omap":10,"kb_used_meta":987445,"kb_avail":731449448,"statfs":{"total":751619276800,"available":749004234752,"internally_reserved":0,"allocated":1603866624,"data_stored":1603419524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10320,"internal_metadata":1011144624},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,4,1,0,16,8,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705758,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2729476,"kb_used_data":2020208,"kb_used_omap":10,"kb_used_meta":709237,"kb_avail":731273724,"statfs":{"total":751619276800,"available":748824293376,"internally_reserved":0,"allocated":2068692992,"data_stored":2068242340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10326,"internal_metadata":726259626},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2777,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2074247168,"data_stored":2074247168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1610096640,"data_stored":1610096640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1746960384,"data_stored":1746960384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2241265664,"data_stored":2241265664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:36.667 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 131 2026-02-24T08:27:36.667 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:36.782 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:36 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:27:36.788 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:36.785+0000 7fea6cd02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:36.790 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:36.787+0000 7fea6cd02640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:36.812 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:36.812 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:36.823 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:36.824 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:36.825 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:36.840 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:36.841 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:36.855 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:36.855 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:36.947 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:36.944+0000 7f806637f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:36.947 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:36.944+0000 7f806637f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:37.095 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:27:37.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:37.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 78 128 332773 332645 33.315 25.0859 0.0273226 0.0300063 2026-02-24T08:27:37.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:37 trial105 ceph-mon[39442]: from='client.15043 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:37.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:37 trial105 ceph-mon[39442]: pgmap v264: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.13k op/s 2026-02-24T08:27:37.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/582562839' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:37.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:27:37.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:27:37.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:27:37.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:27:37.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2373679941' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "131"} : dispatch 2026-02-24T08:27:38.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 79 128 336258 336130 33.2379 27.2266 0.0204128 0.030072 2026-02-24T08:27:38.906 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:38.932 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:38 trial105 ceph-mon[39442]: 5.3 scrub starts 2026-02-24T08:27:39.045 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:39.162 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:39.159+0000 7f3a95386640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:39.162 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:39.159+0000 7f3a95386640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:39.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:27:39.161997+0000 min lat: 0.000698887 max lat: 0.233817 avg lat: 0.030152 2026-02-24T08:27:39.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:27:39.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 80 127 339661 339534 33.1549 26.5938 0.0281112 0.030152 2026-02-24T08:27:39.177 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:39.177 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:39.192 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:39.192 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:39.207 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:39.207 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:39.220 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:39.220 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:39.842 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:27:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:27:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:27:39.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:39 trial105 ceph-mon[39442]: 5.3 scrub ok 2026-02-24T08:27:39.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:39 trial105 ceph-mon[39442]: pgmap v265: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.71k op/s 2026-02-24T08:27:39.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:39 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2945858411' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:39.940 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:27:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:27:39] "GET /metrics HTTP/1.1" 200 4216 "" "Prometheus/3.6.0" 2026-02-24T08:27:40.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 81 127 343156 343029 33.0826 27.3047 0.0739977 0.0302152 2026-02-24T08:27:40.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:40 trial105 ceph-mon[39442]: 5.c scrub starts 2026-02-24T08:27:40.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:40 trial105 ceph-mon[39442]: 5.2 scrub starts 2026-02-24T08:27:41.163 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 82 128 346395 346267 32.9876 25.2969 0.0269812 0.0303007 2026-02-24T08:27:41.265 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:41.408 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:41.531 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:41.528+0000 7f479ea96640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:41.531 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:41.528+0000 7f479ea96640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:41.547 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:41.547 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:41.561 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:41.561 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:41.576 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:41.576 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:41.589 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:41.589 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:41 trial105 ceph-mon[39442]: 5.f scrub starts 2026-02-24T08:27:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:41 trial105 ceph-mon[39442]: 5.c scrub ok 2026-02-24T08:27:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:41 trial105 ceph-mon[39442]: pgmap v266: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.50k op/s 2026-02-24T08:27:41.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:41 trial105 ceph-mon[39442]: 5.2 scrub ok 2026-02-24T08:27:41.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:41 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3792581966' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:42.141 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:27:42.141 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:27:42.142 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:27:42.142 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:42.164 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 83 128 349808 349680 32.9114 26.6641 0.0935369 0.0303701 2026-02-24T08:27:42.292 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:42.417 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:42.412+0000 7f62dee55640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:42.417 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:42.412+0000 7f62dee55640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:42.563 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:42.564 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:42.611 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2026-02-24T08:27:40.747564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2763407904,"num_objects":42161,"num_object_clones":0,"num_object_copies":126483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42161,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":337393,"num_write_kb":2700214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160957,"ondisk_log_size":160957,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11484628,"kb_used_data":8029636,"kb_used_omap":44,"kb_used_meta":3454867,"kb_avail":2924528172,"statfs":{"total":3006477107200,"available":2994716848128,"internally_reserved":0,"allocated":8222347264,"data_stored":8220548208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45277,"internal_metadata":3537784611},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,8,15,4,3,0,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":344621056,"num_objects":5256,"num_object_clones":0,"num_object_copies":15768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5256,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42068,"num_write_kb":336544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001706"},"pg_stats":[{"pgid":"5.f","version":"73'21493","reported_seq":21547,"reported_epoch":73,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:27:40.687602+0000","last_change":"2026-02-24T08:27:39.952653+0000","last_active":"2026-02-24T08:27:40.687602+0000","last_peered":"2026-02-24T08:27:40.687602+0000","last_clean":"2026-02-24T08:27:40.687602+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:40.687602+0000","last_undegraded":"2026-02-24T08:27:40.687602+0000","last_fullsized":"2026-02-24T08:27:40.687602+0000","mapping_epoch":63,"log_start":"65'11400","ondisk_log_start":"65'11400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":2649,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176070656,"num_objects":2687,"num_object_clones":0,"num_object_copies":8061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21493,"num_write_kb":171944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"73'20136","reported_seq":20166,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:35.720222+0000","last_change":"2026-02-24T08:26:18.067799+0000","last_active":"2026-02-24T08:27:35.720222+0000","last_peered":"2026-02-24T08:27:35.720222+0000","last_clean":"2026-02-24T08:27:35.720222+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:35.720222+0000","last_undegraded":"2026-02-24T08:27:35.720222+0000","last_fullsized":"2026-02-24T08:27:35.720222+0000","mapping_epoch":63,"log_start":"65'10100","ondisk_log_start":"65'10100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164954112,"num_objects":2517,"num_object_clones":0,"num_object_copies":7551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2517,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20136,"num_write_kb":161088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"73'20728","reported_seq":20790,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:40.558356+0000","last_change":"2026-02-24T08:27:34.727321+0000","last_active":"2026-02-24T08:27:40.558356+0000","last_peered":"2026-02-24T08:27:40.558356+0000","last_clean":"2026-02-24T08:27:40.558356+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:40.558356+0000","last_undegraded":"2026-02-24T08:27:40.558356+0000","last_fullsized":"2026-02-24T08:27:40.558356+0000","mapping_epoch":63,"log_start":"65'10700","ondisk_log_start":"65'10700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'19440","last_scrub_stamp":"2026-02-24T08:27:34.727275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:34.727275+0000","objects_scrubbed":2429,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:41.277756+0000","scrub_duration":304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169803776,"num_objects":2591,"num_object_clones":0,"num_object_copies":7773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20728,"num_write_kb":165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"73'20760","reported_seq":20790,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:35.773210+0000","last_change":"2026-02-24T08:26:18.065406+0000","last_active":"2026-02-24T08:27:35.773210+0000","last_peered":"2026-02-24T08:27:35.773210+0000","last_clean":"2026-02-24T08:27:35.773210+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:35.773210+0000","last_undegraded":"2026-02-24T08:27:35.773210+0000","last_fullsized":"2026-02-24T08:27:35.773210+0000","mapping_epoch":63,"log_start":"65'10700","ondisk_log_start":"65'10700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:36.990265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170065920,"num_objects":2595,"num_object_clones":0,"num_object_copies":7785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2595,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20760,"num_write_kb":166080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"73'20808","reported_seq":20838,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:40.501144+0000","last_change":"2026-02-24T08:26:18.067842+0000","last_active":"2026-02-24T08:27:40.501144+0000","last_peered":"2026-02-24T08:27:40.501144+0000","last_clean":"2026-02-24T08:27:40.501144+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:40.501144+0000","last_undegraded":"2026-02-24T08:27:40.501144+0000","last_fullsized":"2026-02-24T08:27:40.501144+0000","mapping_epoch":63,"log_start":"65'10800","ondisk_log_start":"65'10800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:45.174131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170459136,"num_objects":2601,"num_object_clones":0,"num_object_copies":7803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2601,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20808,"num_write_kb":166464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"73'22096","reported_seq":22126,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:40.553495+0000","last_change":"2026-02-24T08:26:18.067231+0000","last_active":"2026-02-24T08:27:40.553495+0000","last_peered":"2026-02-24T08:27:40.553495+0000","last_clean":"2026-02-24T08:27:40.553495+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:40.553495+0000","last_undegraded":"2026-02-24T08:27:40.553495+0000","last_fullsized":"2026-02-24T08:27:40.553495+0000","mapping_epoch":63,"log_start":"65'12000","ondisk_log_start":"65'12000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:41.086710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181010432,"num_objects":2762,"num_object_clones":0,"num_object_copies":8286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22096,"num_write_kb":176768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"73'20336","reported_seq":20361,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:35.721754+0000","last_change":"2026-02-24T08:26:18.067084+0000","last_active":"2026-02-24T08:27:35.721754+0000","last_peered":"2026-02-24T08:27:35.721754+0000","last_clean":"2026-02-24T08:27:35.721754+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:35.721754+0000","last_undegraded":"2026-02-24T08:27:35.721754+0000","last_fullsized":"2026-02-24T08:27:35.721754+0000","mapping_epoch":63,"log_start":"65'10300","ondisk_log_start":"65'10300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:38.782906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166592512,"num_objects":2542,"num_object_clones":0,"num_object_copies":7626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20336,"num_write_kb":162688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"73'21624","reported_seq":21654,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:40.542692+0000","last_change":"2026-02-24T08:26:18.067411+0000","last_active":"2026-02-24T08:27:40.542692+0000","last_peered":"2026-02-24T08:27:40.542692+0000","last_clean":"2026-02-24T08:27:40.542692+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:40.542692+0000","last_undegraded":"2026-02-24T08:27:40.542692+0000","last_fullsized":"2026-02-24T08:27:40.542692+0000","mapping_epoch":63,"log_start":"65'11600","ondisk_log_start":"65'11600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:42.672509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177143808,"num_objects":2703,"num_object_clones":0,"num_object_copies":8109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21624,"num_write_kb":172992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"73'21112","reported_seq":21173,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:35.721263+0000","last_change":"2026-02-24T08:27:20.408387+0000","last_active":"2026-02-24T08:27:35.721263+0000","last_peered":"2026-02-24T08:27:35.721263+0000","last_clean":"2026-02-24T08:27:35.721263+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:35.721263+0000","last_undegraded":"2026-02-24T08:27:35.721263+0000","last_fullsized":"2026-02-24T08:27:35.721263+0000","mapping_epoch":63,"log_start":"65'11100","ondisk_log_start":"65'11100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'17800","last_scrub_stamp":"2026-02-24T08:27:20.408345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:20.408345+0000","objects_scrubbed":2214,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:27.738857+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172949504,"num_objects":2639,"num_object_clones":0,"num_object_copies":7917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2639,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21112,"num_write_kb":168896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"73'20568","reported_seq":20598,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:35.655612+0000","last_change":"2026-02-24T08:26:18.064606+0000","last_active":"2026-02-24T08:27:35.655612+0000","last_peered":"2026-02-24T08:27:35.655612+0000","last_clean":"2026-02-24T08:27:35.655612+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:35.655612+0000","last_undegraded":"2026-02-24T08:27:35.655612+0000","last_fullsized":"2026-02-24T08:27:35.655612+0000","mapping_epoch":63,"log_start":"65'10500","ondisk_log_start":"65'10500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.651395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168493056,"num_objects":2571,"num_object_clones":0,"num_object_copies":7713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2571,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20568,"num_write_kb":164544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"73'21888","reported_seq":21951,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:40.533012+0000","last_change":"2026-02-24T08:27:26.865159+0000","last_active":"2026-02-24T08:27:40.533012+0000","last_peered":"2026-02-24T08:27:40.533012+0000","last_clean":"2026-02-24T08:27:40.533012+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:40.533012+0000","last_undegraded":"2026-02-24T08:27:40.533012+0000","last_fullsized":"2026-02-24T08:27:40.533012+0000","mapping_epoch":63,"log_start":"65'11800","ondisk_log_start":"65'11800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'18960","last_scrub_stamp":"2026-02-24T08:27:26.865105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:26.865105+0000","objects_scrubbed":2335,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:45.774021+0000","scrub_duration":1596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179306496,"num_objects":2736,"num_object_clones":0,"num_object_copies":8208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2736,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21888,"num_write_kb":175104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"73'21115","reported_seq":21177,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:40.551211+0000","last_change":"2026-02-24T08:27:37.887330+0000","last_active":"2026-02-24T08:27:40.551211+0000","last_peered":"2026-02-24T08:27:40.551211+0000","last_clean":"2026-02-24T08:27:40.551211+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:40.551211+0000","last_undegraded":"2026-02-24T08:27:40.551211+0000","last_fullsized":"2026-02-24T08:27:40.551211+0000","mapping_epoch":63,"log_start":"65'11100","ondisk_log_start":"65'11100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20560","last_scrub_stamp":"2026-02-24T08:27:37.887294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:37.887294+0000","objects_scrubbed":2567,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.580636+0000","scrub_duration":641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172974080,"num_objects":2640,"num_object_clones":0,"num_object_copies":7920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2640,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21115,"num_write_kb":168920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"73'20354","reported_seq":20379,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:35.731185+0000","last_change":"2026-02-24T08:26:18.067679+0000","last_active":"2026-02-24T08:27:35.731185+0000","last_peered":"2026-02-24T08:27:35.731185+0000","last_clean":"2026-02-24T08:27:35.731185+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:35.731185+0000","last_undegraded":"2026-02-24T08:27:35.731185+0000","last_fullsized":"2026-02-24T08:27:35.731185+0000","mapping_epoch":63,"log_start":"65'10300","ondisk_log_start":"65'10300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166739968,"num_objects":2545,"num_object_clones":0,"num_object_copies":7635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20354,"num_write_kb":162832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"73'21592","reported_seq":21655,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:35.672306+0000","last_change":"2026-02-24T08:27:28.263376+0000","last_active":"2026-02-24T08:27:35.672306+0000","last_peered":"2026-02-24T08:27:35.672306+0000","last_clean":"2026-02-24T08:27:35.672306+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:35.672306+0000","last_undegraded":"2026-02-24T08:27:35.672306+0000","last_fullsized":"2026-02-24T08:27:35.672306+0000","mapping_epoch":63,"log_start":"65'11500","ondisk_log_start":"65'11500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20000","last_scrub_stamp":"2026-02-24T08:27:28.263309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:28.263309+0000","objects_scrubbed":2483,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:47.931229+0000","scrub_duration":1546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176881664,"num_objects":2699,"num_object_clones":0,"num_object_copies":8097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2699,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21592,"num_write_kb":172736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"73'21200","reported_seq":21227,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:40.567678+0000","last_change":"2026-02-24T08:26:18.065699+0000","last_active":"2026-02-24T08:27:40.567678+0000","last_peered":"2026-02-24T08:27:40.567678+0000","last_clean":"2026-02-24T08:27:40.567678+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:40.567678+0000","last_undegraded":"2026-02-24T08:27:40.567678+0000","last_fullsized":"2026-02-24T08:27:40.567678+0000","mapping_epoch":63,"log_start":"65'11100","ondisk_log_start":"65'11100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:43.974749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173670400,"num_objects":2650,"num_object_clones":0,"num_object_copies":7950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2650,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21200,"num_write_kb":169600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"73'21448","reported_seq":21512,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:40.670943+0000","last_change":"2026-02-24T08:27:34.537371+0000","last_active":"2026-02-24T08:27:40.670943+0000","last_peered":"2026-02-24T08:27:40.670943+0000","last_clean":"2026-02-24T08:27:40.670943+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:40.670943+0000","last_undegraded":"2026-02-24T08:27:40.670943+0000","last_fullsized":"2026-02-24T08:27:40.670943+0000","mapping_epoch":63,"log_start":"65'11400","ondisk_log_start":"65'11400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20288","last_scrub_stamp":"2026-02-24T08:27:34.537328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:34.537328+0000","objects_scrubbed":2532,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:44.342049+0000","scrub_duration":594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175702016,"num_objects":2681,"num_object_clones":0,"num_object_copies":8043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2681,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21448,"num_write_kb":171584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":182,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:22.835540+0000","last_change":"2026-02-24T08:26:34.981400+0000","last_active":"2026-02-24T08:27:22.835540+0000","last_peered":"2026-02-24T08:27:22.835540+0000","last_clean":"2026-02-24T08:27:22.835540+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:22.835540+0000","last_undegraded":"2026-02-24T08:27:22.835540+0000","last_fullsized":"2026-02-24T08:27:22.835540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:26:34.981338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:26:34.981338+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:27:39.958795+0000","scrub_duration":445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2762817536,"num_objects":42159,"num_object_clones":0,"num_object_copies":126477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337258,"num_write_kb":2698064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8270733312,"data_stored":8270733312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160858,"ondisk_log_size":160858,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2777,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247897,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3094044,"kb_used_data":2278792,"kb_used_omap":10,"kb_used_meta":815221,"kb_avail":730909156,"statfs":{"total":751619276800,"available":748450975744,"internally_reserved":0,"allocated":2333483008,"data_stored":2333032356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10401,"internal_metadata":834787167},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,5,11,0,1,0,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444124,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2726764,"kb_used_data":1874008,"kb_used_omap":13,"kb_used_meta":852722,"kb_avail":731276436,"statfs":{"total":751619276800,"available":748827070464,"internally_reserved":0,"allocated":1918984192,"data_stored":1918533540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14230,"internal_metadata":873187434},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,3,4,4,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2666288,"kb_used_data":1642716,"kb_used_omap":10,"kb_used_meta":1023541,"kb_avail":731336912,"statfs":{"total":751619276800,"available":748888997888,"internally_reserved":0,"allocated":1682141184,"data_stored":1681694084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10320,"internal_metadata":1048106928},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705760,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2997532,"kb_used_data":2234120,"kb_used_omap":10,"kb_used_meta":763381,"kb_avail":731005668,"statfs":{"total":751619276800,"available":748549804032,"internally_reserved":0,"allocated":2287738880,"data_stored":2287288228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10326,"internal_metadata":781703082},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2777,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2294448128,"data_stored":2294448128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1689698304,"data_stored":1689698304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1932476416,"data_stored":1932476416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2354110464,"data_stored":2354110464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:42.613 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:27:42.613 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 141 2026-02-24T08:27:42.794 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:42.824 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:42 trial105 ceph-mon[39442]: 5.f scrub ok 2026-02-24T08:27:42.824 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:42 trial105 ceph-mon[39442]: 5.6 scrub starts 2026-02-24T08:27:42.928 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:42.925+0000 7fcd96536640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:42.928 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:42.925+0000 7fcd96536640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:43.066 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:27:43.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:43.164 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 84 128 353123 352995 32.8279 25.8984 0.0111553 0.0304505 2026-02-24T08:27:43.639 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:43.790 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:43.906 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:43 trial105 ceph-mon[39442]: 5.6 scrub ok 2026-02-24T08:27:43.906 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:43 trial105 ceph-mon[39442]: from='client.15053 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:43.906 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:43 trial105 ceph-mon[39442]: pgmap v267: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.88k op/s 2026-02-24T08:27:43.906 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/417869929' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "141"} : dispatch 2026-02-24T08:27:44.142 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:44.139+0000 7fa68a114640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:44.142 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:44.139+0000 7fa68a114640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:44.158 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:44.158 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:44.164 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 85 127 356353 356226 32.7387 25.2422 0.0254218 0.030531 2026-02-24T08:27:44.174 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:44.174 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:44.188 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:44.188 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:44.205 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:44.205 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:44.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:44 trial105 ceph-mon[39442]: 5.e scrub starts 2026-02-24T08:27:44.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:27:44.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4229366751' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:45.164 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 86 128 359802 359674 32.6712 26.9375 0.101051 0.0305937 2026-02-24T08:27:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:45 trial105 ceph-mon[39442]: 5.a scrub starts 2026-02-24T08:27:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:45 trial105 ceph-mon[39442]: 5.a scrub ok 2026-02-24T08:27:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:45 trial105 ceph-mon[39442]: pgmap v268: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.72k op/s 2026-02-24T08:27:45.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:45 trial105 ceph-mon[39442]: 5.9 scrub starts 2026-02-24T08:27:45.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:45 trial105 ceph-mon[39442]: 5.e scrub ok 2026-02-24T08:27:46.164 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 87 128 363106 362978 32.5923 25.8125 0.177238 0.0306681 2026-02-24T08:27:46.249 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:46.394 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:46.564 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:46.561+0000 7f29d2bd8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:46.564 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:46.561+0000 7f29d2bd8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:46.578 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:46.579 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:46.592 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:46.592 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:46.605 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:46.605 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:46.618 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:46.618 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:46.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:46 trial105 ceph-mon[39442]: 5.9 scrub ok 2026-02-24T08:27:46.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1547442827' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:47.164 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 88 128 366483 366355 32.5217 26.3828 0.054198 0.0307384 2026-02-24T08:27:47.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:47 trial105 ceph-mon[39442]: pgmap v269: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.11k op/s 2026-02-24T08:27:47.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:47 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:27:47.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:47 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:27:48.103 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:27:48.104 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:27:48.104 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:27:48.104 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:27:48.164 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 89 128 369976 369848 32.4629 27.2891 0.0227086 0.0307938 2026-02-24T08:27:48.247 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:48.377 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:48.374+0000 7ff9f09e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:48.377 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:48.374+0000 7ff9f09e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:48.397 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:27:48.397 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:27:48.398 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:27:48.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:27:48.434 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:27:48.434 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:27:48.584 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:48.666 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:48.710 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:48.707+0000 7f5de7479640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:48.710 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:48.707+0000 7f5de7479640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:48.734 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:27:48.734 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:27:48.734 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:27:48.734 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:27:48.735 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:27:48.735 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:27:48.735 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:27:48.735 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:27:48.735 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:27:48.735 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:27:48.735 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:27:48.735 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:27:48.773 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:27:48.774 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:27:48.774 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:27:48.818 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:48.885 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:48 trial105 ceph-mon[39442]: 5.8 scrub starts 2026-02-24T08:27:48.945 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:48.942+0000 7f716977e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:48.945 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:48.942+0000 7f716977e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:48.963 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:48.964 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:48.968 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:48.979 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:48.980 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:49.002 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:49.002 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:49.018 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:49.018 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:49.116 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:49.113+0000 7f0c1a996640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:49.116 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:49.113+0000 7f0c1a996640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:49.137 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:27:49.138 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:27:49.139 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:27:49.164 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 90 120 373163 373043 32.3795 24.9609 0.0661395 0.030869 2026-02-24T08:27:49.176 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:27:49.177 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:27:49.177 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:27:49.297 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:49.403 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:49.401+0000 7f9115e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:49.404 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:49.401+0000 7f9115e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:49.421 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:27:49.421 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:27:49.421 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:27:49.421 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:27:49.421 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:27:49.421 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:27:49.421 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:27:49.421 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:27:49.422 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:27:49.422 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:27:49.422 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:27:49.422 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:27:49.448 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:27:49.449 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:27:49.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:49 trial105 ceph-mon[39442]: 5.8 scrub ok 2026-02-24T08:27:49.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:49 trial105 ceph-mon[39442]: pgmap v270: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.80k op/s 2026-02-24T08:27:49.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3530314316' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:49.690 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:27:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:27:49] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-24T08:27:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:27:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:27:49.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:27:50.164 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total time run: 90.066 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total writes made: 373163 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Write size: 8192 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object size: 65536 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Bandwidth (MB/sec): 32.3689 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Bandwidth: 12.1477 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max bandwidth (MB/sec): 68.6016 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min bandwidth (MB/sec): 21.2578 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average IOPS: 4143 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev IOPS: 1554.91 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max IOPS: 8781 2026-02-24T08:27:50.165 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min IOPS: 2721 2026-02-24T08:27:50.166 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average Latency(s): 0.0308789 2026-02-24T08:27:50.166 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Latency(s): 0.0233861 2026-02-24T08:27:50.166 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max latency(s): 0.233817 2026-02-24T08:27:50.166 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min latency(s): 0.000698887 2026-02-24T08:27:50.169 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:27:50.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:50 trial105 ceph-mon[39442]: 5.0 scrub starts 2026-02-24T08:27:50.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:50 trial105 ceph-mon[39442]: 5.0 scrub ok 2026-02-24T08:27:51.070 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:51.218 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:51.347 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:51.342+0000 7f21d4335640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:51.347 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:51.343+0000 7f21d4335640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:51.366 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:51.367 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:51.387 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:51.387 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:51.401 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:51.401 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:51.417 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:51.418 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:51.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:51 trial105 ceph-mon[39442]: 5.b scrub starts 2026-02-24T08:27:51.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:51 trial105 ceph-mon[39442]: pgmap v271: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 26 MiB/s wr, 3.44k op/s 2026-02-24T08:27:51.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2589439737' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:53 trial105 ceph-mon[39442]: 5.b scrub ok 2026-02-24T08:27:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:53 trial105 ceph-mon[39442]: pgmap v272: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 23 MiB/s wr, 3.15k op/s 2026-02-24T08:27:53.464 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:53.613 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:53.756 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:53.752+0000 7f6dd9f2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:53.756 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:53.753+0000 7f6dd9f2a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:53.778 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:53.778 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:53.794 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:53.794 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:53.810 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:53.810 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:53.824 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:53.824 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:54.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2368223180' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:54.450 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:27:54.450 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:27:54.450 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T08:27:54.450 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:27:54.605 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:54.754 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:54.749+0000 7fda850c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:54.757 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:54.755+0000 7fda850c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:54.905 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:27:54.906 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:27:54.955 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2026-02-24T08:27:54.749542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2931712568,"num_objects":44729,"num_object_clones":0,"num_object_copies":134187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44729,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":375219,"num_write_kb":2987455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160983,"ondisk_log_size":160983,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12556564,"kb_used_data":8939140,"kb_used_omap":44,"kb_used_meta":3617299,"kb_avail":2923456236,"statfs":{"total":3006477107200,"available":2993619185664,"internally_reserved":0,"allocated":9153679360,"data_stored":9151880304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45328,"internal_metadata":3704114928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,4,2,5,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":106946584,"num_objects":1631,"num_object_clones":0,"num_object_copies":4893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1631,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30336,"num_write_kb":227321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001708"},"pg_stats":[{"pgid":"5.f","version":"73'23562","reported_seq":23626,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.701615+0000","last_change":"2026-02-24T08:27:41.036671+0000","last_active":"2026-02-24T08:27:50.701615+0000","last_peered":"2026-02-24T08:27:50.701615+0000","last_clean":"2026-02-24T08:27:50.701615+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:27:50.701615+0000","last_undegraded":"2026-02-24T08:27:50.701615+0000","last_fullsized":"2026-02-24T08:27:50.701615+0000","mapping_epoch":63,"log_start":"65'13500","ondisk_log_start":"65'13500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21592","last_scrub_stamp":"2026-02-24T08:27:41.036609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:41.036609+0000","objects_scrubbed":2681,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:47.433150+0000","scrub_duration":1083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184614912,"num_objects":2817,"num_object_clones":0,"num_object_copies":8451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23562,"num_write_kb":187584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"73'22987","reported_seq":23053,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.785609+0000","last_change":"2026-02-24T08:27:45.388386+0000","last_active":"2026-02-24T08:27:50.785609+0000","last_peered":"2026-02-24T08:27:50.785609+0000","last_clean":"2026-02-24T08:27:50.785609+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:50.785609+0000","last_undegraded":"2026-02-24T08:27:50.785609+0000","last_fullsized":"2026-02-24T08:27:50.785609+0000","mapping_epoch":63,"log_start":"65'12900","ondisk_log_start":"65'12900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22056","last_scrub_stamp":"2026-02-24T08:27:45.388352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:45.388352+0000","objects_scrubbed":2739,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:57.928278+0000","scrub_duration":1518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178651136,"num_objects":2726,"num_object_clones":0,"num_object_copies":8178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22987,"num_write_kb":182848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"73'22399","reported_seq":22458,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.575066+0000","last_change":"2026-02-24T08:27:34.727321+0000","last_active":"2026-02-24T08:27:50.575066+0000","last_peered":"2026-02-24T08:27:50.575066+0000","last_clean":"2026-02-24T08:27:50.575066+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:27:50.575066+0000","last_undegraded":"2026-02-24T08:27:50.575066+0000","last_fullsized":"2026-02-24T08:27:50.575066+0000","mapping_epoch":63,"log_start":"65'12300","ondisk_log_start":"65'12300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'19440","last_scrub_stamp":"2026-02-24T08:27:34.727275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:34.727275+0000","objects_scrubbed":2429,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:41.277756+0000","scrub_duration":304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178323480,"num_objects":2722,"num_object_clones":0,"num_object_copies":8166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2722,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":22399,"num_write_kb":178625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"73'23746","reported_seq":23811,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.804389+0000","last_change":"2026-02-24T08:27:40.331227+0000","last_active":"2026-02-24T08:27:50.804389+0000","last_peered":"2026-02-24T08:27:50.804389+0000","last_clean":"2026-02-24T08:27:50.804389+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:50.804389+0000","last_undegraded":"2026-02-24T08:27:50.804389+0000","last_fullsized":"2026-02-24T08:27:50.804389+0000","mapping_epoch":63,"log_start":"65'13700","ondisk_log_start":"65'13700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21704","last_scrub_stamp":"2026-02-24T08:27:40.331183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:40.331183+0000","objects_scrubbed":2701,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:46.939709+0000","scrub_duration":953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181993472,"num_objects":2777,"num_object_clones":0,"num_object_copies":8331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23746,"num_write_kb":188608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"73'22520","reported_seq":22562,"reported_epoch":73,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:27:50.598604+0000","last_change":"2026-02-24T08:27:50.116795+0000","last_active":"2026-02-24T08:27:50.598604+0000","last_peered":"2026-02-24T08:27:50.598604+0000","last_clean":"2026-02-24T08:27:50.598604+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:27:50.598604+0000","last_undegraded":"2026-02-24T08:27:50.598604+0000","last_fullsized":"2026-02-24T08:27:50.598604+0000","mapping_epoch":63,"log_start":"65'12500","ondisk_log_start":"65'12500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:26:17.054519+0000","objects_scrubbed":1599,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177995776,"num_objects":2716,"num_object_clones":0,"num_object_copies":8148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2716,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22520,"num_write_kb":179456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"73'24121","reported_seq":24184,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.596406+0000","last_change":"2026-02-24T08:27:44.580085+0000","last_active":"2026-02-24T08:27:50.596406+0000","last_peered":"2026-02-24T08:27:50.596406+0000","last_clean":"2026-02-24T08:27:50.596406+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:27:50.596406+0000","last_undegraded":"2026-02-24T08:27:50.596406+0000","last_fullsized":"2026-02-24T08:27:50.596406+0000","mapping_epoch":63,"log_start":"67'14100","ondisk_log_start":"67'14100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22880","last_scrub_stamp":"2026-02-24T08:27:44.580025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:44.580025+0000","objects_scrubbed":2858,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:51.258735+0000","scrub_duration":391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189267968,"num_objects":2888,"num_object_clones":0,"num_object_copies":8664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2888,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24121,"num_write_kb":192064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"73'23560","reported_seq":23627,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.790513+0000","last_change":"2026-02-24T08:27:46.168067+0000","last_active":"2026-02-24T08:27:50.790513+0000","last_peered":"2026-02-24T08:27:50.790513+0000","last_clean":"2026-02-24T08:27:50.790513+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:50.790513+0000","last_undegraded":"2026-02-24T08:27:50.790513+0000","last_fullsized":"2026-02-24T08:27:50.790513+0000","mapping_epoch":63,"log_start":"67'13500","ondisk_log_start":"67'13500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22712","last_scrub_stamp":"2026-02-24T08:27:46.168023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.168023+0000","objects_scrubbed":2826,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:01.019222+0000","scrub_duration":1326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183566336,"num_objects":2801,"num_object_clones":0,"num_object_copies":8403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2801,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23560,"num_write_kb":187456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"73'23446","reported_seq":23512,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.590469+0000","last_change":"2026-02-24T08:27:48.078818+0000","last_active":"2026-02-24T08:27:50.590469+0000","last_peered":"2026-02-24T08:27:50.590469+0000","last_clean":"2026-02-24T08:27:50.590469+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:27:50.590469+0000","last_undegraded":"2026-02-24T08:27:50.590469+0000","last_fullsized":"2026-02-24T08:27:50.590469+0000","mapping_epoch":63,"log_start":"65'13400","ondisk_log_start":"65'13400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'23040","last_scrub_stamp":"2026-02-24T08:27:48.078660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:48.078660+0000","objects_scrubbed":2869,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:57.525158+0000","scrub_duration":890,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183590912,"num_objects":2802,"num_object_clones":0,"num_object_copies":8406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23446,"num_write_kb":186648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"73'24147","reported_seq":24208,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.801881+0000","last_change":"2026-02-24T08:27:20.408387+0000","last_active":"2026-02-24T08:27:50.801881+0000","last_peered":"2026-02-24T08:27:50.801881+0000","last_clean":"2026-02-24T08:27:50.801881+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:50.801881+0000","last_undegraded":"2026-02-24T08:27:50.801881+0000","last_fullsized":"2026-02-24T08:27:50.801881+0000","mapping_epoch":63,"log_start":"65'14100","ondisk_log_start":"65'14100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'17800","last_scrub_stamp":"2026-02-24T08:27:20.408345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:20.408345+0000","objects_scrubbed":2214,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:27.738857+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188153856,"num_objects":2871,"num_object_clones":0,"num_object_copies":8613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24147,"num_write_kb":192128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"73'23391","reported_seq":23452,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.808089+0000","last_change":"2026-02-24T08:27:41.891613+0000","last_active":"2026-02-24T08:27:50.808089+0000","last_peered":"2026-02-24T08:27:50.808089+0000","last_clean":"2026-02-24T08:27:50.808089+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:50.808089+0000","last_undegraded":"2026-02-24T08:27:50.808089+0000","last_fullsized":"2026-02-24T08:27:50.808089+0000","mapping_epoch":63,"log_start":"65'13300","ondisk_log_start":"65'13300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21664","last_scrub_stamp":"2026-02-24T08:27:41.891554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:41.891554+0000","objects_scrubbed":2704,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:48.116017+0000","scrub_duration":603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181075968,"num_objects":2763,"num_object_clones":0,"num_object_copies":8289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23391,"num_write_kb":185984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"73'23804","reported_seq":23862,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.590001+0000","last_change":"2026-02-24T08:27:26.865159+0000","last_active":"2026-02-24T08:27:50.590001+0000","last_peered":"2026-02-24T08:27:50.590001+0000","last_clean":"2026-02-24T08:27:50.590001+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:27:50.590001+0000","last_undegraded":"2026-02-24T08:27:50.590001+0000","last_fullsized":"2026-02-24T08:27:50.590001+0000","mapping_epoch":63,"log_start":"67'13800","ondisk_log_start":"67'13800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'18960","last_scrub_stamp":"2026-02-24T08:27:26.865105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:26.865105+0000","objects_scrubbed":2335,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:45.774021+0000","scrub_duration":1596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187629568,"num_objects":2863,"num_object_clones":0,"num_object_copies":8589,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2863,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23804,"num_write_kb":189632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"73'22876","reported_seq":22935,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.598591+0000","last_change":"2026-02-24T08:27:37.887330+0000","last_active":"2026-02-24T08:27:50.598591+0000","last_peered":"2026-02-24T08:27:50.598591+0000","last_clean":"2026-02-24T08:27:50.598591+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:27:50.598591+0000","last_undegraded":"2026-02-24T08:27:50.598591+0000","last_fullsized":"2026-02-24T08:27:50.598591+0000","mapping_epoch":63,"log_start":"65'12800","ondisk_log_start":"65'12800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20560","last_scrub_stamp":"2026-02-24T08:27:37.887294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:37.887294+0000","objects_scrubbed":2567,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.580636+0000","scrub_duration":641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179437568,"num_objects":2738,"num_object_clones":0,"num_object_copies":8214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22876,"num_write_kb":182144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"73'23256","reported_seq":23317,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.804438+0000","last_change":"2026-02-24T08:27:40.867066+0000","last_active":"2026-02-24T08:27:50.804438+0000","last_peered":"2026-02-24T08:27:50.804438+0000","last_clean":"2026-02-24T08:27:50.804438+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:50.804438+0000","last_undegraded":"2026-02-24T08:27:50.804438+0000","last_fullsized":"2026-02-24T08:27:50.804438+0000","mapping_epoch":63,"log_start":"65'13200","ondisk_log_start":"65'13200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21552","last_scrub_stamp":"2026-02-24T08:27:40.867005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:40.867005+0000","objects_scrubbed":2677,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:04.871126+0000","scrub_duration":940,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179306496,"num_objects":2736,"num_object_clones":0,"num_object_copies":8208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2736,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23256,"num_write_kb":184832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"73'24661","reported_seq":24723,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.807306+0000","last_change":"2026-02-24T08:27:28.263376+0000","last_active":"2026-02-24T08:27:50.807306+0000","last_peered":"2026-02-24T08:27:50.807306+0000","last_clean":"2026-02-24T08:27:50.807306+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:50.807306+0000","last_undegraded":"2026-02-24T08:27:50.807306+0000","last_fullsized":"2026-02-24T08:27:50.807306+0000","mapping_epoch":63,"log_start":"66'14600","ondisk_log_start":"66'14600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20000","last_scrub_stamp":"2026-02-24T08:27:28.263309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:28.263309+0000","objects_scrubbed":2483,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:47.931229+0000","scrub_duration":1546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191627264,"num_objects":2924,"num_object_clones":0,"num_object_copies":8772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2924,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24661,"num_write_kb":196160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"73'23110","reported_seq":23176,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.574337+0000","last_change":"2026-02-24T08:27:49.362120+0000","last_active":"2026-02-24T08:27:50.574337+0000","last_peered":"2026-02-24T08:27:50.574337+0000","last_clean":"2026-02-24T08:27:50.574337+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:27:50.574337+0000","last_undegraded":"2026-02-24T08:27:50.574337+0000","last_fullsized":"2026-02-24T08:27:50.574337+0000","mapping_epoch":63,"log_start":"65'13100","ondisk_log_start":"65'13100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'23024","last_scrub_stamp":"2026-02-24T08:27:49.362068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:49.362068+0000","objects_scrubbed":2878,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:06.197075+0000","scrub_duration":147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182976512,"num_objects":2792,"num_object_clones":0,"num_object_copies":8376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23110,"num_write_kb":184192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"73'23498","reported_seq":23560,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:50.716411+0000","last_change":"2026-02-24T08:27:34.537371+0000","last_active":"2026-02-24T08:27:50.716411+0000","last_peered":"2026-02-24T08:27:50.716411+0000","last_clean":"2026-02-24T08:27:50.716411+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:27:50.716411+0000","last_undegraded":"2026-02-24T08:27:50.716411+0000","last_fullsized":"2026-02-24T08:27:50.716411+0000","mapping_epoch":63,"log_start":"65'13400","ondisk_log_start":"65'13400","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20288","last_scrub_stamp":"2026-02-24T08:27:34.537328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:34.537328+0000","objects_scrubbed":2532,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:44.342049+0000","scrub_duration":594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182910976,"num_objects":2791,"num_object_clones":0,"num_object_copies":8373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2791,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23498,"num_write_kb":186944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":190,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:46.848837+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:27:46.848837+0000","last_peered":"2026-02-24T08:27:46.848837+0000","last_clean":"2026-02-24T08:27:46.848837+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:46.848837+0000","last_undegraded":"2026-02-24T08:27:46.848837+0000","last_fullsized":"2026-02-24T08:27:46.848837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2931122200,"num_objects":44727,"num_object_clones":0,"num_object_copies":134181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44727,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":375084,"num_write_kb":2985305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8773324800,"data_stored":8773312584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160884,"ondisk_log_size":160884,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3539,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247900,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3483180,"kb_used_data":2613784,"kb_used_omap":10,"kb_used_meta":869365,"kb_avail":730520020,"statfs":{"total":751619276800,"available":748052500480,"internally_reserved":0,"allocated":2676514816,"data_stored":2676064164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10452,"internal_metadata":890230572},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444126,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2932116,"kb_used_data":2043264,"kb_used_omap":13,"kb_used_meta":888818,"kb_avail":731071084,"statfs":{"total":751619276800,"available":748616790016,"internally_reserved":0,"allocated":2092302336,"data_stored":2091851684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14230,"internal_metadata":910149738},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,4,2,5,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2915560,"kb_used_data":1855892,"kb_used_omap":10,"kb_used_meta":1059637,"kb_avail":731087640,"statfs":{"total":751619276800,"available":748633743360,"internally_reserved":0,"allocated":1900433408,"data_stored":1899986308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10320,"internal_metadata":1085069232},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3225708,"kb_used_data":2426200,"kb_used_omap":10,"kb_used_meta":799477,"kb_avail":730777492,"statfs":{"total":751619276800,"available":748316151808,"internally_reserved":0,"allocated":2484428800,"data_stored":2483978148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10326,"internal_metadata":818665386},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3539,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2398908416,"data_stored":2398904344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1826119680,"data_stored":1826119680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2004029440,"data_stored":2004025368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2544267264,"data_stored":2544263192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:27:54.958 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:27:54.958 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 66 2026-02-24T08:27:55.108 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:55.251 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:55 trial105 ceph-mon[39442]: pgmap v273: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 18 MiB/s wr, 2.53k op/s 2026-02-24T08:27:55.251 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:55 trial105 ceph-mon[39442]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:27:55.252 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:55.248+0000 7f75b97de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:55.252 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:55.248+0000 7f75b97de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:55.405 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:27:55.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:27:55.870 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:27:56.029 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:56.171 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:56.168+0000 7fc102b52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:56.172 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3347319577' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T08:27:56.174 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:56.169+0000 7fc102b52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:56.201 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:56.202 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:56.217 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:56.217 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:56.231 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:56.232 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:56.249 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:56.249 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:57.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1850575352' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:57.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:57 trial105 ceph-mon[39442]: pgmap v274: 17 pgs: 17 active+clean; 1.7 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 18 MiB/s wr, 4.00k op/s 2026-02-24T08:27:58.301 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:27:58.461 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:27:58.601 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:58.597+0000 7fd2a32ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:58.602 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:27:58.599+0000 7fd2a32ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:27:58.622 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:27:58.622 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:27:58.638 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:27:58.638 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:27:58.652 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:27:58.653 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:27:58.667 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:27:58.667 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:27:58.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4136245841' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:27:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:27:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:27:59.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:27:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:59 trial105 ceph-mon[39442]: pgmap v275: 17 pgs: 17 active+clean; 1.7 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 7.7 MiB/s wr, 2.61k op/s 2026-02-24T08:27:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:27:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:27:59.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:27:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:27:59] "GET /metrics HTTP/1.1" 200 4217 "" "Prometheus/3.6.0" 2026-02-24T08:28:00.452 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:00.453 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:00.453 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_3 2026-02-24T08:28:00.453 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:00.615 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:00.718 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:00.757 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:00.754+0000 7ff263fa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:00.757 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:00.754+0000 7ff263fa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:00.866 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:00.912 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:00.913 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:00.969 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2026-02-24T08:28:00.750402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1116693048,"num_objects":17034,"num_object_clones":0,"num_object_copies":51102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17034,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":402914,"num_write_kb":2987455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161078,"ondisk_log_size":161078,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7537504,"kb_used_data":3811728,"kb_used_omap":44,"kb_used_meta":3725587,"kb_avail":2928475296,"statfs":{"total":3006477107200,"available":2998758703104,"internally_reserved":0,"allocated":3903209472,"data_stored":3901398200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45328,"internal_metadata":3815001840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,11,12,11,23,23],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1844568040,"num_objects":-28146,"num_object_clones":0,"num_object_copies":-84438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28146,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":41369,"num_write_kb":94025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001696"},"pg_stats":[{"pgid":"5.f","version":"73'25795","reported_seq":25862,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:00.735061+0000","last_change":"2026-02-24T08:27:41.036671+0000","last_active":"2026-02-24T08:28:00.735061+0000","last_peered":"2026-02-24T08:28:00.735061+0000","last_clean":"2026-02-24T08:28:00.735061+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:28:00.735061+0000","last_undegraded":"2026-02-24T08:28:00.735061+0000","last_fullsized":"2026-02-24T08:28:00.735061+0000","mapping_epoch":63,"log_start":"69'15700","ondisk_log_start":"69'15700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21592","last_scrub_stamp":"2026-02-24T08:27:41.036609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:41.036609+0000","objects_scrubbed":2681,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:47.433150+0000","scrub_duration":1083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38273024,"num_objects":584,"num_object_clones":0,"num_object_copies":1752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":584,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25795,"num_write_kb":187584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"73'24109","reported_seq":24175,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:55.835333+0000","last_change":"2026-02-24T08:27:45.388386+0000","last_active":"2026-02-24T08:27:55.835333+0000","last_peered":"2026-02-24T08:27:55.835333+0000","last_clean":"2026-02-24T08:27:55.835333+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:27:55.835333+0000","last_undegraded":"2026-02-24T08:27:55.835333+0000","last_fullsized":"2026-02-24T08:27:55.835333+0000","mapping_epoch":63,"log_start":"67'14100","ondisk_log_start":"67'14100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22056","last_scrub_stamp":"2026-02-24T08:27:45.388352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:45.388352+0000","objects_scrubbed":2739,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:57.928278+0000","scrub_duration":1518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105119744,"num_objects":1604,"num_object_clones":0,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1604,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24109,"num_write_kb":182848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"73'24548","reported_seq":24609,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:00.647672+0000","last_change":"2026-02-24T08:27:34.727321+0000","last_active":"2026-02-24T08:28:00.647672+0000","last_peered":"2026-02-24T08:28:00.647672+0000","last_clean":"2026-02-24T08:28:00.647672+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:28:00.647672+0000","last_undegraded":"2026-02-24T08:28:00.647672+0000","last_fullsized":"2026-02-24T08:28:00.647672+0000","mapping_epoch":63,"log_start":"69'14500","ondisk_log_start":"69'14500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'19440","last_scrub_stamp":"2026-02-24T08:27:34.727275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:34.727275+0000","objects_scrubbed":2429,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:41.277756+0000","scrub_duration":304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37486616,"num_objects":573,"num_object_clones":0,"num_object_copies":1719,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":573,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24548,"num_write_kb":178625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"73'24865","reported_seq":24925,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:55.801695+0000","last_change":"2026-02-24T08:27:40.331227+0000","last_active":"2026-02-24T08:27:55.801695+0000","last_peered":"2026-02-24T08:27:55.801695+0000","last_clean":"2026-02-24T08:27:55.801695+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:27:55.801695+0000","last_undegraded":"2026-02-24T08:27:55.801695+0000","last_fullsized":"2026-02-24T08:27:55.801695+0000","mapping_epoch":63,"log_start":"69'14800","ondisk_log_start":"69'14800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21704","last_scrub_stamp":"2026-02-24T08:27:40.331183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:40.331183+0000","objects_scrubbed":2701,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:46.939709+0000","scrub_duration":953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108658688,"num_objects":1658,"num_object_clones":0,"num_object_copies":4974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24865,"num_write_kb":188608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"73'24655","reported_seq":24721,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:00.650124+0000","last_change":"2026-02-24T08:27:52.248832+0000","last_active":"2026-02-24T08:28:00.650124+0000","last_peered":"2026-02-24T08:28:00.650124+0000","last_clean":"2026-02-24T08:28:00.650124+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:28:00.650124+0000","last_undegraded":"2026-02-24T08:28:00.650124+0000","last_fullsized":"2026-02-24T08:28:00.650124+0000","mapping_epoch":63,"log_start":"69'14600","ondisk_log_start":"69'14600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22893","last_scrub_stamp":"2026-02-24T08:27:52.248706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:52.248706+0000","objects_scrubbed":2654,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:17.992997+0000","scrub_duration":2131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38076416,"num_objects":581,"num_object_clones":0,"num_object_copies":1743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":581,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24655,"num_write_kb":179456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"73'26391","reported_seq":26454,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:00.642499+0000","last_change":"2026-02-24T08:27:44.580085+0000","last_active":"2026-02-24T08:28:00.642499+0000","last_peered":"2026-02-24T08:28:00.642499+0000","last_clean":"2026-02-24T08:28:00.642499+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:28:00.642499+0000","last_undegraded":"2026-02-24T08:28:00.642499+0000","last_fullsized":"2026-02-24T08:28:00.642499+0000","mapping_epoch":63,"log_start":"69'16300","ondisk_log_start":"69'16300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22880","last_scrub_stamp":"2026-02-24T08:27:44.580025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:44.580025+0000","objects_scrubbed":2858,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:51.258735+0000","scrub_duration":391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40501248,"num_objects":618,"num_object_clones":0,"num_object_copies":1854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":618,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26391,"num_write_kb":192064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"73'24643","reported_seq":24709,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:55.821367+0000","last_change":"2026-02-24T08:27:46.168067+0000","last_active":"2026-02-24T08:27:55.821367+0000","last_peered":"2026-02-24T08:27:55.821367+0000","last_clean":"2026-02-24T08:27:55.821367+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:27:55.821367+0000","last_undegraded":"2026-02-24T08:27:55.821367+0000","last_fullsized":"2026-02-24T08:27:55.821367+0000","mapping_epoch":63,"log_start":"69'14600","ondisk_log_start":"69'14600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22712","last_scrub_stamp":"2026-02-24T08:27:46.168023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.168023+0000","objects_scrubbed":2826,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:01.019222+0000","scrub_duration":1326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112590848,"num_objects":1718,"num_object_clones":0,"num_object_copies":5154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1718,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24643,"num_write_kb":187456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"73'25694","reported_seq":25756,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:00.650803+0000","last_change":"2026-02-24T08:27:48.078818+0000","last_active":"2026-02-24T08:28:00.650803+0000","last_peered":"2026-02-24T08:28:00.650803+0000","last_clean":"2026-02-24T08:28:00.650803+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:28:00.650803+0000","last_undegraded":"2026-02-24T08:28:00.650803+0000","last_fullsized":"2026-02-24T08:28:00.650803+0000","mapping_epoch":63,"log_start":"69'15600","ondisk_log_start":"69'15600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'23040","last_scrub_stamp":"2026-02-24T08:27:48.078660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:48.078660+0000","objects_scrubbed":2869,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:57.525158+0000","scrub_duration":890,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36265984,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25694,"num_write_kb":186648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"73'25298","reported_seq":25359,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:55.824965+0000","last_change":"2026-02-24T08:27:20.408387+0000","last_active":"2026-02-24T08:27:55.824965+0000","last_peered":"2026-02-24T08:27:55.824965+0000","last_clean":"2026-02-24T08:27:55.824965+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:27:55.824965+0000","last_undegraded":"2026-02-24T08:27:55.824965+0000","last_fullsized":"2026-02-24T08:27:55.824965+0000","mapping_epoch":63,"log_start":"69'15200","ondisk_log_start":"69'15200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'17800","last_scrub_stamp":"2026-02-24T08:27:20.408345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:20.408345+0000","objects_scrubbed":2214,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:27.738857+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112721920,"num_objects":1720,"num_object_clones":0,"num_object_copies":5160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25298,"num_write_kb":192128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"73'24561","reported_seq":24626,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:55.795427+0000","last_change":"2026-02-24T08:27:41.891613+0000","last_active":"2026-02-24T08:27:55.795427+0000","last_peered":"2026-02-24T08:27:55.795427+0000","last_clean":"2026-02-24T08:27:55.795427+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:27:55.795427+0000","last_undegraded":"2026-02-24T08:27:55.795427+0000","last_fullsized":"2026-02-24T08:27:55.795427+0000","mapping_epoch":63,"log_start":"68'14500","ondisk_log_start":"68'14500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21664","last_scrub_stamp":"2026-02-24T08:27:41.891554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:41.891554+0000","objects_scrubbed":2704,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:48.116017+0000","scrub_duration":603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104398848,"num_objects":1593,"num_object_clones":0,"num_object_copies":4779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24561,"num_write_kb":185984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"73'26052","reported_seq":26109,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:00.651908+0000","last_change":"2026-02-24T08:27:26.865159+0000","last_active":"2026-02-24T08:28:00.651908+0000","last_peered":"2026-02-24T08:28:00.651908+0000","last_clean":"2026-02-24T08:28:00.651908+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:28:00.651908+0000","last_undegraded":"2026-02-24T08:28:00.651908+0000","last_fullsized":"2026-02-24T08:28:00.651908+0000","mapping_epoch":63,"log_start":"69'16000","ondisk_log_start":"69'16000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'18960","last_scrub_stamp":"2026-02-24T08:27:26.865105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:26.865105+0000","objects_scrubbed":2335,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:45.774021+0000","scrub_duration":1596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40304640,"num_objects":615,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":615,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26052,"num_write_kb":189632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"73'25044","reported_seq":25108,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:00.650264+0000","last_change":"2026-02-24T08:27:37.887330+0000","last_active":"2026-02-24T08:28:00.650264+0000","last_peered":"2026-02-24T08:28:00.650264+0000","last_clean":"2026-02-24T08:28:00.650264+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:28:00.650264+0000","last_undegraded":"2026-02-24T08:28:00.650264+0000","last_fullsized":"2026-02-24T08:28:00.650264+0000","mapping_epoch":63,"log_start":"69'15000","ondisk_log_start":"69'15000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20560","last_scrub_stamp":"2026-02-24T08:27:37.887294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:37.887294+0000","objects_scrubbed":2567,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.580636+0000","scrub_duration":641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37355520,"num_objects":570,"num_object_clones":0,"num_object_copies":1710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25044,"num_write_kb":182144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"73'24299","reported_seq":24362,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:55.830960+0000","last_change":"2026-02-24T08:27:40.867066+0000","last_active":"2026-02-24T08:27:55.830960+0000","last_peered":"2026-02-24T08:27:55.830960+0000","last_clean":"2026-02-24T08:27:55.830960+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:27:55.830960+0000","last_undegraded":"2026-02-24T08:27:55.830960+0000","last_fullsized":"2026-02-24T08:27:55.830960+0000","mapping_epoch":63,"log_start":"69'14200","ondisk_log_start":"69'14200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21552","last_scrub_stamp":"2026-02-24T08:27:40.867005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:40.867005+0000","objects_scrubbed":2677,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:04.871126+0000","scrub_duration":940,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110952448,"num_objects":1693,"num_object_clones":0,"num_object_copies":5079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24299,"num_write_kb":184832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"73'25840","reported_seq":25903,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:55.815004+0000","last_change":"2026-02-24T08:27:28.263376+0000","last_active":"2026-02-24T08:27:55.815004+0000","last_peered":"2026-02-24T08:27:55.815004+0000","last_clean":"2026-02-24T08:27:55.815004+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:27:55.815004+0000","last_undegraded":"2026-02-24T08:27:55.815004+0000","last_fullsized":"2026-02-24T08:27:55.815004+0000","mapping_epoch":63,"log_start":"69'15800","ondisk_log_start":"69'15800","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20000","last_scrub_stamp":"2026-02-24T08:27:28.263309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:28.263309+0000","objects_scrubbed":2483,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:47.931229+0000","scrub_duration":1546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114360320,"num_objects":1745,"num_object_clones":0,"num_object_copies":5235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25840,"num_write_kb":196160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"73'25272","reported_seq":25334,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:00.653524+0000","last_change":"2026-02-24T08:27:49.362120+0000","last_active":"2026-02-24T08:28:00.653524+0000","last_peered":"2026-02-24T08:28:00.653524+0000","last_clean":"2026-02-24T08:28:00.653524+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:28:00.653524+0000","last_undegraded":"2026-02-24T08:28:00.653524+0000","last_fullsized":"2026-02-24T08:28:00.653524+0000","mapping_epoch":63,"log_start":"69'15200","ondisk_log_start":"69'15200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'23024","last_scrub_stamp":"2026-02-24T08:27:49.362068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:49.362068+0000","objects_scrubbed":2878,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:06.197075+0000","scrub_duration":147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25272,"num_write_kb":184192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"73'25713","reported_seq":25774,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:00.739744+0000","last_change":"2026-02-24T08:27:34.537371+0000","last_active":"2026-02-24T08:28:00.739744+0000","last_peered":"2026-02-24T08:28:00.739744+0000","last_clean":"2026-02-24T08:28:00.739744+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:28:00.739744+0000","last_undegraded":"2026-02-24T08:28:00.739744+0000","last_fullsized":"2026-02-24T08:28:00.739744+0000","mapping_epoch":63,"log_start":"69'15700","ondisk_log_start":"69'15700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20288","last_scrub_stamp":"2026-02-24T08:27:34.537328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:34.537328+0000","objects_scrubbed":2532,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:44.342049+0000","scrub_duration":594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25713,"num_write_kb":186944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":190,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:46.848837+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:27:46.848837+0000","last_peered":"2026-02-24T08:27:46.848837+0000","last_clean":"2026-02-24T08:27:46.848837+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:46.848837+0000","last_undegraded":"2026-02-24T08:27:46.848837+0000","last_fullsized":"2026-02-24T08:27:46.848837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1116102680,"num_objects":17032,"num_object_clones":0,"num_object_copies":51096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17032,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":402779,"num_write_kb":2985305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3545255936,"data_stored":3545243720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160979,"ondisk_log_size":160979,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3539,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247901,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2552560,"kb_used_data":1665116,"kb_used_omap":10,"kb_used_meta":887413,"kb_avail":731450640,"statfs":{"total":751619276800,"available":749005455360,"internally_reserved":0,"allocated":1705078784,"data_stored":1704624060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10452,"internal_metadata":908711724},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,11,12,11,23,23],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444128,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1335064,"kb_used_data":410116,"kb_used_omap":13,"kb_used_meta":924914,"kb_avail":732668136,"statfs":{"total":751619276800,"available":750252171264,"internally_reserved":0,"allocated":419958784,"data_stored":419504060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14230,"internal_metadata":947112042},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2202408,"kb_used_data":1124628,"kb_used_omap":10,"kb_used_meta":1077685,"kb_avail":731800792,"statfs":{"total":751619276800,"available":749364011008,"internally_reserved":0,"allocated":1151619072,"data_stored":1151171972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10320,"internal_metadata":1103550384},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1447472,"kb_used_data":611868,"kb_used_omap":10,"kb_used_meta":835573,"kb_avail":732555728,"statfs":{"total":751619276800,"available":750137065472,"internally_reserved":0,"allocated":626552832,"data_stored":626098108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10326,"internal_metadata":855627690},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3539,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":506490880,"data_stored":506486808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1093951488,"data_stored":1093951488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":415567872,"data_stored":415563800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1529245696,"data_stored":1529241624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:00.970 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:28:00.971 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_3 pg_num 76 2026-02-24T08:28:01.022 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:01.018+0000 7fe536ecc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:01.025 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:01.022+0000 7fe536ecc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:01.054 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:01.054 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:01.073 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:01.073 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:01.090 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:01.090 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:01.103 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:01.103 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:01.167 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:01.298 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:01.295+0000 7fcf1cbb9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:01.298 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:01.295+0000 7fcf1cbb9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:01.462 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:28:01.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:28:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:01 trial105 ceph-mon[39442]: pgmap v276: 17 pgs: 17 active+clean; 1.0 GiB data, 7.2 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 7.7 MiB/s wr, 3.45k op/s 2026-02-24T08:28:02.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:01 trial105 ceph-mon[39442]: from='client.15083 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:02.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/695531366' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:02.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3660686436' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_3", "var": "pg_num", "val": "76"} : dispatch 2026-02-24T08:28:03.153 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:03.316 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:03.499 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Removed 46646 objects 2026-02-24T08:28:03.500 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Clean up completed and total clean up time :13.3299 2026-02-24T08:28:03.727 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:03.707+0000 7f5871b68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:03.728 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:03.707+0000 7f5871b68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:03.728 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:03.729 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:03.733 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:03.733 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:03.745 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:03.745 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:03.757 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:03.757 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:04.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:03 trial105 ceph-mon[39442]: pgmap v277: 17 pgs: 17 active+clean; 576 MiB data, 5.6 GiB used, 2.7 TiB / 2.7 TiB avail; 3.3 MiB/s wr, 3.46k op/s 2026-02-24T08:28:04.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/566061097' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:05.793 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:05.914 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:06.016 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:06.013+0000 7f9fab9ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:06.016 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:06.013+0000 7f9fab9ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:06.028 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:06.029 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:06.039 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:06.040 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:06.050 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:06.051 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:06.061 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:06.061 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:06.061 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:05 trial105 ceph-mon[39442]: pgmap v278: 17 pgs: 17 active+clean; 576 MiB data, 5.6 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.96k op/s 2026-02-24T08:28:06.504 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:06.504 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:06.504 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:06.622 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:06.725 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:06.722+0000 7f3b9cbf7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:06.726 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:06.723+0000 7f3b9cbf7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:06.834 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:06.835 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:06.871 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2026-02-24T08:28:06.751305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":419946,"num_write_kb":2987455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160810,"ondisk_log_size":160810,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":3766348,"kb_used_data":4540,"kb_used_omap":44,"kb_used_meta":3761683,"kb_avail":2932246452,"statfs":{"total":3006477107200,"available":3002620366848,"internally_reserved":0,"allocated":4648960,"data_stored":2849904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45328,"internal_metadata":3851964144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,4,8,16,19,26,16],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2931122200,"num_objects":-44727,"num_object_clones":0,"num_object_copies":-134181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44727,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001762"},"pg_stats":[{"pgid":"5.f","version":"73'26379","reported_seq":26446,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.416909+0000","last_change":"2026-02-24T08:27:41.036671+0000","last_active":"2026-02-24T08:28:03.416909+0000","last_peered":"2026-02-24T08:28:03.416909+0000","last_clean":"2026-02-24T08:28:03.416909+0000","last_became_active":"2026-02-24T08:26:18.066145+0000","last_became_peered":"2026-02-24T08:26:18.066145+0000","last_unstale":"2026-02-24T08:28:03.416909+0000","last_undegraded":"2026-02-24T08:28:03.416909+0000","last_fullsized":"2026-02-24T08:28:03.416909+0000","mapping_epoch":63,"log_start":"69'16300","ondisk_log_start":"69'16300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21592","last_scrub_stamp":"2026-02-24T08:27:41.036609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:41.036609+0000","objects_scrubbed":2681,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:47.433150+0000","scrub_duration":1083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26379,"num_write_kb":187584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"73'25713","reported_seq":25780,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.405771+0000","last_change":"2026-02-24T08:27:45.388386+0000","last_active":"2026-02-24T08:28:03.405771+0000","last_peered":"2026-02-24T08:28:03.405771+0000","last_clean":"2026-02-24T08:28:03.405771+0000","last_became_active":"2026-02-24T08:26:18.067521+0000","last_became_peered":"2026-02-24T08:26:18.067521+0000","last_unstale":"2026-02-24T08:28:03.405771+0000","last_undegraded":"2026-02-24T08:28:03.405771+0000","last_fullsized":"2026-02-24T08:28:03.405771+0000","mapping_epoch":63,"log_start":"69'15700","ondisk_log_start":"69'15700","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22056","last_scrub_stamp":"2026-02-24T08:27:45.388352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:45.388352+0000","objects_scrubbed":2739,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:57.928278+0000","scrub_duration":1518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25713,"num_write_kb":182848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"73'25121","reported_seq":25184,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.407964+0000","last_change":"2026-02-24T08:27:34.727321+0000","last_active":"2026-02-24T08:28:03.407964+0000","last_peered":"2026-02-24T08:28:03.407964+0000","last_clean":"2026-02-24T08:28:03.407964+0000","last_became_active":"2026-02-24T08:26:18.067772+0000","last_became_peered":"2026-02-24T08:26:18.067772+0000","last_unstale":"2026-02-24T08:28:03.407964+0000","last_undegraded":"2026-02-24T08:28:03.407964+0000","last_fullsized":"2026-02-24T08:28:03.407964+0000","mapping_epoch":63,"log_start":"69'15100","ondisk_log_start":"69'15100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'19440","last_scrub_stamp":"2026-02-24T08:27:34.727275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:34.727275+0000","objects_scrubbed":2429,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:41.277756+0000","scrub_duration":304,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25121,"num_write_kb":178625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"73'26523","reported_seq":26588,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.419682+0000","last_change":"2026-02-24T08:27:40.331227+0000","last_active":"2026-02-24T08:28:03.419682+0000","last_peered":"2026-02-24T08:28:03.419682+0000","last_clean":"2026-02-24T08:28:03.419682+0000","last_became_active":"2026-02-24T08:26:18.065239+0000","last_became_peered":"2026-02-24T08:26:18.065239+0000","last_unstale":"2026-02-24T08:28:03.419682+0000","last_undegraded":"2026-02-24T08:28:03.419682+0000","last_fullsized":"2026-02-24T08:28:03.419682+0000","mapping_epoch":63,"log_start":"69'16500","ondisk_log_start":"69'16500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21704","last_scrub_stamp":"2026-02-24T08:27:40.331183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:40.331183+0000","objects_scrubbed":2701,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:46.939709+0000","scrub_duration":953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26523,"num_write_kb":188608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"73'25236","reported_seq":25303,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.444318+0000","last_change":"2026-02-24T08:27:52.248832+0000","last_active":"2026-02-24T08:28:03.444318+0000","last_peered":"2026-02-24T08:28:03.444318+0000","last_clean":"2026-02-24T08:28:03.444318+0000","last_became_active":"2026-02-24T08:26:18.067455+0000","last_became_peered":"2026-02-24T08:26:18.067455+0000","last_unstale":"2026-02-24T08:28:03.444318+0000","last_undegraded":"2026-02-24T08:28:03.444318+0000","last_fullsized":"2026-02-24T08:28:03.444318+0000","mapping_epoch":63,"log_start":"69'15200","ondisk_log_start":"69'15200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22893","last_scrub_stamp":"2026-02-24T08:27:52.248706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:52.248706+0000","objects_scrubbed":2654,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:17.992997+0000","scrub_duration":2131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25236,"num_write_kb":179456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"73'27009","reported_seq":27075,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.497842+0000","last_change":"2026-02-24T08:27:44.580085+0000","last_active":"2026-02-24T08:28:03.497842+0000","last_peered":"2026-02-24T08:28:03.497842+0000","last_clean":"2026-02-24T08:28:03.497842+0000","last_became_active":"2026-02-24T08:26:18.066859+0000","last_became_peered":"2026-02-24T08:26:18.066859+0000","last_unstale":"2026-02-24T08:28:03.497842+0000","last_undegraded":"2026-02-24T08:28:03.497842+0000","last_fullsized":"2026-02-24T08:28:03.497842+0000","mapping_epoch":63,"log_start":"69'17000","ondisk_log_start":"69'17000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22880","last_scrub_stamp":"2026-02-24T08:27:44.580025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:44.580025+0000","objects_scrubbed":2858,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:51.258735+0000","scrub_duration":391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27009,"num_write_kb":192064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"73'26361","reported_seq":26428,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.426232+0000","last_change":"2026-02-24T08:27:46.168067+0000","last_active":"2026-02-24T08:28:03.426232+0000","last_peered":"2026-02-24T08:28:03.426232+0000","last_clean":"2026-02-24T08:28:03.426232+0000","last_became_active":"2026-02-24T08:26:18.066382+0000","last_became_peered":"2026-02-24T08:26:18.066382+0000","last_unstale":"2026-02-24T08:28:03.426232+0000","last_undegraded":"2026-02-24T08:28:03.426232+0000","last_fullsized":"2026-02-24T08:28:03.426232+0000","mapping_epoch":63,"log_start":"69'16300","ondisk_log_start":"69'16300","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'22712","last_scrub_stamp":"2026-02-24T08:27:46.168023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.168023+0000","objects_scrubbed":2826,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:01.019222+0000","scrub_duration":1326,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26361,"num_write_kb":187456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"73'26248","reported_seq":26314,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.452298+0000","last_change":"2026-02-24T08:27:48.078818+0000","last_active":"2026-02-24T08:28:03.452298+0000","last_peered":"2026-02-24T08:28:03.452298+0000","last_clean":"2026-02-24T08:28:03.452298+0000","last_became_active":"2026-02-24T08:26:18.067050+0000","last_became_peered":"2026-02-24T08:26:18.067050+0000","last_unstale":"2026-02-24T08:28:03.452298+0000","last_undegraded":"2026-02-24T08:28:03.452298+0000","last_fullsized":"2026-02-24T08:28:03.452298+0000","mapping_epoch":63,"log_start":"69'16200","ondisk_log_start":"69'16200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'23040","last_scrub_stamp":"2026-02-24T08:27:48.078660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:48.078660+0000","objects_scrubbed":2869,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:57.525158+0000","scrub_duration":890,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26248,"num_write_kb":186648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"73'27018","reported_seq":27079,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.415805+0000","last_change":"2026-02-24T08:27:20.408387+0000","last_active":"2026-02-24T08:28:03.415805+0000","last_peered":"2026-02-24T08:28:03.415805+0000","last_clean":"2026-02-24T08:28:03.415805+0000","last_became_active":"2026-02-24T08:26:18.067534+0000","last_became_peered":"2026-02-24T08:26:18.067534+0000","last_unstale":"2026-02-24T08:28:03.415805+0000","last_undegraded":"2026-02-24T08:28:03.415805+0000","last_fullsized":"2026-02-24T08:28:03.415805+0000","mapping_epoch":63,"log_start":"69'17000","ondisk_log_start":"69'17000","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'17800","last_scrub_stamp":"2026-02-24T08:27:20.408345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:20.408345+0000","objects_scrubbed":2214,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:27.738857+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27018,"num_write_kb":192128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"73'26154","reported_seq":26219,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.417959+0000","last_change":"2026-02-24T08:27:41.891613+0000","last_active":"2026-02-24T08:28:03.417959+0000","last_peered":"2026-02-24T08:28:03.417959+0000","last_clean":"2026-02-24T08:28:03.417959+0000","last_became_active":"2026-02-24T08:26:18.064422+0000","last_became_peered":"2026-02-24T08:26:18.064422+0000","last_unstale":"2026-02-24T08:28:03.417959+0000","last_undegraded":"2026-02-24T08:28:03.417959+0000","last_fullsized":"2026-02-24T08:28:03.417959+0000","mapping_epoch":63,"log_start":"69'16100","ondisk_log_start":"69'16100","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21664","last_scrub_stamp":"2026-02-24T08:27:41.891554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:41.891554+0000","objects_scrubbed":2704,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:48.116017+0000","scrub_duration":603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26154,"num_write_kb":185984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"73'26667","reported_seq":26730,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.416815+0000","last_change":"2026-02-24T08:27:26.865159+0000","last_active":"2026-02-24T08:28:03.416815+0000","last_peered":"2026-02-24T08:28:03.416815+0000","last_clean":"2026-02-24T08:28:03.416815+0000","last_became_active":"2026-02-24T08:26:18.067441+0000","last_became_peered":"2026-02-24T08:26:18.067441+0000","last_unstale":"2026-02-24T08:28:03.416815+0000","last_undegraded":"2026-02-24T08:28:03.416815+0000","last_fullsized":"2026-02-24T08:28:03.416815+0000","mapping_epoch":63,"log_start":"69'16600","ondisk_log_start":"69'16600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'18960","last_scrub_stamp":"2026-02-24T08:27:26.865105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:26.865105+0000","objects_scrubbed":2335,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:45.774021+0000","scrub_duration":1596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26667,"num_write_kb":189632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"73'25614","reported_seq":25678,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.443914+0000","last_change":"2026-02-24T08:27:37.887330+0000","last_active":"2026-02-24T08:28:03.443914+0000","last_peered":"2026-02-24T08:28:03.443914+0000","last_clean":"2026-02-24T08:28:03.443914+0000","last_became_active":"2026-02-24T08:26:18.067259+0000","last_became_peered":"2026-02-24T08:26:18.067259+0000","last_unstale":"2026-02-24T08:28:03.443914+0000","last_undegraded":"2026-02-24T08:28:03.443914+0000","last_fullsized":"2026-02-24T08:28:03.443914+0000","mapping_epoch":63,"log_start":"69'15600","ondisk_log_start":"69'15600","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20560","last_scrub_stamp":"2026-02-24T08:27:37.887294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:37.887294+0000","objects_scrubbed":2567,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.580636+0000","scrub_duration":641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25614,"num_write_kb":182144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"73'25992","reported_seq":26057,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.451560+0000","last_change":"2026-02-24T08:27:40.867066+0000","last_active":"2026-02-24T08:28:03.451560+0000","last_peered":"2026-02-24T08:28:03.451560+0000","last_clean":"2026-02-24T08:28:03.451560+0000","last_became_active":"2026-02-24T08:26:18.067263+0000","last_became_peered":"2026-02-24T08:26:18.067263+0000","last_unstale":"2026-02-24T08:28:03.451560+0000","last_undegraded":"2026-02-24T08:28:03.451560+0000","last_fullsized":"2026-02-24T08:28:03.451560+0000","mapping_epoch":63,"log_start":"69'15900","ondisk_log_start":"69'15900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'21552","last_scrub_stamp":"2026-02-24T08:27:40.867005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:40.867005+0000","objects_scrubbed":2677,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:04.871126+0000","scrub_duration":940,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25992,"num_write_kb":184832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"73'27585","reported_seq":27648,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.426360+0000","last_change":"2026-02-24T08:27:28.263376+0000","last_active":"2026-02-24T08:28:03.426360+0000","last_peered":"2026-02-24T08:28:03.426360+0000","last_clean":"2026-02-24T08:28:03.426360+0000","last_became_active":"2026-02-24T08:26:18.067123+0000","last_became_peered":"2026-02-24T08:26:18.067123+0000","last_unstale":"2026-02-24T08:28:03.426360+0000","last_undegraded":"2026-02-24T08:28:03.426360+0000","last_fullsized":"2026-02-24T08:28:03.426360+0000","mapping_epoch":63,"log_start":"69'17500","ondisk_log_start":"69'17500","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20000","last_scrub_stamp":"2026-02-24T08:27:28.263309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:28.263309+0000","objects_scrubbed":2483,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:47.931229+0000","scrub_duration":1546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27585,"num_write_kb":196160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"73'25902","reported_seq":25968,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.447176+0000","last_change":"2026-02-24T08:27:49.362120+0000","last_active":"2026-02-24T08:28:03.447176+0000","last_peered":"2026-02-24T08:28:03.447176+0000","last_clean":"2026-02-24T08:28:03.447176+0000","last_became_active":"2026-02-24T08:26:18.065458+0000","last_became_peered":"2026-02-24T08:26:18.065458+0000","last_unstale":"2026-02-24T08:28:03.447176+0000","last_undegraded":"2026-02-24T08:28:03.447176+0000","last_fullsized":"2026-02-24T08:28:03.447176+0000","mapping_epoch":63,"log_start":"69'15900","ondisk_log_start":"69'15900","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'23024","last_scrub_stamp":"2026-02-24T08:27:49.362068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:49.362068+0000","objects_scrubbed":2878,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:06.197075+0000","scrub_duration":147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25902,"num_write_kb":184192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"73'26289","reported_seq":26353,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:28:03.436250+0000","last_change":"2026-02-24T08:27:34.537371+0000","last_active":"2026-02-24T08:28:03.436250+0000","last_peered":"2026-02-24T08:28:03.436250+0000","last_clean":"2026-02-24T08:28:03.436250+0000","last_became_active":"2026-02-24T08:26:18.067072+0000","last_became_peered":"2026-02-24T08:26:18.067072+0000","last_unstale":"2026-02-24T08:28:03.436250+0000","last_undegraded":"2026-02-24T08:28:03.436250+0000","last_fullsized":"2026-02-24T08:28:03.436250+0000","mapping_epoch":63,"log_start":"69'16200","ondisk_log_start":"69'16200","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'20288","last_scrub_stamp":"2026-02-24T08:27:34.537328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:26:17.054519+0000","last_clean_scrub_stamp":"2026-02-24T08:27:34.537328+0000","objects_scrubbed":2532,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:44.342049+0000","scrub_duration":594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26289,"num_write_kb":186944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":190,"reported_epoch":73,"state":"active+clean","last_fresh":"2026-02-24T08:27:46.848837+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:27:46.848837+0000","last_peered":"2026-02-24T08:27:46.848837+0000","last_clean":"2026-02-24T08:27:46.848837+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:27:46.848837+0000","last_undegraded":"2026-02-24T08:27:46.848837+0000","last_fullsized":"2026-02-24T08:27:46.848837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":419811,"num_write_kb":2985305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160711,"ondisk_log_size":160711,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3539,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247903,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":906772,"kb_used_data":1280,"kb_used_omap":10,"kb_used_meta":905461,"kb_avail":733096428,"statfs":{"total":751619276800,"available":750690742272,"internally_reserved":0,"allocated":1310720,"data_stored":860068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10452,"internal_metadata":927192876},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,3,6,9,11,18,16],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444129,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":926228,"kb_used_data":1280,"kb_used_omap":13,"kb_used_meta":924914,"kb_avail":733076972,"statfs":{"total":751619276800,"available":750670819328,"internally_reserved":0,"allocated":1310720,"data_stored":860068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14230,"internal_metadata":947112042},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1096464,"kb_used_data":700,"kb_used_omap":10,"kb_used_meta":1095733,"kb_avail":732906736,"statfs":{"total":751619276800,"available":750496497664,"internally_reserved":0,"allocated":716800,"data_stored":269700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10320,"internal_metadata":1122031536},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,2,7,8,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705765,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":836884,"kb_used_data":1280,"kb_used_omap":10,"kb_used_meta":835573,"kb_avail":733166316,"statfs":{"total":751619276800,"available":750762307584,"internally_reserved":0,"allocated":1310720,"data_stored":860068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10326,"internal_metadata":855627690},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3539,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:07.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:06 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/684811001' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:08.096 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:08.120 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:07 trial105 ceph-mon[39442]: pgmap v279: 17 pgs: 17 active+clean; 577 KiB data, 3.6 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 3.73k op/s 2026-02-24T08:28:08.121 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:07 trial105 ceph-mon[39442]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:08.214 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:08.313 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:08.310+0000 7f9cc97f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:08.313 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:08.310+0000 7f9cc97f1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:08.325 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:08.325 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:08.336 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:08.336 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:08.346 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:08.346 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:08.355 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:08.356 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:08.929 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_3 2026-02-24T08:28:08.929 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2026-02-24T08:28:09.048 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:09.071 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/542852455' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:09.150 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:09.147+0000 7fa5c6f32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:09.150 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:09.147+0000 7fa5c6f32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:09.812 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:28:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:28:09] "GET /metrics HTTP/1.1" 200 4217 "" "Prometheus/3.6.0" 2026-02-24T08:28:09.815 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_3' removed 2026-02-24T08:28:09.843 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:28:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:28:09.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:28:09.862 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T08:28:09.862 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T08:28:09.862 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_4 2026-02-24T08:28:09.863 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool create unique_pool_4 16 2026-02-24T08:28:09.980 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:10.083 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:10.079+0000 7fbc9e394640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:10.083 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:09 trial105 ceph-mon[39442]: pgmap v280: 17 pgs: 17 active+clean; 577 KiB data, 3.6 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.26k op/s 2026-02-24T08:28:10.083 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:09 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4257910655' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:28:10.084 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:10.079+0000 7fbc9e394640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:10.390 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:10.509 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:10.610 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:10.606+0000 7f1f5e378640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:10.610 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:10.606+0000 7f1f5e378640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:10.622 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:10.622 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:10.632 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:10.633 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:10.644 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:10.644 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:10.654 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:10.655 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:10.819 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_4' created 2026-02-24T08:28:10.862 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2026-02-24T08:28:10.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4257910655' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_3", "pool2": "unique_pool_3", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:28:10.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:10 trial105 ceph-mon[39442]: osdmap e74: 4 total, 4 up, 4 in 2026-02-24T08:28:10.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3534238720' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16} : dispatch 2026-02-24T08:28:10.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/967971805' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:10.976 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:11.078 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:11.074+0000 7ffad6699640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:11.078 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:11.074+0000 7ffad6699640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:11.824 INFO:teuthology.orchestra.run.trial105.stderr:enabled application 'rados' on pool 'unique_pool_4' 2026-02-24T08:28:11.872 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:11.872 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:11 trial105 ceph-mon[39442]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 3.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:28:12.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3534238720' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_4", "pg_num": 16}]': finished 2026-02-24T08:28:12.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:11 trial105 ceph-mon[39442]: osdmap e75: 4 total, 4 up, 4 in 2026-02-24T08:28:12.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3429917713' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:28:12.693 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:12.809 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:12.865 DEBUG:teuthology.orchestra.run.trial105:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_4 bench 90 write' 2026-02-24T08:28:12.865 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:28:12.865 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:12.867 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T08:28:12.867 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T08:28:12.908 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:12.904+0000 7faf85564640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:12.908 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:12.905+0000 7faf85564640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:12.921 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:12.921 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:12.923 INFO:tasks.radosbench.radosbench.0.trial105.stdout:hints = 1 2026-02-24T08:28:12.923 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T08:28:12.924 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object prefix: benchmark_data_trial105_120311 2026-02-24T08:28:12.924 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:28:12.924 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 0 0 0 0 0 0 - 0 2026-02-24T08:28:12.933 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:12.933 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:12.949 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:12.950 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:12.964 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:12.964 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:12.972 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:12 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3429917713' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_4", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:28:12.972 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:12 trial105 ceph-mon[39442]: osdmap e76: 4 total, 4 up, 4 in 2026-02-24T08:28:12.972 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:12 trial105 ceph-mon[39442]: osdmap e77: 4 total, 4 up, 4 in 2026-02-24T08:28:13.003 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:13.135 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:13.131+0000 7fe52665b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:13.135 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:13.131+0000 7fe52665b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:13.294 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:13.297 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:13.339 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2026-02-24T08:28:12.752059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":3784444,"kb_used_data":4588,"kb_used_omap":46,"kb_used_meta":3779729,"kb_avail":2932228356,"statfs":{"total":3006477107200,"available":3002601836544,"internally_reserved":0,"allocated":4698112,"data_stored":2867540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47940,"internal_metadata":3870442684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-419811,"num_write_kb":-2985305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000495"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2026-02-24T08:28:10.821047+0000","last_change":"2026-02-24T08:28:10.821047+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.821047+0000","last_undegraded":"2026-02-24T08:28:10.821047+0000","last_fullsized":"2026-02-24T08:28:10.821047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:28:10.813810+0000","last_change":"2026-02-24T08:28:10.813810+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.813810+0000","last_undegraded":"2026-02-24T08:28:10.813810+0000","last_fullsized":"2026-02-24T08:28:10.813810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:28:10.813810+0000","last_change":"2026-02-24T08:28:10.813810+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.813810+0000","last_undegraded":"2026-02-24T08:28:10.813810+0000","last_fullsized":"2026-02-24T08:28:10.813810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2026-02-24T08:28:10.821382+0000","last_change":"2026-02-24T08:28:10.821382+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.821382+0000","last_undegraded":"2026-02-24T08:28:10.821382+0000","last_fullsized":"2026-02-24T08:28:10.821382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2026-02-24T08:28:10.820802+0000","last_change":"2026-02-24T08:28:10.820802+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.820802+0000","last_undegraded":"2026-02-24T08:28:10.820802+0000","last_fullsized":"2026-02-24T08:28:10.820802+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:28:10.813810+0000","last_change":"2026-02-24T08:28:10.813810+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.813810+0000","last_undegraded":"2026-02-24T08:28:10.813810+0000","last_fullsized":"2026-02-24T08:28:10.813810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:28:10.813810+0000","last_change":"2026-02-24T08:28:10.813810+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.813810+0000","last_undegraded":"2026-02-24T08:28:10.813810+0000","last_fullsized":"2026-02-24T08:28:10.813810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2026-02-24T08:28:10.821929+0000","last_change":"2026-02-24T08:28:10.821929+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.821929+0000","last_undegraded":"2026-02-24T08:28:10.821929+0000","last_fullsized":"2026-02-24T08:28:10.821929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2026-02-24T08:28:10.820983+0000","last_change":"2026-02-24T08:28:10.820983+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.820983+0000","last_undegraded":"2026-02-24T08:28:10.820983+0000","last_fullsized":"2026-02-24T08:28:10.820983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:28:10.813810+0000","last_change":"2026-02-24T08:28:10.813810+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.813810+0000","last_undegraded":"2026-02-24T08:28:10.813810+0000","last_fullsized":"2026-02-24T08:28:10.813810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2026-02-24T08:28:10.821058+0000","last_change":"2026-02-24T08:28:10.821058+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.821058+0000","last_undegraded":"2026-02-24T08:28:10.821058+0000","last_fullsized":"2026-02-24T08:28:10.821058+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:28:10.813810+0000","last_change":"2026-02-24T08:28:10.813810+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.813810+0000","last_undegraded":"2026-02-24T08:28:10.813810+0000","last_fullsized":"2026-02-24T08:28:10.813810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2026-02-24T08:28:10.821908+0000","last_change":"2026-02-24T08:28:10.821908+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.821908+0000","last_undegraded":"2026-02-24T08:28:10.821908+0000","last_fullsized":"2026-02-24T08:28:10.821908+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2026-02-24T08:28:10.820834+0000","last_change":"2026-02-24T08:28:10.820834+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.820834+0000","last_undegraded":"2026-02-24T08:28:10.820834+0000","last_fullsized":"2026-02-24T08:28:10.820834+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:28:10.813810+0000","last_change":"2026-02-24T08:28:10.813810+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.813810+0000","last_undegraded":"2026-02-24T08:28:10.813810+0000","last_fullsized":"2026-02-24T08:28:10.813810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2026-02-24T08:28:10.822311+0000","last_change":"2026-02-24T08:28:10.822311+0000","last_active":"2026-02-24T08:28:10.813810+0000","last_peered":"2026-02-24T08:28:10.813810+0000","last_clean":"2026-02-24T08:28:10.813810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:28:10.822311+0000","last_undegraded":"2026-02-24T08:28:10.822311+0000","last_fullsized":"2026-02-24T08:28:10.822311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":194,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T08:28:10.822624+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:28:10.822624+0000","last_peered":"2026-02-24T08:28:10.822624+0000","last_clean":"2026-02-24T08:28:10.822624+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:10.822624+0000","last_undegraded":"2026-02-24T08:28:10.822624+0000","last_fullsized":"2026-02-24T08:28:10.822624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":27,"acting":27,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3643,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247904,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":906784,"kb_used_data":1292,"kb_used_omap":10,"kb_used_meta":905461,"kb_avail":733096416,"statfs":{"total":751619276800,"available":750690729984,"internally_reserved":0,"allocated":1323008,"data_stored":864477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11108,"internal_metadata":927192220},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444130,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":944288,"kb_used_data":1292,"kb_used_omap":14,"kb_used_meta":942961,"kb_avail":733058912,"statfs":{"total":751619276800,"available":750652325888,"internally_reserved":0,"allocated":1323008,"data_stored":864477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14882,"internal_metadata":965592542},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1096476,"kb_used_data":712,"kb_used_omap":10,"kb_used_meta":1095733,"kb_avail":732906724,"statfs":{"total":751619276800,"available":750496485376,"internally_reserved":0,"allocated":729088,"data_stored":274109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10972,"internal_metadata":1122030884},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705766,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":836896,"kb_used_data":1292,"kb_used_omap":10,"kb_used_meta":835573,"kb_avail":733166304,"statfs":{"total":751619276800,"available":750762295296,"internally_reserved":0,"allocated":1323008,"data_stored":864477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10978,"internal_metadata":855627038},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3643,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:13.925 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 1 127 10641 10514 82.1336 82.1406 0.0176496 0.0120669 2026-02-24T08:28:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:13 trial105 ceph-mon[39442]: pgmap v286: 17 pgs: 9 creating+peering, 1 active+clean, 7 unknown; 577 KiB data, 3.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:28:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3872796854' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:14.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:13 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:28:14.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:13 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:28:14.925 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 2 128 20575 20447 79.8646 77.6016 0.0149779 0.0124694 2026-02-24T08:28:15.011 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:15.183 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:14 trial105 ceph-mon[39442]: from='client.15110 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:28:15.344 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:15.339+0000 7f9fa66d4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:15.344 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:15.340+0000 7f9fa66d4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:15.361 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:15.362 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:15.379 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:15.379 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:15.396 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:15.396 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:15.411 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:15.411 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:15.925 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 3 128 30016 29888 77.8271 73.7578 0.00735469 0.0128198 2026-02-24T08:28:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:15 trial105 ceph-mon[39442]: pgmap v287: 17 pgs: 9 creating+peering, 1 active+clean, 7 unknown; 577 KiB data, 3.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:28:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:15 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1392971559' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:16.925 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 4 127 39426 39299 76.7464 73.5234 0.00934687 0.0130031 2026-02-24T08:28:17.464 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:17.658 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:17.790 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:17.786+0000 7fca47d7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:17.790 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:17.786+0000 7fca47d7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:17.810 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:17.810 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:17.827 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:17.827 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:17.843 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:17.843 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:17.857 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:17.857 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:17.925 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 5 127 48048 47921 74.868 67.3594 0.00491639 0.0133207 2026-02-24T08:28:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:17 trial105 ceph-mon[39442]: pgmap v288: 17 pgs: 17 active+clean; 226 MiB data, 4.2 GiB used, 2.7 TiB / 2.7 TiB avail; 38 MiB/s wr, 4.80k op/s 2026-02-24T08:28:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:17 trial105 ceph-mon[39442]: osdmap e78: 4 total, 4 up, 4 in 2026-02-24T08:28:18.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3256920346' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:18.343 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:18.343 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:18.343 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:28:18.343 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:18.501 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:18.631 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:18.627+0000 7f4a016be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:18.631 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:18.628+0000 7f4a016be640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:18.790 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:18.791 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:18.837 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2026-02-24T08:28:18.752885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":236782112,"num_objects":3607,"num_object_clones":0,"num_object_copies":10821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3607,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":28967,"num_write_kb":232806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28931,"ondisk_log_size":28931,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4361108,"kb_used_data":543940,"kb_used_omap":55,"kb_used_meta":3817032,"kb_avail":2931651692,"statfs":{"total":3006477107200,"available":3002011332608,"internally_reserved":0,"allocated":556994560,"data_stored":555073664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56424,"internal_metadata":3908641688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":236191744,"num_objects":3605,"num_object_clones":0,"num_object_copies":10815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28832,"num_write_kb":230656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.930516"},"pg_stats":[{"pgid":"6.f","version":"77'1576","reported_seq":1581,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.842296+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:28:15.842296+0000","last_peered":"2026-02-24T08:28:15.842296+0000","last_clean":"2026-02-24T08:28:15.842296+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:28:15.842296+0000","last_undegraded":"2026-02-24T08:28:15.842296+0000","last_fullsized":"2026-02-24T08:28:15.842296+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"77'1736","reported_seq":1745,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.745941+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:28:15.745941+0000","last_peered":"2026-02-24T08:28:15.745941+0000","last_clean":"2026-02-24T08:28:15.745941+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:28:15.745941+0000","last_undegraded":"2026-02-24T08:28:15.745941+0000","last_fullsized":"2026-02-24T08:28:15.745941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1736,"log_dups_size":0,"ondisk_log_size":1736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1736,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"77'1920","reported_seq":1927,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.746055+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:28:15.746055+0000","last_peered":"2026-02-24T08:28:15.746055+0000","last_clean":"2026-02-24T08:28:15.746055+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:28:15.746055+0000","last_undegraded":"2026-02-24T08:28:15.746055+0000","last_fullsized":"2026-02-24T08:28:15.746055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1920,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"77'1704","reported_seq":1718,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.778261+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:28:15.778261+0000","last_peered":"2026-02-24T08:28:15.778261+0000","last_clean":"2026-02-24T08:28:15.778261+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:28:15.778261+0000","last_undegraded":"2026-02-24T08:28:15.778261+0000","last_fullsized":"2026-02-24T08:28:15.778261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1704,"log_dups_size":0,"ondisk_log_size":1704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:10.954657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1704,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"77'1855","reported_seq":1844,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.842481+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:28:15.842481+0000","last_peered":"2026-02-24T08:28:15.842481+0000","last_clean":"2026-02-24T08:28:15.842481+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:28:15.842481+0000","last_undegraded":"2026-02-24T08:28:15.842481+0000","last_fullsized":"2026-02-24T08:28:15.842481+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15196160,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1855,"num_write_kb":14840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"77'1576","reported_seq":1589,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.746164+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:28:15.746164+0000","last_peered":"2026-02-24T08:28:15.746164+0000","last_clean":"2026-02-24T08:28:15.746164+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:28:15.746164+0000","last_undegraded":"2026-02-24T08:28:15.746164+0000","last_fullsized":"2026-02-24T08:28:15.746164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1576,"log_dups_size":0,"ondisk_log_size":1576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1576,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"77'1760","reported_seq":1774,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.657561+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:28:15.657561+0000","last_peered":"2026-02-24T08:28:15.657561+0000","last_clean":"2026-02-24T08:28:15.657561+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:28:15.657561+0000","last_undegraded":"2026-02-24T08:28:15.657561+0000","last_fullsized":"2026-02-24T08:28:15.657561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1760,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"77'1958","reported_seq":1960,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.852934+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:28:15.852934+0000","last_peered":"2026-02-24T08:28:15.852934+0000","last_clean":"2026-02-24T08:28:15.852934+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:28:15.852934+0000","last_undegraded":"2026-02-24T08:28:15.852934+0000","last_fullsized":"2026-02-24T08:28:15.852934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16039936,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1958,"num_write_kb":15664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"77'1944","reported_seq":1945,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.842177+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:28:15.842177+0000","last_peered":"2026-02-24T08:28:15.842177+0000","last_clean":"2026-02-24T08:28:15.842177+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:28:15.842177+0000","last_undegraded":"2026-02-24T08:28:15.842177+0000","last_fullsized":"2026-02-24T08:28:15.842177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1944,"log_dups_size":0,"ondisk_log_size":1944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1944,"num_write_kb":15552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"77'1896","reported_seq":1910,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.743700+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:28:15.743700+0000","last_peered":"2026-02-24T08:28:15.743700+0000","last_clean":"2026-02-24T08:28:15.743700+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:28:15.743700+0000","last_undegraded":"2026-02-24T08:28:15.743700+0000","last_fullsized":"2026-02-24T08:28:15.743700+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1896,"num_write_kb":15168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"77'1736","reported_seq":1750,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.827431+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:28:15.827431+0000","last_peered":"2026-02-24T08:28:15.827431+0000","last_clean":"2026-02-24T08:28:15.827431+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:28:15.827431+0000","last_undegraded":"2026-02-24T08:28:15.827431+0000","last_fullsized":"2026-02-24T08:28:15.827431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1736,"log_dups_size":0,"ondisk_log_size":1736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221312,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1736,"num_write_kb":13888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"77'1987","reported_seq":1998,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.728819+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:28:15.728819+0000","last_peered":"2026-02-24T08:28:15.728819+0000","last_clean":"2026-02-24T08:28:15.728819+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:28:15.728819+0000","last_undegraded":"2026-02-24T08:28:15.728819+0000","last_fullsized":"2026-02-24T08:28:15.728819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16277504,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1987,"num_write_kb":15896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"77'1856","reported_seq":1870,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.851754+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:28:15.851754+0000","last_peered":"2026-02-24T08:28:15.851754+0000","last_clean":"2026-02-24T08:28:15.851754+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:28:15.851754+0000","last_undegraded":"2026-02-24T08:28:15.851754+0000","last_fullsized":"2026-02-24T08:28:15.851754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1856,"log_dups_size":0,"ondisk_log_size":1856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1856,"num_write_kb":14848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"77'1808","reported_seq":1810,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.841800+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:28:15.841800+0000","last_peered":"2026-02-24T08:28:15.841800+0000","last_clean":"2026-02-24T08:28:15.841800+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:28:15.841800+0000","last_undegraded":"2026-02-24T08:28:15.841800+0000","last_fullsized":"2026-02-24T08:28:15.841800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1808,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"77'1688","reported_seq":1702,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.650166+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:28:15.650166+0000","last_peered":"2026-02-24T08:28:15.650166+0000","last_clean":"2026-02-24T08:28:15.650166+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:28:15.650166+0000","last_undegraded":"2026-02-24T08:28:15.650166+0000","last_fullsized":"2026-02-24T08:28:15.650166+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1688,"log_dups_size":0,"ondisk_log_size":1688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1688,"num_write_kb":13504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"77'1832","reported_seq":1836,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:15.852279+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:28:15.852279+0000","last_peered":"2026-02-24T08:28:15.852279+0000","last_clean":"2026-02-24T08:28:15.852279+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:28:15.852279+0000","last_undegraded":"2026-02-24T08:28:15.852279+0000","last_fullsized":"2026-02-24T08:28:15.852279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1832,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":198,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-24T08:28:12.097322+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:28:12.097322+0000","last_peered":"2026-02-24T08:28:12.097322+0000","last_clean":"2026-02-24T08:28:12.097322+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:12.097322+0000","last_undegraded":"2026-02-24T08:28:12.097322+0000","last_fullsized":"2026-02-24T08:28:12.097322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":236191744,"num_objects":3605,"num_object_clones":0,"num_object_copies":10815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3605,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28832,"num_write_kb":230656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":704077824,"data_stored":704077824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28832,"ondisk_log_size":28832,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3755,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1036228,"kb_used_data":112688,"kb_used_omap":13,"kb_used_meta":923506,"kb_avail":732966972,"statfs":{"total":751619276800,"available":750558179328,"internally_reserved":0,"allocated":115392512,"data_stored":114911400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13724,"internal_metadata":945670756},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444131,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1056076,"kb_used_data":113080,"kb_used_omap":16,"kb_used_meta":942959,"kb_avail":732947124,"statfs":{"total":751619276800,"available":750537854976,"internally_reserved":0,"allocated":115793920,"data_stored":115312808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16838,"internal_metadata":965590586},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1276112,"kb_used_data":179132,"kb_used_omap":12,"kb_used_meta":1096947,"kb_avail":732727088,"statfs":{"total":751619276800,"available":750312538112,"internally_reserved":0,"allocated":183431168,"data_stored":182953608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12928,"internal_metadata":1123274112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705767,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":992692,"kb_used_data":139040,"kb_used_omap":12,"kb_used_meta":853619,"kb_avail":733010508,"statfs":{"total":751619276800,"available":750602760192,"internally_reserved":0,"allocated":142376960,"data_stored":141895848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12934,"internal_metadata":874106234},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3755,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":169893888,"data_stored":169893888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":208551936,"data_stored":208551936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":172744704,"data_stored":172744704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":152887296,"data_stored":152887296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:18.839 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:28:18.839 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 151 2026-02-24T08:28:18.925 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 6 128 56160 56032 72.9505 63.3672 0.00583162 0.01368 2026-02-24T08:28:18.999 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:19.146 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:19.142+0000 7f7f0a099640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:19.146 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:19.142+0000 7f7f0a099640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:19.310 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:28:19.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:28:19.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:28:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:28:19] "GET /metrics HTTP/1.1" 200 4165 "" "Prometheus/3.6.0" 2026-02-24T08:28:19.905 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:19.925 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 7 128 63644 63516 70.879 58.4688 0.0108833 0.0140918 2026-02-24T08:28:19.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:28:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:28:19.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:28:20.070 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:20.101 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:19 trial105 ceph-mon[39442]: pgmap v290: 17 pgs: 17 active+clean; 226 MiB data, 4.2 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.16k op/s 2026-02-24T08:28:20.101 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:19 trial105 ceph-mon[39442]: from='client.15116 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:20.101 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3498856771' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "151"} : dispatch 2026-02-24T08:28:20.215 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:20.212+0000 7fa51d128640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:20.215 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:20.212+0000 7fa51d128640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:20.230 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:20.230 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:20.249 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:20.249 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:20.264 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:20.264 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:20.278 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:20.278 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:20.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 8 128 70937 70809 69.1407 56.9766 0.00964297 0.0144355 2026-02-24T08:28:21.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:20 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/453606553' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:21.925 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 9 128 77758 77630 67.379 53.2891 0.0457406 0.0148142 2026-02-24T08:28:22.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:21 trial105 ceph-mon[39442]: pgmap v291: 17 pgs: 17 active+clean; 266 MiB data, 4.4 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 3.92k op/s 2026-02-24T08:28:22.325 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:22.480 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:22.612 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:22.609+0000 7f30e6d18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:22.613 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:22.609+0000 7f30e6d18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:22.630 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:22.630 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:22.649 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:22.649 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:22.665 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:22.665 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:22.682 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:22.682 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:22.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 10 128 84271 84143 65.729 50.8828 0.00836015 0.0151894 2026-02-24T08:28:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:23 trial105 ceph-mon[39442]: osdmap e79: 4 total, 4 up, 4 in 2026-02-24T08:28:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1350567044' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:23.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:23 trial105 ceph-mon[39442]: pgmap v293: 17 pgs: 17 active+clean; 547 MiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.74k op/s 2026-02-24T08:28:23.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 11 128 90731 90603 64.3414 50.4688 0.0111878 0.0155188 2026-02-24T08:28:24.357 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:24.357 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:24.357 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T08:28:24.358 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:24.385 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:24 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:28:24.385 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:24 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:28:24.509 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:24.733 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:24.915 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:24.871+0000 7f6ea1b3a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:24.916 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:24.871+0000 7f6ea1b3a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:24.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 12 128 96049 95921 62.4416 41.5469 0.0485391 0.0159956 2026-02-24T08:28:24.934 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:25.044 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:25.044 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:25.243 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2026-02-24T08:28:24.753695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":573604384,"num_objects":8750,"num_object_clones":0,"num_object_copies":26250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8750,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":70083,"num_write_kb":561734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70047,"ondisk_log_size":70047,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5251740,"kb_used_data":1612364,"kb_used_omap":57,"kb_used_meta":3639238,"kb_avail":2930761060,"statfs":{"total":3006477107200,"available":3001099325440,"internally_reserved":0,"allocated":1651060736,"data_stored":1649108292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59027,"internal_metadata":3726580077},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,8,17,26,30,12,11],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":336822272,"num_objects":5143,"num_object_clones":0,"num_object_copies":15429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41116,"num_write_kb":328928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001137"},"pg_stats":[{"pgid":"6.f","version":"78'4229","reported_seq":4243,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.843675+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:28:20.843675+0000","last_peered":"2026-02-24T08:28:20.843675+0000","last_clean":"2026-02-24T08:28:20.843675+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:28:20.843675+0000","last_undegraded":"2026-02-24T08:28:20.843675+0000","last_fullsized":"2026-02-24T08:28:20.843675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4229,"log_dups_size":0,"ondisk_log_size":4229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34643968,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":529,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4229,"num_write_kb":33832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"78'4384","reported_seq":4400,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.688820+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:28:20.688820+0000","last_peered":"2026-02-24T08:28:20.688820+0000","last_clean":"2026-02-24T08:28:20.688820+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:28:20.688820+0000","last_undegraded":"2026-02-24T08:28:20.688820+0000","last_fullsized":"2026-02-24T08:28:20.688820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4384,"log_dups_size":0,"ondisk_log_size":4384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":548,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4384,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"78'4548","reported_seq":4559,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.753325+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:28:20.753325+0000","last_peered":"2026-02-24T08:28:20.753325+0000","last_clean":"2026-02-24T08:28:20.753325+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:28:20.753325+0000","last_undegraded":"2026-02-24T08:28:20.753325+0000","last_fullsized":"2026-02-24T08:28:20.753325+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37257216,"num_objects":569,"num_object_clones":0,"num_object_copies":1707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4548,"num_write_kb":36384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"78'4350","reported_seq":4361,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.831741+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:28:20.831741+0000","last_peered":"2026-02-24T08:28:20.831741+0000","last_clean":"2026-02-24T08:28:20.831741+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:28:20.831741+0000","last_undegraded":"2026-02-24T08:28:20.831741+0000","last_fullsized":"2026-02-24T08:28:20.831741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4350,"log_dups_size":0,"ondisk_log_size":4350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:10.954657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35635200,"num_objects":544,"num_object_clones":0,"num_object_copies":1632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":544,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4350,"num_write_kb":34800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"78'4264","reported_seq":4280,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.842545+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:28:20.842545+0000","last_peered":"2026-02-24T08:28:20.842545+0000","last_clean":"2026-02-24T08:28:20.842545+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:28:20.842545+0000","last_undegraded":"2026-02-24T08:28:20.842545+0000","last_fullsized":"2026-02-24T08:28:20.842545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":0,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4264,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"78'4392","reported_seq":4408,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.747328+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:28:20.747328+0000","last_peered":"2026-02-24T08:28:20.747328+0000","last_clean":"2026-02-24T08:28:20.747328+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:28:20.747328+0000","last_undegraded":"2026-02-24T08:28:20.747328+0000","last_fullsized":"2026-02-24T08:28:20.747328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4392,"log_dups_size":0,"ondisk_log_size":4392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4392,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"78'4338","reported_seq":4354,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.663173+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:28:20.663173+0000","last_peered":"2026-02-24T08:28:20.663173+0000","last_clean":"2026-02-24T08:28:20.663173+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:28:20.663173+0000","last_undegraded":"2026-02-24T08:28:20.663173+0000","last_fullsized":"2026-02-24T08:28:20.663173+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4338,"log_dups_size":0,"ondisk_log_size":4338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35536896,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4338,"num_write_kb":34704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"78'4440","reported_seq":4456,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.844677+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:28:20.844677+0000","last_peered":"2026-02-24T08:28:20.844677+0000","last_clean":"2026-02-24T08:28:20.844677+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:28:20.844677+0000","last_undegraded":"2026-02-24T08:28:20.844677+0000","last_fullsized":"2026-02-24T08:28:20.844677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36372480,"num_objects":555,"num_object_clones":0,"num_object_copies":1665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4440,"num_write_kb":35520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"78'4547","reported_seq":4558,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.845076+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:28:20.845076+0000","last_peered":"2026-02-24T08:28:20.845076+0000","last_clean":"2026-02-24T08:28:20.845076+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:28:20.845076+0000","last_undegraded":"2026-02-24T08:28:20.845076+0000","last_fullsized":"2026-02-24T08:28:20.845076+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37249024,"num_objects":569,"num_object_clones":0,"num_object_copies":1707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4547,"num_write_kb":36376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"78'4376","reported_seq":4386,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.754194+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:28:20.754194+0000","last_peered":"2026-02-24T08:28:20.754194+0000","last_clean":"2026-02-24T08:28:20.754194+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:28:20.754194+0000","last_undegraded":"2026-02-24T08:28:20.754194+0000","last_fullsized":"2026-02-24T08:28:20.754194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4376,"log_dups_size":0,"ondisk_log_size":4376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35848192,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4376,"num_write_kb":35008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"78'4288","reported_seq":4304,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.842146+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:28:20.842146+0000","last_peered":"2026-02-24T08:28:20.842146+0000","last_clean":"2026-02-24T08:28:20.842146+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:28:20.842146+0000","last_undegraded":"2026-02-24T08:28:20.842146+0000","last_fullsized":"2026-02-24T08:28:20.842146+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4288,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"78'4452","reported_seq":4468,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.750278+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:28:20.750278+0000","last_peered":"2026-02-24T08:28:20.750278+0000","last_clean":"2026-02-24T08:28:20.750278+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:28:20.750278+0000","last_undegraded":"2026-02-24T08:28:20.750278+0000","last_fullsized":"2026-02-24T08:28:20.750278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4452,"log_dups_size":0,"ondisk_log_size":4452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36470784,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4452,"num_write_kb":35616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"78'4256","reported_seq":4272,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.792983+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:28:20.792983+0000","last_peered":"2026-02-24T08:28:20.792983+0000","last_clean":"2026-02-24T08:28:20.792983+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:28:20.792983+0000","last_undegraded":"2026-02-24T08:28:20.792983+0000","last_fullsized":"2026-02-24T08:28:20.792983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34865152,"num_objects":532,"num_object_clones":0,"num_object_copies":1596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4256,"num_write_kb":34048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"78'4299","reported_seq":4314,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.843227+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:28:20.843227+0000","last_peered":"2026-02-24T08:28:20.843227+0000","last_clean":"2026-02-24T08:28:20.843227+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:28:20.843227+0000","last_undegraded":"2026-02-24T08:28:20.843227+0000","last_fullsized":"2026-02-24T08:28:20.843227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35217408,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4299,"num_write_kb":34392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"78'4313","reported_seq":4321,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.665677+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:28:20.665677+0000","last_peered":"2026-02-24T08:28:20.665677+0000","last_clean":"2026-02-24T08:28:20.665677+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:28:20.665677+0000","last_undegraded":"2026-02-24T08:28:20.665677+0000","last_fullsized":"2026-02-24T08:28:20.665677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35332096,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":540,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4313,"num_write_kb":34504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"78'4472","reported_seq":4486,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:20.853290+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:28:20.853290+0000","last_peered":"2026-02-24T08:28:20.853290+0000","last_clean":"2026-02-24T08:28:20.853290+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:28:20.853290+0000","last_undegraded":"2026-02-24T08:28:20.853290+0000","last_fullsized":"2026-02-24T08:28:20.853290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":4472,"log_dups_size":0,"ondisk_log_size":4472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36634624,"num_objects":559,"num_object_clones":0,"num_object_copies":1677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4472,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":200,"reported_epoch":78,"state":"active+clean","last_fresh":"2026-02-24T08:28:17.062893+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:28:17.062893+0000","last_peered":"2026-02-24T08:28:17.062893+0000","last_clean":"2026-02-24T08:28:17.062893+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:17.062893+0000","last_undegraded":"2026-02-24T08:28:17.062893+0000","last_fullsized":"2026-02-24T08:28:17.062893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":573014016,"num_objects":8748,"num_object_clones":0,"num_object_copies":26244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69948,"num_write_kb":559584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1716387840,"data_stored":1716387840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69948,"ondisk_log_size":69948,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3783,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247906,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1340632,"kb_used_data":326852,"kb_used_omap":14,"kb_used_meta":1013745,"kb_avail":732662568,"statfs":{"total":751619276800,"available":750246469632,"internally_reserved":0,"allocated":334696448,"data_stored":334207449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14371,"internal_metadata":1038075869},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,16,2,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444132,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1445856,"kb_used_data":412620,"kb_used_omap":17,"kb_used_meta":1033198,"kb_avail":732557344,"statfs":{"total":751619276800,"available":750138720256,"internally_reserved":0,"allocated":422522880,"data_stored":422033881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17490,"internal_metadata":1057995694},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1180452,"kb_used_data":477840,"kb_used_omap":13,"kb_used_meta":702578,"kb_avail":732822748,"statfs":{"total":751619276800,"available":750410493952,"internally_reserved":0,"allocated":489308160,"data_stored":488822713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13580,"internal_metadata":719440628},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,6,16,10,28,8,11],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705768,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1284800,"kb_used_data":395052,"kb_used_omap":13,"kb_used_meta":889714,"kb_avail":732718400,"statfs":{"total":751619276800,"available":750303641600,"internally_reserved":0,"allocated":404533248,"data_stored":404044249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13586,"internal_metadata":911067886},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3783,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":425164800,"data_stored":425164800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":504872960,"data_stored":504872960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":426917888,"data_stored":426917888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":359432192,"data_stored":359432192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:25.245 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:28:25.246 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 26 2026-02-24T08:28:25.288 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:25.285+0000 7f4f4365e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:25.288 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:25.286+0000 7f4f4365e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:25.289 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:25 trial105 ceph-mon[39442]: pgmap v294: 17 pgs: 17 active+clean; 547 MiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 40 MiB/s wr, 5.14k op/s 2026-02-24T08:28:25.307 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:25.307 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:25.321 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:25.321 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:25.336 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:25.337 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:25.353 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:25.354 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:25.405 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:25.614 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:25.609+0000 7fc305bf6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:25.614 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:25.609+0000 7fc305bf6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:25.769 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:28:25.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:28:25.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 13 127 101212 101085 60.7416 40.3438 0.0144954 0.0164374 2026-02-24T08:28:26.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:26 trial105 ceph-mon[39442]: from='client.15124 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:26.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3699301435' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:26.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2883200028' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T08:28:26.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 14 128 106466 106338 59.3341 41.0391 0.0410216 0.016828 2026-02-24T08:28:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:27 trial105 ceph-mon[39442]: pgmap v295: 17 pgs: 17 active+clean; 785 MiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.39k op/s 2026-02-24T08:28:27.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:27 trial105 ceph-mon[39442]: osdmap e80: 4 total, 4 up, 4 in 2026-02-24T08:28:27.470 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:27.623 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:27.751 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:27.747+0000 7fdd748cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:27.751 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:27.747+0000 7fdd748cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:27.766 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:27.767 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:27.784 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:27.785 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:27.802 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:27.803 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:27.817 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:27.817 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:27.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 15 128 111106 110978 57.795 36.25 0.00500119 0.017272 2026-02-24T08:28:28.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3981365713' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:28.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 16 128 115947 115819 56.5464 37.8203 0.0128265 0.0176552 2026-02-24T08:28:29.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:29 trial105 ceph-mon[39442]: pgmap v297: 17 pgs: 17 active+clean; 785 MiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 65 MiB/s wr, 8.30k op/s 2026-02-24T08:28:29.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:28:29.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 17 128 120720 120592 55.4136 37.2891 0.0104066 0.0180133 2026-02-24T08:28:29.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:28:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:28:29.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:28:29.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:28:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:28:29] "GET /metrics HTTP/1.1" 200 4217 "" "Prometheus/3.6.0" 2026-02-24T08:28:30.075 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:30.229 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:30.364 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:30.361+0000 7f84b7f52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:30.364 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:30.361+0000 7f84b7f52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:30.390 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:30.390 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:30.406 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:30.407 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:30.420 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:30.421 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:30.435 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:30.436 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:30.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4093068044' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:30.825 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:30.825 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:30.826 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:28:30.826 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:30.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 18 128 125169 125041 54.2659 34.7578 0.00945729 0.0184041 2026-02-24T08:28:30.981 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:31.116 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:31.113+0000 7f7375993640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:31.116 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:31.113+0000 7f7375993640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:31.277 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:31.277 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:31.326 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2026-02-24T08:28:30.754515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":847757856,"num_objects":12931,"num_object_clones":0,"num_object_copies":38793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12931,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":103549,"num_write_kb":829462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103513,"ondisk_log_size":103513,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6331632,"kb_used_data":2511768,"kb_used_omap":61,"kb_used_meta":3819714,"kb_avail":2929681168,"statfs":{"total":3006477107200,"available":2999993516032,"internally_reserved":0,"allocated":2572050432,"data_stored":2570058553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62928,"internal_metadata":3911387696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,8,24,18,41,8,11],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":274153472,"num_objects":4181,"num_object_clones":0,"num_object_copies":12543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33466,"num_write_kb":267728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.692145"},"pg_stats":[{"pgid":"6.f","version":"79'6242","reported_seq":6260,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.846783+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:28:25.846783+0000","last_peered":"2026-02-24T08:28:25.846783+0000","last_clean":"2026-02-24T08:28:25.846783+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:28:25.846783+0000","last_undegraded":"2026-02-24T08:28:25.846783+0000","last_fullsized":"2026-02-24T08:28:25.846783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6242,"log_dups_size":0,"ondisk_log_size":6242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51134464,"num_objects":781,"num_object_clones":0,"num_object_copies":2343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":781,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6242,"num_write_kb":49936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"79'6488","reported_seq":6505,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.755873+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:28:25.755873+0000","last_peered":"2026-02-24T08:28:25.755873+0000","last_clean":"2026-02-24T08:28:25.755873+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:28:25.755873+0000","last_undegraded":"2026-02-24T08:28:25.755873+0000","last_fullsized":"2026-02-24T08:28:25.755873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6488,"log_dups_size":0,"ondisk_log_size":6488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":811,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6488,"num_write_kb":51904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"79'6504","reported_seq":6522,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.734876+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:28:25.734876+0000","last_peered":"2026-02-24T08:28:25.734876+0000","last_clean":"2026-02-24T08:28:25.734876+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:28:25.734876+0000","last_undegraded":"2026-02-24T08:28:25.734876+0000","last_fullsized":"2026-02-24T08:28:25.734876+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6504,"log_dups_size":0,"ondisk_log_size":6504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53280768,"num_objects":813,"num_object_clones":0,"num_object_copies":2439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6504,"num_write_kb":52032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"79'6318","reported_seq":6336,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.851561+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:28:25.851561+0000","last_peered":"2026-02-24T08:28:25.851561+0000","last_clean":"2026-02-24T08:28:25.851561+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:28:25.851561+0000","last_undegraded":"2026-02-24T08:28:25.851561+0000","last_fullsized":"2026-02-24T08:28:25.851561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6318,"log_dups_size":0,"ondisk_log_size":6318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:10.954657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51757056,"num_objects":790,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":790,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6318,"num_write_kb":50544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"79'6056","reported_seq":6074,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.857994+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:28:25.857994+0000","last_peered":"2026-02-24T08:28:25.857994+0000","last_clean":"2026-02-24T08:28:25.857994+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:28:25.857994+0000","last_undegraded":"2026-02-24T08:28:25.857994+0000","last_fullsized":"2026-02-24T08:28:25.857994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6056,"log_dups_size":0,"ondisk_log_size":6056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49610752,"num_objects":757,"num_object_clones":0,"num_object_copies":2271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6056,"num_write_kb":48448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"79'6331","reported_seq":6343,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.752424+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:28:25.752424+0000","last_peered":"2026-02-24T08:28:25.752424+0000","last_clean":"2026-02-24T08:28:25.752424+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:28:25.752424+0000","last_undegraded":"2026-02-24T08:28:25.752424+0000","last_fullsized":"2026-02-24T08:28:25.752424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6331,"log_dups_size":0,"ondisk_log_size":6331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51863552,"num_objects":792,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6331,"num_write_kb":50648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"80'7824","reported_seq":7844,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T08:28:30.658897+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:28:30.658897+0000","last_peered":"2026-02-24T08:28:30.658897+0000","last_clean":"2026-02-24T08:28:30.658897+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:28:30.658897+0000","last_undegraded":"2026-02-24T08:28:30.658897+0000","last_fullsized":"2026-02-24T08:28:30.658897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":7824,"log_dups_size":0,"ondisk_log_size":7824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64094208,"num_objects":978,"num_object_clones":0,"num_object_copies":2934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":978,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7824,"num_write_kb":62592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"79'6448","reported_seq":6466,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.823912+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:28:25.823912+0000","last_peered":"2026-02-24T08:28:25.823912+0000","last_clean":"2026-02-24T08:28:25.823912+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:28:25.823912+0000","last_undegraded":"2026-02-24T08:28:25.823912+0000","last_fullsized":"2026-02-24T08:28:25.823912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6448,"log_dups_size":0,"ondisk_log_size":6448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52822016,"num_objects":806,"num_object_clones":0,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6448,"num_write_kb":51584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"79'6293","reported_seq":6309,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.860920+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:28:25.860920+0000","last_peered":"2026-02-24T08:28:25.860920+0000","last_clean":"2026-02-24T08:28:25.860920+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:28:25.860920+0000","last_undegraded":"2026-02-24T08:28:25.860920+0000","last_fullsized":"2026-02-24T08:28:25.860920+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6293,"log_dups_size":0,"ondisk_log_size":6293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51552256,"num_objects":787,"num_object_clones":0,"num_object_copies":2361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6293,"num_write_kb":50344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"79'6414","reported_seq":6422,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.756550+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:28:25.756550+0000","last_peered":"2026-02-24T08:28:25.756550+0000","last_clean":"2026-02-24T08:28:25.756550+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:28:25.756550+0000","last_undegraded":"2026-02-24T08:28:25.756550+0000","last_fullsized":"2026-02-24T08:28:25.756550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6414,"log_dups_size":0,"ondisk_log_size":6414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52543488,"num_objects":802,"num_object_clones":0,"num_object_copies":2406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6414,"num_write_kb":51312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"79'6072","reported_seq":6090,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.834902+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:28:25.834902+0000","last_peered":"2026-02-24T08:28:25.834902+0000","last_clean":"2026-02-24T08:28:25.834902+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:28:25.834902+0000","last_undegraded":"2026-02-24T08:28:25.834902+0000","last_fullsized":"2026-02-24T08:28:25.834902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6072,"log_dups_size":0,"ondisk_log_size":6072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49741824,"num_objects":759,"num_object_clones":0,"num_object_copies":2277,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":759,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6072,"num_write_kb":48576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"79'6472","reported_seq":6483,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.749253+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:28:25.749253+0000","last_peered":"2026-02-24T08:28:25.749253+0000","last_clean":"2026-02-24T08:28:25.749253+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:28:25.749253+0000","last_undegraded":"2026-02-24T08:28:25.749253+0000","last_fullsized":"2026-02-24T08:28:25.749253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6472,"log_dups_size":0,"ondisk_log_size":6472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53018624,"num_objects":809,"num_object_clones":0,"num_object_copies":2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":809,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6472,"num_write_kb":51776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"79'6296","reported_seq":6308,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.854165+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:28:25.854165+0000","last_peered":"2026-02-24T08:28:25.854165+0000","last_clean":"2026-02-24T08:28:25.854165+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:28:25.854165+0000","last_undegraded":"2026-02-24T08:28:25.854165+0000","last_fullsized":"2026-02-24T08:28:25.854165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6296,"log_dups_size":0,"ondisk_log_size":6296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51576832,"num_objects":787,"num_object_clones":0,"num_object_copies":2361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6296,"num_write_kb":50368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"79'5920","reported_seq":5938,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.801396+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:28:25.801396+0000","last_peered":"2026-02-24T08:28:25.801396+0000","last_clean":"2026-02-24T08:28:25.801396+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:28:25.801396+0000","last_undegraded":"2026-02-24T08:28:25.801396+0000","last_fullsized":"2026-02-24T08:28:25.801396+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":5920,"log_dups_size":0,"ondisk_log_size":5920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48496640,"num_objects":740,"num_object_clones":0,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":740,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5920,"num_write_kb":47360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"80'7536","reported_seq":7556,"reported_epoch":80,"state":"active+clean","last_fresh":"2026-02-24T08:28:30.659777+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:28:30.659777+0000","last_peered":"2026-02-24T08:28:30.659777+0000","last_clean":"2026-02-24T08:28:30.659777+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:28:30.659777+0000","last_undegraded":"2026-02-24T08:28:30.659777+0000","last_fullsized":"2026-02-24T08:28:30.659777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":7536,"log_dups_size":0,"ondisk_log_size":7536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61734912,"num_objects":942,"num_object_clones":0,"num_object_copies":2826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7536,"num_write_kb":60288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"79'6200","reported_seq":6212,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:25.856437+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:28:25.856437+0000","last_peered":"2026-02-24T08:28:25.856437+0000","last_clean":"2026-02-24T08:28:25.856437+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:28:25.856437+0000","last_undegraded":"2026-02-24T08:28:25.856437+0000","last_fullsized":"2026-02-24T08:28:25.856437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":6200,"log_dups_size":0,"ondisk_log_size":6200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50790400,"num_objects":775,"num_object_clones":0,"num_object_copies":2325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6200,"num_write_kb":49600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":203,"reported_epoch":79,"state":"active+clean","last_fresh":"2026-02-24T08:28:22.064988+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:28:22.064988+0000","last_peered":"2026-02-24T08:28:22.064988+0000","last_clean":"2026-02-24T08:28:22.064988+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:22.064988+0000","last_undegraded":"2026-02-24T08:28:22.064988+0000","last_fullsized":"2026-02-24T08:28:22.064988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":847167488,"num_objects":12929,"num_object_clones":0,"num_object_copies":38787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103414,"num_write_kb":827312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2615173120,"data_stored":2615173120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103414,"ondisk_log_size":103414,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3807,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247907,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1516620,"kb_used_data":484792,"kb_used_omap":14,"kb_used_meta":1031793,"kb_avail":732486580,"statfs":{"total":751619276800,"available":750066257920,"internally_reserved":0,"allocated":496427008,"data_stored":495930122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15012,"internal_metadata":1056556380},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444133,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1667724,"kb_used_data":598384,"kb_used_omap":17,"kb_used_meta":1069294,"kb_avail":732335476,"statfs":{"total":751619276800,"available":749911527424,"internally_reserved":0,"allocated":612745216,"data_stored":612248330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18142,"internal_metadata":1094957346},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1431704,"kb_used_data":692996,"kb_used_omap":13,"kb_used_meta":738674,"kb_avail":732571496,"statfs":{"total":751619276800,"available":750153211904,"internally_reserved":0,"allocated":709627904,"data_stored":709134570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14232,"internal_metadata":756402280},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,6,16,10,28,8,11],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705770,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1715584,"kb_used_data":735596,"kb_used_omap":15,"kb_used_meta":979952,"kb_avail":732287616,"statfs":{"total":751619276800,"available":749862518784,"internally_reserved":0,"allocated":753250304,"data_stored":752745531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15542,"internal_metadata":1003471690},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,8,8,13],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3807,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":763428864,"data_stored":763428864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":721051648,"data_stored":721051648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":616308736,"data_stored":616308736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":514383872,"data_stored":514383872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:31.328 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:28:31.329 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 161 2026-02-24T08:28:31.482 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:31.623 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:31.620+0000 7f4e667fc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:31.624 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:31.620+0000 7f4e667fc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:31.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:31 trial105 ceph-mon[39442]: pgmap v298: 17 pgs: 17 active+clean; 808 MiB data, 6.0 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.85k op/s 2026-02-24T08:28:31.779 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:28:31.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:28:31.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 19 127 129383 129256 53.1428 32.9297 0.0172078 0.018796 2026-02-24T08:28:32.489 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:32.647 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:32.676 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:32 trial105 ceph-mon[39442]: from='client.15134 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:32.676 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:32 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3091785761' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "161"} : dispatch 2026-02-24T08:28:32.676 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:32 trial105 ceph-mon[39442]: osdmap e81: 4 total, 4 up, 4 in 2026-02-24T08:28:32.788 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:32.785+0000 7f4bc551a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:32.789 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:32.786+0000 7f4bc551a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:32.802 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:32.803 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:32.818 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:32.818 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:32.834 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:32.834 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:32.851 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:32.851 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:32.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:28:32.924988+0000 min lat: 0.00104297 max lat: 0.1638 avg lat: 0.0191137 2026-02-24T08:28:32.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:28:32.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 20 128 133904 133776 52.2512 35.3125 0.00724062 0.0191137 2026-02-24T08:28:33.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:33 trial105 ceph-mon[39442]: pgmap v300: 17 pgs: 17 active+clean; 974 MiB data, 6.5 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.82k op/s 2026-02-24T08:28:33.690 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2383936870' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:33.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 21 128 138293 138165 51.3957 34.2891 0.0172697 0.0194368 2026-02-24T08:28:34.916 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:34.926 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 22 128 142555 142427 50.5728 33.2969 0.0093051 0.0197543 2026-02-24T08:28:35.067 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:35.380 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:35.375+0000 7fe58b55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:35.380 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:35.376+0000 7fe58b55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:35.395 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:35.395 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:35.409 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:35.410 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:35.423 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:35.423 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:35.437 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:35.437 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:35.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 23 128 145479 145351 49.3671 22.8438 0.016213 0.0202102 2026-02-24T08:28:36.079 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:35 trial105 ceph-mon[39442]: pgmap v301: 17 pgs: 17 active+clean; 974 MiB data, 6.5 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.01k op/s 2026-02-24T08:28:36.079 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3527391411' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:36.828 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:36.828 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:36.828 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:28:36.829 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:36.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 24 128 149234 149106 48.5324 29.3359 0.00782297 0.0205816 2026-02-24T08:28:36.989 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:37.126 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:37.123+0000 7f91ea3c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:37.126 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:37.123+0000 7f91ea3c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:37.285 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:37.286 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:37.339 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2026-02-24T08:28:37.065177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1189855776,"num_objects":18150,"num_object_clones":0,"num_object_copies":54450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18150,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":145309,"num_write_kb":1163542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145273,"ondisk_log_size":145273,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7497404,"kb_used_data":3460972,"kb_used_omap":65,"kb_used_meta":4036286,"kb_avail":2928515396,"statfs":{"total":3006477107200,"available":2998799765504,"internally_reserved":0,"allocated":3544035328,"data_stored":3541988240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67506,"internal_metadata":4133156942},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[20,9,8,18,26,15,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":366280704,"num_objects":5588,"num_object_clones":0,"num_object_copies":16764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44712,"num_write_kb":357696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.310926"},"pg_stats":[{"pgid":"6.f","version":"81'9304","reported_seq":9326,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.906468+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:28:35.906468+0000","last_peered":"2026-02-24T08:28:35.906468+0000","last_clean":"2026-02-24T08:28:35.906468+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:28:35.906468+0000","last_undegraded":"2026-02-24T08:28:35.906468+0000","last_fullsized":"2026-02-24T08:28:35.906468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9304,"log_dups_size":0,"ondisk_log_size":9304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76218368,"num_objects":1163,"num_object_clones":0,"num_object_copies":3489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1163,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9304,"num_write_kb":74432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"81'9136","reported_seq":9158,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.710219+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:28:35.710219+0000","last_peered":"2026-02-24T08:28:35.710219+0000","last_clean":"2026-02-24T08:28:35.710219+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:28:35.710219+0000","last_undegraded":"2026-02-24T08:28:35.710219+0000","last_fullsized":"2026-02-24T08:28:35.710219+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9136,"log_dups_size":0,"ondisk_log_size":9136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74842112,"num_objects":1142,"num_object_clones":0,"num_object_copies":3426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9136,"num_write_kb":73088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"81'9240","reported_seq":9259,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.758450+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:28:35.758450+0000","last_peered":"2026-02-24T08:28:35.758450+0000","last_clean":"2026-02-24T08:28:35.758450+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:28:35.758450+0000","last_undegraded":"2026-02-24T08:28:35.758450+0000","last_fullsized":"2026-02-24T08:28:35.758450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9240,"log_dups_size":0,"ondisk_log_size":9240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75694080,"num_objects":1155,"num_object_clones":0,"num_object_copies":3465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9240,"num_write_kb":73920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"81'9263","reported_seq":9285,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.904063+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:28:35.904063+0000","last_peered":"2026-02-24T08:28:35.904063+0000","last_clean":"2026-02-24T08:28:35.904063+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:28:35.904063+0000","last_undegraded":"2026-02-24T08:28:35.904063+0000","last_fullsized":"2026-02-24T08:28:35.904063+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9263,"log_dups_size":0,"ondisk_log_size":9263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:10.954657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75882496,"num_objects":1158,"num_object_clones":0,"num_object_copies":3474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9263,"num_write_kb":74104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"81'8605","reported_seq":8624,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.872413+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:28:35.872413+0000","last_peered":"2026-02-24T08:28:35.872413+0000","last_clean":"2026-02-24T08:28:35.872413+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:28:35.872413+0000","last_undegraded":"2026-02-24T08:28:35.872413+0000","last_fullsized":"2026-02-24T08:28:35.872413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":8605,"log_dups_size":0,"ondisk_log_size":8605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70492160,"num_objects":1076,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8605,"num_write_kb":68840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"81'9288","reported_seq":9310,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.746870+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:28:35.746870+0000","last_peered":"2026-02-24T08:28:35.746870+0000","last_clean":"2026-02-24T08:28:35.746870+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:28:35.746870+0000","last_undegraded":"2026-02-24T08:28:35.746870+0000","last_fullsized":"2026-02-24T08:28:35.746870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9288,"log_dups_size":0,"ondisk_log_size":9288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76087296,"num_objects":1161,"num_object_clones":0,"num_object_copies":3483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9288,"num_write_kb":74304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"81'8997","reported_seq":9019,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.709003+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:28:35.709003+0000","last_peered":"2026-02-24T08:28:35.709003+0000","last_clean":"2026-02-24T08:28:35.709003+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:28:35.709003+0000","last_undegraded":"2026-02-24T08:28:35.709003+0000","last_fullsized":"2026-02-24T08:28:35.709003+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":8997,"log_dups_size":0,"ondisk_log_size":8997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73703424,"num_objects":1125,"num_object_clones":0,"num_object_copies":3375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1125,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8997,"num_write_kb":71976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"81'9038","reported_seq":9051,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.863596+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:28:35.863596+0000","last_peered":"2026-02-24T08:28:35.863596+0000","last_clean":"2026-02-24T08:28:35.863596+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:28:35.863596+0000","last_undegraded":"2026-02-24T08:28:35.863596+0000","last_fullsized":"2026-02-24T08:28:35.863596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9038,"log_dups_size":0,"ondisk_log_size":9038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74039296,"num_objects":1130,"num_object_clones":0,"num_object_copies":3390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9038,"num_write_kb":72304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"81'9152","reported_seq":9174,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.858243+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:28:35.858243+0000","last_peered":"2026-02-24T08:28:35.858243+0000","last_clean":"2026-02-24T08:28:35.858243+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:28:35.858243+0000","last_undegraded":"2026-02-24T08:28:35.858243+0000","last_fullsized":"2026-02-24T08:28:35.858243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9152,"log_dups_size":0,"ondisk_log_size":9152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74973184,"num_objects":1144,"num_object_clones":0,"num_object_copies":3432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9152,"num_write_kb":73216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"81'9008","reported_seq":9030,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.739646+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:28:35.739646+0000","last_peered":"2026-02-24T08:28:35.739646+0000","last_clean":"2026-02-24T08:28:35.739646+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:28:35.739646+0000","last_undegraded":"2026-02-24T08:28:35.739646+0000","last_fullsized":"2026-02-24T08:28:35.739646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9008,"log_dups_size":0,"ondisk_log_size":9008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73793536,"num_objects":1126,"num_object_clones":0,"num_object_copies":3378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9008,"num_write_kb":72064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"81'9176","reported_seq":9198,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.868597+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:28:35.868597+0000","last_peered":"2026-02-24T08:28:35.868597+0000","last_clean":"2026-02-24T08:28:35.868597+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:28:35.868597+0000","last_undegraded":"2026-02-24T08:28:35.868597+0000","last_fullsized":"2026-02-24T08:28:35.868597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9176,"log_dups_size":0,"ondisk_log_size":9176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75169792,"num_objects":1147,"num_object_clones":0,"num_object_copies":3441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1147,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9176,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"81'9216","reported_seq":9233,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.762551+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:28:35.762551+0000","last_peered":"2026-02-24T08:28:35.762551+0000","last_clean":"2026-02-24T08:28:35.762551+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:28:35.762551+0000","last_undegraded":"2026-02-24T08:28:35.762551+0000","last_fullsized":"2026-02-24T08:28:35.762551+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9216,"log_dups_size":0,"ondisk_log_size":9216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":1152,"num_object_clones":0,"num_object_copies":3456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"81'9288","reported_seq":9310,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.843943+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:28:35.843943+0000","last_peered":"2026-02-24T08:28:35.843943+0000","last_clean":"2026-02-24T08:28:35.843943+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:28:35.843943+0000","last_undegraded":"2026-02-24T08:28:35.843943+0000","last_fullsized":"2026-02-24T08:28:35.843943+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9288,"log_dups_size":0,"ondisk_log_size":9288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76087296,"num_objects":1161,"num_object_clones":0,"num_object_copies":3483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9288,"num_write_kb":74304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"81'8760","reported_seq":8782,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.868790+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:28:35.868790+0000","last_peered":"2026-02-24T08:28:35.868790+0000","last_clean":"2026-02-24T08:28:35.868790+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:28:35.868790+0000","last_undegraded":"2026-02-24T08:28:35.868790+0000","last_fullsized":"2026-02-24T08:28:35.868790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":8760,"log_dups_size":0,"ondisk_log_size":8760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71761920,"num_objects":1095,"num_object_clones":0,"num_object_copies":3285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8760,"num_write_kb":70080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"81'8823","reported_seq":8841,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.727067+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:28:35.727067+0000","last_peered":"2026-02-24T08:28:35.727067+0000","last_clean":"2026-02-24T08:28:35.727067+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:28:35.727067+0000","last_undegraded":"2026-02-24T08:28:35.727067+0000","last_fullsized":"2026-02-24T08:28:35.727067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":8823,"log_dups_size":0,"ondisk_log_size":8823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72278016,"num_objects":1103,"num_object_clones":0,"num_object_copies":3309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8823,"num_write_kb":70584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"81'8880","reported_seq":8902,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:35.859092+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:28:35.859092+0000","last_peered":"2026-02-24T08:28:35.859092+0000","last_clean":"2026-02-24T08:28:35.859092+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:28:35.859092+0000","last_undegraded":"2026-02-24T08:28:35.859092+0000","last_fullsized":"2026-02-24T08:28:35.859092+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":8880,"log_dups_size":0,"ondisk_log_size":8880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72744960,"num_objects":1110,"num_object_clones":0,"num_object_copies":3330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8880,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":207,"reported_epoch":81,"state":"active+clean","last_fresh":"2026-02-24T08:28:32.069549+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:28:32.069549+0000","last_peered":"2026-02-24T08:28:32.069549+0000","last_clean":"2026-02-24T08:28:32.069549+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:32.069549+0000","last_undegraded":"2026-02-24T08:28:32.069549+0000","last_fullsized":"2026-02-24T08:28:32.069549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1189265408,"num_objects":18148,"num_object_clones":0,"num_object_copies":54444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145174,"num_write_kb":1161392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3566936064,"data_stored":3566936064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145174,"ondisk_log_size":145174,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3855,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247909,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1780564,"kb_used_data":712640,"kb_used_omap":15,"kb_used_meta":1067888,"kb_avail":732222636,"statfs":{"total":751619276800,"available":749795979264,"internally_reserved":0,"allocated":729743360,"data_stored":729230700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16330,"internal_metadata":1093517366},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,0,6],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444135,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1995460,"kb_used_data":871984,"kb_used_omap":18,"kb_used_meta":1123437,"kb_avail":732007740,"statfs":{"total":751619276800,"available":749575925760,"internally_reserved":0,"allocated":892911616,"data_stored":892398956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19446,"internal_metadata":1150399498},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[16,4,0,15,11,15],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1839864,"kb_used_data":1010916,"kb_used_omap":15,"kb_used_meta":828912,"kb_avail":732163336,"statfs":{"total":751619276800,"available":749735256064,"internally_reserved":0,"allocated":1035177984,"data_stored":1034668876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15536,"internal_metadata":848806736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705771,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1881516,"kb_used_data":865432,"kb_used_omap":15,"kb_used_meta":1016048,"kb_avail":732121684,"statfs":{"total":751619276800,"available":749692604416,"internally_reserved":0,"allocated":886202368,"data_stored":885689708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16194,"internal_metadata":1040433342},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,8,3,9,0,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3855,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":892436480,"data_stored":892436480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1040515072,"data_stored":1040515072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":893976576,"data_stored":893976576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":740007936,"data_stored":740007936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:37.341 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:28:37.341 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 171 2026-02-24T08:28:37.501 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:37.642 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:37.639+0000 7fafbfd16640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:37.642 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:37.639+0000 7fafbfd16640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:37.798 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:28:37.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:28:37.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 25 128 152718 152590 47.6798 27.2188 0.0202528 0.0209485 2026-02-24T08:28:37.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:37 trial105 ceph-mon[39442]: pgmap v302: 17 pgs: 17 active+clean; 1.1 GiB data, 7.2 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.61k op/s 2026-02-24T08:28:37.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:28:37.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:37 trial105 ceph-mon[39442]: osdmap e82: 4 total, 4 up, 4 in 2026-02-24T08:28:37.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:28:37.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:28:37.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:28:37.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:28:37.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1532089637' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "171"} : dispatch 2026-02-24T08:28:38.105 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:38.260 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:38.395 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:38.392+0000 7f19a30bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:38.395 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:38.392+0000 7f19a30bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:38.415 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:38.415 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:38.434 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:38.435 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:38.450 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:38.451 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:38.468 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:38.468 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:38.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 26 128 156386 156258 46.9481 28.6562 0.0392261 0.02128 2026-02-24T08:28:39.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:38 trial105 ceph-mon[39442]: from='client.15142 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:39.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:38 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:28:39.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:38 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:28:39.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:38 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/82932420' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:39.813 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:28:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:28:39] "GET /metrics HTTP/1.1" 200 4217 "" "Prometheus/3.6.0" 2026-02-24T08:28:39.840 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:28:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:28:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:28:39.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 27 128 160094 159966 46.2821 28.9688 0.0461027 0.0215806 2026-02-24T08:28:40.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:39 trial105 ceph-mon[39442]: pgmap v304: 17 pgs: 17 active+clean; 1.1 GiB data, 7.2 GiB used, 2.7 TiB / 2.7 TiB avail; 41 MiB/s wr, 5.22k op/s 2026-02-24T08:28:40.519 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:40.667 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:40.793 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:40.790+0000 7fd479a41640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:40.794 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:40.790+0000 7fd479a41640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:40.812 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:40.813 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:40.827 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:40.828 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:40.842 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:40.842 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:40.856 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:40.857 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:40.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 28 128 163514 163386 45.5833 26.7188 0.0226435 0.0219142 2026-02-24T08:28:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2351273976' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:41.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 29 128 167059 166931 44.9664 27.6953 0.0211689 0.0222181 2026-02-24T08:28:42.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:41 trial105 ceph-mon[39442]: pgmap v305: 17 pgs: 17 active+clean; 1.1 GiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.67k op/s 2026-02-24T08:28:42.843 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:42.844 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:42.844 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-24T08:28:42.844 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:42.912 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:42.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 30 128 170662 170534 44.4058 28.1484 0.0278925 0.0224967 2026-02-24T08:28:43.005 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:43.066 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:43.142 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:43.136+0000 7f6b1983e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:43.142 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:43.136+0000 7f6b1983e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:43.192 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:43.189+0000 7f7f29f40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:43.193 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:43.190+0000 7f7f29f40640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:43.210 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:43.210 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:43.225 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:43.225 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:43.240 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:43.240 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:43.256 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:43.256 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:43.295 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:43.296 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:43.345 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2026-02-24T08:28:42.756167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1337492000,"num_objects":20403,"num_object_clones":0,"num_object_copies":61209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20403,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":163331,"num_write_kb":1307718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160395,"ondisk_log_size":160395,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7994956,"kb_used_data":3886332,"kb_used_omap":69,"kb_used_meta":4108474,"kb_avail":2928017844,"statfs":{"total":3006477107200,"available":2998290272256,"internally_reserved":0,"allocated":3979603968,"data_stored":3977525332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70768,"internal_metadata":4207078288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,0,8,7,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":316571648,"num_objects":4830,"num_object_clones":0,"num_object_copies":14490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4830,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38644,"num_write_kb":309152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001389"},"pg_stats":[{"pgid":"6.f","version":"82'10496","reported_seq":10520,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.904836+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:28:40.904836+0000","last_peered":"2026-02-24T08:28:40.904836+0000","last_clean":"2026-02-24T08:28:40.904836+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:28:40.904836+0000","last_undegraded":"2026-02-24T08:28:40.904836+0000","last_fullsized":"2026-02-24T08:28:40.904836+0000","mapping_epoch":75,"log_start":"77'400","ondisk_log_start":"77'400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":1312,"num_object_clones":0,"num_object_copies":3936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10496,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'10104","reported_seq":10128,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.716561+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:28:40.716561+0000","last_peered":"2026-02-24T08:28:40.716561+0000","last_clean":"2026-02-24T08:28:40.716561+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:28:40.716561+0000","last_undegraded":"2026-02-24T08:28:40.716561+0000","last_fullsized":"2026-02-24T08:28:40.716561+0000","mapping_epoch":75,"log_start":"77'100","ondisk_log_start":"77'100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82771968,"num_objects":1263,"num_object_clones":0,"num_object_copies":3789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10104,"num_write_kb":80832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'10269","reported_seq":10290,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.763390+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:28:40.763390+0000","last_peered":"2026-02-24T08:28:40.763390+0000","last_clean":"2026-02-24T08:28:40.763390+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:28:40.763390+0000","last_undegraded":"2026-02-24T08:28:40.763390+0000","last_fullsized":"2026-02-24T08:28:40.763390+0000","mapping_epoch":75,"log_start":"77'200","ondisk_log_start":"77'200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84123648,"num_objects":1284,"num_object_clones":0,"num_object_copies":3852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10269,"num_write_kb":82152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'10328","reported_seq":10352,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.890839+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:28:40.890839+0000","last_peered":"2026-02-24T08:28:40.890839+0000","last_clean":"2026-02-24T08:28:40.890839+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:28:40.890839+0000","last_undegraded":"2026-02-24T08:28:40.890839+0000","last_fullsized":"2026-02-24T08:28:40.890839+0000","mapping_epoch":75,"log_start":"77'300","ondisk_log_start":"77'300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:10.954657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84606976,"num_objects":1291,"num_object_clones":0,"num_object_copies":3873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1291,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10328,"num_write_kb":82624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'9695","reported_seq":9712,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.940601+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:28:40.940601+0000","last_peered":"2026-02-24T08:28:40.940601+0000","last_clean":"2026-02-24T08:28:40.940601+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:28:40.940601+0000","last_undegraded":"2026-02-24T08:28:40.940601+0000","last_fullsized":"2026-02-24T08:28:40.940601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9695,"log_dups_size":0,"ondisk_log_size":9695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79421440,"num_objects":1212,"num_object_clones":0,"num_object_copies":3636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9695,"num_write_kb":77560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'10376","reported_seq":10400,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.710562+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:28:40.710562+0000","last_peered":"2026-02-24T08:28:40.710562+0000","last_clean":"2026-02-24T08:28:40.710562+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:28:40.710562+0000","last_undegraded":"2026-02-24T08:28:40.710562+0000","last_fullsized":"2026-02-24T08:28:40.710562+0000","mapping_epoch":75,"log_start":"77'300","ondisk_log_start":"77'300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85000192,"num_objects":1297,"num_object_clones":0,"num_object_copies":3891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10376,"num_write_kb":83008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'10280","reported_seq":10304,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.725916+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:28:40.725916+0000","last_peered":"2026-02-24T08:28:40.725916+0000","last_clean":"2026-02-24T08:28:40.725916+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:28:40.725916+0000","last_undegraded":"2026-02-24T08:28:40.725916+0000","last_fullsized":"2026-02-24T08:28:40.725916+0000","mapping_epoch":75,"log_start":"77'200","ondisk_log_start":"77'200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84213760,"num_objects":1285,"num_object_clones":0,"num_object_copies":3855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10280,"num_write_kb":82240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'10072","reported_seq":10087,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.883070+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:28:40.883070+0000","last_peered":"2026-02-24T08:28:40.883070+0000","last_clean":"2026-02-24T08:28:40.883070+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:28:40.883070+0000","last_undegraded":"2026-02-24T08:28:40.883070+0000","last_fullsized":"2026-02-24T08:28:40.883070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82509824,"num_objects":1259,"num_object_clones":0,"num_object_copies":3777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1259,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10072,"num_write_kb":80576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'10384","reported_seq":10408,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.923145+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:28:40.923145+0000","last_peered":"2026-02-24T08:28:40.923145+0000","last_clean":"2026-02-24T08:28:40.923145+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:28:40.923145+0000","last_undegraded":"2026-02-24T08:28:40.923145+0000","last_fullsized":"2026-02-24T08:28:40.923145+0000","mapping_epoch":75,"log_start":"77'300","ondisk_log_start":"77'300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85065728,"num_objects":1298,"num_object_clones":0,"num_object_copies":3894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1298,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10384,"num_write_kb":83072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'10288","reported_seq":10312,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.760448+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:28:40.760448+0000","last_peered":"2026-02-24T08:28:40.760448+0000","last_clean":"2026-02-24T08:28:40.760448+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:28:40.760448+0000","last_undegraded":"2026-02-24T08:28:40.760448+0000","last_fullsized":"2026-02-24T08:28:40.760448+0000","mapping_epoch":75,"log_start":"77'200","ondisk_log_start":"77'200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84279296,"num_objects":1286,"num_object_clones":0,"num_object_copies":3858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10288,"num_write_kb":82304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'10367","reported_seq":10386,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.936423+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:28:40.936423+0000","last_peered":"2026-02-24T08:28:40.936423+0000","last_clean":"2026-02-24T08:28:40.936423+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:28:40.936423+0000","last_undegraded":"2026-02-24T08:28:40.936423+0000","last_fullsized":"2026-02-24T08:28:40.936423+0000","mapping_epoch":75,"log_start":"77'300","ondisk_log_start":"77'300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84926464,"num_objects":1296,"num_object_clones":0,"num_object_copies":3888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1296,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10367,"num_write_kb":82936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'10168","reported_seq":10192,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.757899+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:28:40.757899+0000","last_peered":"2026-02-24T08:28:40.757899+0000","last_clean":"2026-02-24T08:28:40.757899+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:28:40.757899+0000","last_undegraded":"2026-02-24T08:28:40.757899+0000","last_fullsized":"2026-02-24T08:28:40.757899+0000","mapping_epoch":75,"log_start":"77'100","ondisk_log_start":"77'100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83296256,"num_objects":1271,"num_object_clones":0,"num_object_copies":3813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1271,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10168,"num_write_kb":81344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'10504","reported_seq":10528,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.845572+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:28:40.845572+0000","last_peered":"2026-02-24T08:28:40.845572+0000","last_clean":"2026-02-24T08:28:40.845572+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:28:40.845572+0000","last_undegraded":"2026-02-24T08:28:40.845572+0000","last_fullsized":"2026-02-24T08:28:40.845572+0000","mapping_epoch":75,"log_start":"77'500","ondisk_log_start":"77'500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86048768,"num_objects":1313,"num_object_clones":0,"num_object_copies":3939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10504,"num_write_kb":84032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'9673","reported_seq":9697,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.933612+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:28:40.933612+0000","last_peered":"2026-02-24T08:28:40.933612+0000","last_clean":"2026-02-24T08:28:40.933612+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:28:40.933612+0000","last_undegraded":"2026-02-24T08:28:40.933612+0000","last_fullsized":"2026-02-24T08:28:40.933612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":9673,"log_dups_size":0,"ondisk_log_size":9673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79241216,"num_objects":1210,"num_object_clones":0,"num_object_copies":3630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9673,"num_write_kb":77384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'10096","reported_seq":10120,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.704783+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:28:40.704783+0000","last_peered":"2026-02-24T08:28:40.704783+0000","last_clean":"2026-02-24T08:28:40.704783+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:28:40.704783+0000","last_undegraded":"2026-02-24T08:28:40.704783+0000","last_fullsized":"2026-02-24T08:28:40.704783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82706432,"num_objects":1262,"num_object_clones":0,"num_object_copies":3786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10096,"num_write_kb":80768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'10096","reported_seq":10120,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:40.876822+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:28:40.876822+0000","last_peered":"2026-02-24T08:28:40.876822+0000","last_clean":"2026-02-24T08:28:40.876822+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:28:40.876822+0000","last_undegraded":"2026-02-24T08:28:40.876822+0000","last_fullsized":"2026-02-24T08:28:40.876822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82706432,"num_objects":1262,"num_object_clones":0,"num_object_copies":3786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10096,"num_write_kb":80768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":209,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:37.070479+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:28:37.070479+0000","last_peered":"2026-02-24T08:28:37.070479+0000","last_clean":"2026-02-24T08:28:37.070479+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:37.070479+0000","last_undegraded":"2026-02-24T08:28:37.070479+0000","last_fullsized":"2026-02-24T08:28:37.070479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1336901632,"num_objects":20401,"num_object_clones":0,"num_object_copies":61203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20401,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163196,"num_write_kb":1305568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4009508864,"data_stored":4009508864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160296,"ondisk_log_size":160296,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3875,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247910,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1887632,"kb_used_data":801660,"kb_used_omap":16,"kb_used_meta":1085935,"kb_avail":732115568,"statfs":{"total":751619276800,"available":749686341632,"internally_reserved":0,"allocated":820899840,"data_stored":820379293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16984,"internal_metadata":1111997864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444136,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2121472,"kb_used_data":979948,"kb_used_omap":19,"kb_used_meta":1141484,"kb_avail":731881728,"statfs":{"total":751619276800,"available":749446889472,"internally_reserved":0,"allocated":1003466752,"data_stored":1002946205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20098,"internal_metadata":1168879998},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,0,8,7,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1979132,"kb_used_data":1132136,"kb_used_omap":16,"kb_used_meta":846959,"kb_avail":732024068,"statfs":{"total":751619276800,"available":749592645632,"internally_reserved":0,"allocated":1159307264,"data_stored":1158790269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":867286584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705772,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2006720,"kb_used_data":972588,"kb_used_omap":16,"kb_used_meta":1034095,"kb_avail":731996480,"statfs":{"total":751619276800,"available":749564395520,"internally_reserved":0,"allocated":995930112,"data_stored":995409565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16846,"internal_metadata":1058913842},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3875,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1003347968,"data_stored":1003347968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1168637952,"data_stored":1168637952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1004363776,"data_stored":1004363776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":833159168,"data_stored":833159168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:43.347 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 26 2026-02-24T08:28:43.496 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:43.635 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:43.630+0000 7fc6f27f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:43.635 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:43.631+0000 7fc6f27f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:43.791 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:28:43.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:28:43.927 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 31 128 173987 173859 43.8112 25.9766 0.0769106 0.0228093 2026-02-24T08:28:43.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:43 trial105 ceph-mon[39442]: pgmap v306: 17 pgs: 17 active+clean; 1.2 GiB data, 7.6 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.86k op/s 2026-02-24T08:28:43.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3863853577' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:43.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3439510288' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "26"} : dispatch 2026-02-24T08:28:44.928 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 32 127 177551 177424 43.3124 27.8516 0.0473314 0.0230682 2026-02-24T08:28:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:44 trial105 ceph-mon[39442]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:28:45.301 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:45.454 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:45.580 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:45.577+0000 7fc703758640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:45.580 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:45.577+0000 7fc703758640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:45.596 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:45.597 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:45.613 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:45.613 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:45.628 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:45.629 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:45.644 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:45.644 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:45.928 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 33 128 181087 180959 42.8367 27.6172 0.0252659 0.0233244 2026-02-24T08:28:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:45 trial105 ceph-mon[39442]: pgmap v307: 17 pgs: 17 active+clean; 1.2 GiB data, 7.6 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.86k op/s 2026-02-24T08:28:45.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3075236802' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:46.928 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 34 128 184683 184555 42.4031 28.0938 0.0279638 0.0235589 2026-02-24T08:28:47.712 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:47.865 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:47.929 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 35 128 188161 188033 41.966 27.1719 0.0547069 0.023808 2026-02-24T08:28:47.992 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:47 trial105 ceph-mon[39442]: pgmap v308: 17 pgs: 17 active+clean; 1.4 GiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.57k op/s 2026-02-24T08:28:48.140 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:48.137+0000 7ff97fccf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:48.140 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:48.137+0000 7ff97fccf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:48.156 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:48.156 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:48.173 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:48.174 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:48.188 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:48.188 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:48.201 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:48.201 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:48.838 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:48.838 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:48.839 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:28:48.839 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:48.929 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 36 128 191497 191369 41.5242 26.0625 0.0879054 0.0240634 2026-02-24T08:28:48.987 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:49.103 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:48 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3976203632' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:49.106 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:49.104+0000 7f7c3b3f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:49.108 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:49.105+0000 7f7c3b3f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:49.247 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:49.248 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:49.304 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2026-02-24T08:28:48.757054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1482072608,"num_objects":22609,"num_object_clones":0,"num_object_copies":67827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22609,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":180980,"num_write_kb":1448910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160944,"ondisk_log_size":160944,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8522116,"kb_used_data":4305204,"kb_used_omap":69,"kb_used_meta":4216762,"kb_avail":2927490684,"statfs":{"total":3006477107200,"available":2997750460416,"internally_reserved":0,"allocated":4408528896,"data_stored":4406450260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70768,"internal_metadata":4317965200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,10,3,11,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":292216832,"num_objects":4459,"num_object_clones":0,"num_object_copies":13377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4459,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35671,"num_write_kb":285368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.691877"},"pg_stats":[{"pgid":"6.f","version":"82'11608","reported_seq":11632,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.944361+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:28:45.944361+0000","last_peered":"2026-02-24T08:28:45.944361+0000","last_clean":"2026-02-24T08:28:45.944361+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:28:45.944361+0000","last_undegraded":"2026-02-24T08:28:45.944361+0000","last_fullsized":"2026-02-24T08:28:45.944361+0000","mapping_epoch":75,"log_start":"77'1600","ondisk_log_start":"77'1600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95092736,"num_objects":1451,"num_object_clones":0,"num_object_copies":4353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1451,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11608,"num_write_kb":92864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'11168","reported_seq":11192,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.725835+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:28:45.725835+0000","last_peered":"2026-02-24T08:28:45.725835+0000","last_clean":"2026-02-24T08:28:45.725835+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:28:45.725835+0000","last_undegraded":"2026-02-24T08:28:45.725835+0000","last_fullsized":"2026-02-24T08:28:45.725835+0000","mapping_epoch":75,"log_start":"77'1100","ondisk_log_start":"77'1100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91488256,"num_objects":1396,"num_object_clones":0,"num_object_copies":4188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11168,"num_write_kb":89344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'11248","reported_seq":11272,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.770285+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:28:45.770285+0000","last_peered":"2026-02-24T08:28:45.770285+0000","last_clean":"2026-02-24T08:28:45.770285+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:28:45.770285+0000","last_undegraded":"2026-02-24T08:28:45.770285+0000","last_fullsized":"2026-02-24T08:28:45.770285+0000","mapping_epoch":75,"log_start":"77'1200","ondisk_log_start":"77'1200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92143616,"num_objects":1406,"num_object_clones":0,"num_object_copies":4218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1406,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11248,"num_write_kb":89984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'11470","reported_seq":11492,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.944020+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:28:45.944020+0000","last_peered":"2026-02-24T08:28:45.944020+0000","last_clean":"2026-02-24T08:28:45.944020+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:28:45.944020+0000","last_undegraded":"2026-02-24T08:28:45.944020+0000","last_fullsized":"2026-02-24T08:28:45.944020+0000","mapping_epoch":75,"log_start":"77'1400","ondisk_log_start":"77'1400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:10.954657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93962240,"num_objects":1434,"num_object_clones":0,"num_object_copies":4302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11470,"num_write_kb":91760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'10832","reported_seq":10852,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.948118+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:28:45.948118+0000","last_peered":"2026-02-24T08:28:45.948118+0000","last_clean":"2026-02-24T08:28:45.948118+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:28:45.948118+0000","last_undegraded":"2026-02-24T08:28:45.948118+0000","last_fullsized":"2026-02-24T08:28:45.948118+0000","mapping_epoch":75,"log_start":"77'800","ondisk_log_start":"77'800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88735744,"num_objects":1354,"num_object_clones":0,"num_object_copies":4062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10832,"num_write_kb":86656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'11520","reported_seq":11544,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.769378+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:28:45.769378+0000","last_peered":"2026-02-24T08:28:45.769378+0000","last_clean":"2026-02-24T08:28:45.769378+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:28:45.769378+0000","last_undegraded":"2026-02-24T08:28:45.769378+0000","last_fullsized":"2026-02-24T08:28:45.769378+0000","mapping_epoch":75,"log_start":"77'1500","ondisk_log_start":"77'1500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":1440,"num_object_clones":0,"num_object_copies":4320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1440,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11520,"num_write_kb":92160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'11398","reported_seq":11421,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.750552+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:28:45.750552+0000","last_peered":"2026-02-24T08:28:45.750552+0000","last_clean":"2026-02-24T08:28:45.750552+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:28:45.750552+0000","last_undegraded":"2026-02-24T08:28:45.750552+0000","last_fullsized":"2026-02-24T08:28:45.750552+0000","mapping_epoch":75,"log_start":"77'1300","ondisk_log_start":"77'1300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93372416,"num_objects":1425,"num_object_clones":0,"num_object_copies":4275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11398,"num_write_kb":91184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'11357","reported_seq":11380,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.889491+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:28:45.889491+0000","last_peered":"2026-02-24T08:28:45.889491+0000","last_clean":"2026-02-24T08:28:45.889491+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:28:45.889491+0000","last_undegraded":"2026-02-24T08:28:45.889491+0000","last_fullsized":"2026-02-24T08:28:45.889491+0000","mapping_epoch":75,"log_start":"77'1300","ondisk_log_start":"77'1300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93036544,"num_objects":1420,"num_object_clones":0,"num_object_copies":4260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11357,"num_write_kb":90856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'11496","reported_seq":11520,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.848597+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:28:45.848597+0000","last_peered":"2026-02-24T08:28:45.848597+0000","last_clean":"2026-02-24T08:28:45.848597+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:28:45.848597+0000","last_undegraded":"2026-02-24T08:28:45.848597+0000","last_fullsized":"2026-02-24T08:28:45.848597+0000","mapping_epoch":75,"log_start":"77'1400","ondisk_log_start":"77'1400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94175232,"num_objects":1437,"num_object_clones":0,"num_object_copies":4311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1437,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11496,"num_write_kb":91968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'11431","reported_seq":11451,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.773610+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:28:45.773610+0000","last_peered":"2026-02-24T08:28:45.773610+0000","last_clean":"2026-02-24T08:28:45.773610+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:28:45.773610+0000","last_undegraded":"2026-02-24T08:28:45.773610+0000","last_fullsized":"2026-02-24T08:28:45.773610+0000","mapping_epoch":75,"log_start":"77'1400","ondisk_log_start":"77'1400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93642752,"num_objects":1429,"num_object_clones":0,"num_object_copies":4287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11431,"num_write_kb":91448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'11480","reported_seq":11504,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.877599+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:28:45.877599+0000","last_peered":"2026-02-24T08:28:45.877599+0000","last_clean":"2026-02-24T08:28:45.877599+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:28:45.877599+0000","last_undegraded":"2026-02-24T08:28:45.877599+0000","last_fullsized":"2026-02-24T08:28:45.877599+0000","mapping_epoch":75,"log_start":"77'1400","ondisk_log_start":"77'1400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94044160,"num_objects":1435,"num_object_clones":0,"num_object_copies":4305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1435,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11480,"num_write_kb":91840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'11184","reported_seq":11204,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.770267+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:28:45.770267+0000","last_peered":"2026-02-24T08:28:45.770267+0000","last_clean":"2026-02-24T08:28:45.770267+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:28:45.770267+0000","last_undegraded":"2026-02-24T08:28:45.770267+0000","last_fullsized":"2026-02-24T08:28:45.770267+0000","mapping_epoch":75,"log_start":"77'1100","ondisk_log_start":"77'1100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91619328,"num_objects":1398,"num_object_clones":0,"num_object_copies":4194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11184,"num_write_kb":89472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'11544","reported_seq":11568,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.817038+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:28:45.817038+0000","last_peered":"2026-02-24T08:28:45.817038+0000","last_clean":"2026-02-24T08:28:45.817038+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:28:45.817038+0000","last_undegraded":"2026-02-24T08:28:45.817038+0000","last_fullsized":"2026-02-24T08:28:45.817038+0000","mapping_epoch":75,"log_start":"77'1500","ondisk_log_start":"77'1500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94568448,"num_objects":1443,"num_object_clones":0,"num_object_copies":4329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1443,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11544,"num_write_kb":92352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'10864","reported_seq":10888,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.942526+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:28:45.942526+0000","last_peered":"2026-02-24T08:28:45.942526+0000","last_clean":"2026-02-24T08:28:45.942526+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:28:45.942526+0000","last_undegraded":"2026-02-24T08:28:45.942526+0000","last_fullsized":"2026-02-24T08:28:45.942526+0000","mapping_epoch":75,"log_start":"77'800","ondisk_log_start":"77'800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88997888,"num_objects":1358,"num_object_clones":0,"num_object_copies":4074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10864,"num_write_kb":86912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'11101","reported_seq":11122,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.760699+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:28:45.760699+0000","last_peered":"2026-02-24T08:28:45.760699+0000","last_clean":"2026-02-24T08:28:45.760699+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:28:45.760699+0000","last_undegraded":"2026-02-24T08:28:45.760699+0000","last_fullsized":"2026-02-24T08:28:45.760699+0000","mapping_epoch":75,"log_start":"77'1100","ondisk_log_start":"77'1100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90939392,"num_objects":1388,"num_object_clones":0,"num_object_copies":4164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1388,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11101,"num_write_kb":88808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'11144","reported_seq":11168,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:45.852069+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:28:45.852069+0000","last_peered":"2026-02-24T08:28:45.852069+0000","last_clean":"2026-02-24T08:28:45.852069+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:28:45.852069+0000","last_undegraded":"2026-02-24T08:28:45.852069+0000","last_fullsized":"2026-02-24T08:28:45.852069+0000","mapping_epoch":75,"log_start":"77'1100","ondisk_log_start":"77'1100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91291648,"num_objects":1393,"num_object_clones":0,"num_object_copies":4179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11144,"num_write_kb":89152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":209,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:37.070479+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:28:37.070479+0000","last_peered":"2026-02-24T08:28:37.070479+0000","last_clean":"2026-02-24T08:28:37.070479+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:37.070479+0000","last_undegraded":"2026-02-24T08:28:37.070479+0000","last_fullsized":"2026-02-24T08:28:37.070479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1481482240,"num_objects":22607,"num_object_clones":0,"num_object_copies":67821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22607,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180845,"num_write_kb":1446760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4441817088,"data_stored":4441817088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160845,"ondisk_log_size":160845,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3875,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247911,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1991480,"kb_used_data":887460,"kb_used_omap":16,"kb_used_meta":1103983,"kb_avail":732011720,"statfs":{"total":751619276800,"available":749580001280,"internally_reserved":0,"allocated":908759040,"data_stored":908238493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16984,"internal_metadata":1130479016},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444137,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2277392,"kb_used_data":1081724,"kb_used_omap":19,"kb_used_meta":1195628,"kb_avail":731725808,"statfs":{"total":751619276800,"available":749287227392,"internally_reserved":0,"allocated":1107685376,"data_stored":1107164829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20098,"internal_metadata":1224323454},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,10,3,11,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2120100,"kb_used_data":1255056,"kb_used_omap":16,"kb_used_meta":865007,"kb_avail":731883100,"statfs":{"total":751619276800,"available":749448294400,"internally_reserved":0,"allocated":1285177344,"data_stored":1284660349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":885767736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2133144,"kb_used_data":1080964,"kb_used_omap":16,"kb_used_meta":1052143,"kb_avail":731870056,"statfs":{"total":751619276800,"available":749434937344,"internally_reserved":0,"allocated":1106907136,"data_stored":1106386589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16846,"internal_metadata":1077394994},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3875,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1112285184,"data_stored":1112285184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1294819328,"data_stored":1294819328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1110122496,"data_stored":1110122496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":924590080,"data_stored":924590080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:49.306 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:28:49.306 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 181 2026-02-24T08:28:49.464 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:49.590 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:49.586+0000 7f0c05492640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:49.590 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:49.587+0000 7f0c05492640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:49.741 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:28:49.741 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:28:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:28:49] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-24T08:28:49.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:28:49.929 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 37 128 194829 194701 41.1054 26.0312 0.0376373 0.0243116 2026-02-24T08:28:49.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:28:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:28:49.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:28:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:49 trial105 ceph-mon[39442]: pgmap v309: 17 pgs: 17 active+clean; 1.4 GiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.05k op/s 2026-02-24T08:28:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2953934664' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "181"} : dispatch 2026-02-24T08:28:50.244 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:50.400 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:50.546 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:50.543+0000 7f66a7e1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:50.547 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:50.543+0000 7f66a7e1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:50.560 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:50.561 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:50.577 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:50.577 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:50.591 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:50.591 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:50.604 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:50.605 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:50.929 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 38 128 198309 198181 40.7391 27.1875 0.0586697 0.0245287 2026-02-24T08:28:51.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:50 trial105 ceph-mon[39442]: from='client.15160 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:51.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/382956837' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:51.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 39 128 201765 201637 40.3868 27 0.0265715 0.0247433 2026-02-24T08:28:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:51 trial105 ceph-mon[39442]: pgmap v310: 17 pgs: 17 active+clean; 1.4 GiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.97k op/s 2026-02-24T08:28:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:51 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:28:52.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:51 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:28:52.655 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:52.803 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:52.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:28:52.928155+0000 min lat: 0.00104297 max lat: 0.207228 avg lat: 0.0249554 2026-02-24T08:28:52.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:28:52.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 40 128 205087 204959 40.0259 25.9531 0.0841025 0.0249554 2026-02-24T08:28:53.173 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:53.169+0000 7f2373d48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:53.173 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:53.169+0000 7f2373d48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:53.190 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:53.191 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:53.205 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:53.205 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:53.217 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:53.218 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:53.232 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:53.232 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:53.233 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:53 trial105 ceph-mon[39442]: pgmap v311: 17 pgs: 17 active+clean; 1.5 GiB data, 8.6 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.19k op/s 2026-02-24T08:28:53.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 41 128 208459 208331 39.6922 26.3438 0.0300194 0.0251807 2026-02-24T08:28:54.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1566922928' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:54.787 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:28:54.788 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:28:54.788 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:28:54.788 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:28:54.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 42 128 211951 211823 39.3967 27.2812 0.0261083 0.0253624 2026-02-24T08:28:54.940 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:55.067 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:55.063+0000 7f29f4db1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:55.068 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:55.063+0000 7f29f4db1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:55.230 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:28:55.231 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:28:55.276 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:28:55.285 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2026-02-24T08:28:54.757875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1622852128,"num_objects":24758,"num_object_clones":0,"num_object_copies":74274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24758,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":198165,"num_write_kb":1586390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160929,"ondisk_log_size":160929,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9061588,"kb_used_data":4736388,"kb_used_omap":69,"kb_used_meta":4325050,"kb_avail":2926951212,"statfs":{"total":3006477107200,"available":2997198041088,"internally_reserved":0,"allocated":4850061312,"data_stored":4847982676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70768,"internal_metadata":4428852112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,6,8,22,51,13],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":285360128,"num_objects":4355,"num_object_clones":0,"num_object_copies":13065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34834,"num_write_kb":278672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001707"},"pg_stats":[{"pgid":"6.f","version":"82'12998","reported_seq":13022,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.954795+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:28:50.954795+0000","last_peered":"2026-02-24T08:28:50.954795+0000","last_clean":"2026-02-24T08:28:50.954795+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:28:50.954795+0000","last_undegraded":"2026-02-24T08:28:50.954795+0000","last_fullsized":"2026-02-24T08:28:50.954795+0000","mapping_epoch":75,"log_start":"78'2900","ondisk_log_start":"78'2900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106479616,"num_objects":1625,"num_object_clones":0,"num_object_copies":4875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12998,"num_write_kb":103984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'12154","reported_seq":12163,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.780665+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:28:50.780665+0000","last_peered":"2026-02-24T08:28:50.780665+0000","last_clean":"2026-02-24T08:28:50.780665+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:28:50.780665+0000","last_undegraded":"2026-02-24T08:28:50.780665+0000","last_fullsized":"2026-02-24T08:28:50.780665+0000","mapping_epoch":75,"log_start":"77'2100","ondisk_log_start":"77'2100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99565568,"num_objects":1520,"num_object_clones":0,"num_object_copies":4560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12154,"num_write_kb":97232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'12408","reported_seq":12432,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.751098+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:28:50.751098+0000","last_peered":"2026-02-24T08:28:50.751098+0000","last_clean":"2026-02-24T08:28:50.751098+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:28:50.751098+0000","last_undegraded":"2026-02-24T08:28:50.751098+0000","last_fullsized":"2026-02-24T08:28:50.751098+0000","mapping_epoch":75,"log_start":"77'2400","ondisk_log_start":"77'2400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101646336,"num_objects":1551,"num_object_clones":0,"num_object_copies":4653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12408,"num_write_kb":99264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'12448","reported_seq":12472,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.907453+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:28:50.907453+0000","last_peered":"2026-02-24T08:28:50.907453+0000","last_clean":"2026-02-24T08:28:50.907453+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:28:50.907453+0000","last_undegraded":"2026-02-24T08:28:50.907453+0000","last_fullsized":"2026-02-24T08:28:50.907453+0000","mapping_epoch":75,"log_start":"77'2400","ondisk_log_start":"77'2400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:10.954657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101974016,"num_objects":1556,"num_object_clones":0,"num_object_copies":4668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12448,"num_write_kb":99584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'12000","reported_seq":12017,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.949928+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:28:50.949928+0000","last_peered":"2026-02-24T08:28:50.949928+0000","last_clean":"2026-02-24T08:28:50.949928+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:28:50.949928+0000","last_undegraded":"2026-02-24T08:28:50.949928+0000","last_fullsized":"2026-02-24T08:28:50.949928+0000","mapping_epoch":75,"log_start":"77'1900","ondisk_log_start":"77'1900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98304000,"num_objects":1500,"num_object_clones":0,"num_object_copies":4500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12000,"num_write_kb":96000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'12558","reported_seq":12574,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.778584+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:28:50.778584+0000","last_peered":"2026-02-24T08:28:50.778584+0000","last_clean":"2026-02-24T08:28:50.778584+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:28:50.778584+0000","last_undegraded":"2026-02-24T08:28:50.778584+0000","last_fullsized":"2026-02-24T08:28:50.778584+0000","mapping_epoch":75,"log_start":"78'2500","ondisk_log_start":"78'2500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102875136,"num_objects":1570,"num_object_clones":0,"num_object_copies":4710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1570,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12558,"num_write_kb":100464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'12431","reported_seq":12449,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.761929+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:28:50.761929+0000","last_peered":"2026-02-24T08:28:50.761929+0000","last_clean":"2026-02-24T08:28:50.761929+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:28:50.761929+0000","last_undegraded":"2026-02-24T08:28:50.761929+0000","last_fullsized":"2026-02-24T08:28:50.761929+0000","mapping_epoch":75,"log_start":"77'2400","ondisk_log_start":"77'2400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101834752,"num_objects":1554,"num_object_clones":0,"num_object_copies":4662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12431,"num_write_kb":99448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'12336","reported_seq":12360,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.861112+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:28:50.861112+0000","last_peered":"2026-02-24T08:28:50.861112+0000","last_clean":"2026-02-24T08:28:50.861112+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:28:50.861112+0000","last_undegraded":"2026-02-24T08:28:50.861112+0000","last_fullsized":"2026-02-24T08:28:50.861112+0000","mapping_epoch":75,"log_start":"77'2300","ondisk_log_start":"77'2300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101056512,"num_objects":1542,"num_object_clones":0,"num_object_copies":4626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1542,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12336,"num_write_kb":98688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'12489","reported_seq":12513,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.948169+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:28:50.948169+0000","last_peered":"2026-02-24T08:28:50.948169+0000","last_clean":"2026-02-24T08:28:50.948169+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:28:50.948169+0000","last_undegraded":"2026-02-24T08:28:50.948169+0000","last_fullsized":"2026-02-24T08:28:50.948169+0000","mapping_epoch":75,"log_start":"77'2400","ondisk_log_start":"77'2400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102309888,"num_objects":1562,"num_object_clones":0,"num_object_copies":4686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12489,"num_write_kb":99912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'12432","reported_seq":12456,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.756466+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:28:50.756466+0000","last_peered":"2026-02-24T08:28:50.756466+0000","last_clean":"2026-02-24T08:28:50.756466+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:28:50.756466+0000","last_undegraded":"2026-02-24T08:28:50.756466+0000","last_fullsized":"2026-02-24T08:28:50.756466+0000","mapping_epoch":75,"log_start":"77'2400","ondisk_log_start":"77'2400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101842944,"num_objects":1554,"num_object_clones":0,"num_object_copies":4662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12432,"num_write_kb":99456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'12520","reported_seq":12544,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.943130+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:28:50.943130+0000","last_peered":"2026-02-24T08:28:50.943130+0000","last_clean":"2026-02-24T08:28:50.943130+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:28:50.943130+0000","last_undegraded":"2026-02-24T08:28:50.943130+0000","last_fullsized":"2026-02-24T08:28:50.943130+0000","mapping_epoch":75,"log_start":"78'2500","ondisk_log_start":"78'2500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102563840,"num_objects":1565,"num_object_clones":0,"num_object_copies":4695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12520,"num_write_kb":100160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'12376","reported_seq":12397,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.777552+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:28:50.777552+0000","last_peered":"2026-02-24T08:28:50.777552+0000","last_clean":"2026-02-24T08:28:50.777552+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:28:50.777552+0000","last_undegraded":"2026-02-24T08:28:50.777552+0000","last_fullsized":"2026-02-24T08:28:50.777552+0000","mapping_epoch":75,"log_start":"77'2300","ondisk_log_start":"77'2300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101384192,"num_objects":1547,"num_object_clones":0,"num_object_copies":4641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12376,"num_write_kb":99008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'12464","reported_seq":12488,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.902177+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:28:50.902177+0000","last_peered":"2026-02-24T08:28:50.902177+0000","last_clean":"2026-02-24T08:28:50.902177+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:28:50.902177+0000","last_undegraded":"2026-02-24T08:28:50.902177+0000","last_fullsized":"2026-02-24T08:28:50.902177+0000","mapping_epoch":75,"log_start":"77'2400","ondisk_log_start":"77'2400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":1558,"num_object_clones":0,"num_object_copies":4674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12464,"num_write_kb":99712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'12144","reported_seq":12168,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.951682+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:28:50.951682+0000","last_peered":"2026-02-24T08:28:50.951682+0000","last_clean":"2026-02-24T08:28:50.951682+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:28:50.951682+0000","last_undegraded":"2026-02-24T08:28:50.951682+0000","last_fullsized":"2026-02-24T08:28:50.951682+0000","mapping_epoch":75,"log_start":"77'2100","ondisk_log_start":"77'2100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99483648,"num_objects":1518,"num_object_clones":0,"num_object_copies":4554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12144,"num_write_kb":97152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'12144","reported_seq":12168,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.772818+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:28:50.772818+0000","last_peered":"2026-02-24T08:28:50.772818+0000","last_clean":"2026-02-24T08:28:50.772818+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:28:50.772818+0000","last_undegraded":"2026-02-24T08:28:50.772818+0000","last_fullsized":"2026-02-24T08:28:50.772818+0000","mapping_epoch":75,"log_start":"77'2100","ondisk_log_start":"77'2100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99483648,"num_objects":1518,"num_object_clones":0,"num_object_copies":4554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12144,"num_write_kb":97152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'12128","reported_seq":12152,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:50.813434+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:28:50.813434+0000","last_peered":"2026-02-24T08:28:50.813434+0000","last_clean":"2026-02-24T08:28:50.813434+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:28:50.813434+0000","last_undegraded":"2026-02-24T08:28:50.813434+0000","last_fullsized":"2026-02-24T08:28:50.813434+0000","mapping_epoch":75,"log_start":"77'2100","ondisk_log_start":"77'2100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99352576,"num_objects":1516,"num_object_clones":0,"num_object_copies":4548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12128,"num_write_kb":97024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":209,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:37.070479+0000","last_change":"2026-02-24T08:27:46.848837+0000","last_active":"2026-02-24T08:28:37.070479+0000","last_peered":"2026-02-24T08:28:37.070479+0000","last_clean":"2026-02-24T08:28:37.070479+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:37.070479+0000","last_undegraded":"2026-02-24T08:28:37.070479+0000","last_fullsized":"2026-02-24T08:28:37.070479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:27:46.848803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:27:46.848803+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:28:54.592930+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1622261760,"num_objects":24756,"num_object_clones":0,"num_object_copies":74268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24756,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198030,"num_write_kb":1584240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4865064960,"data_stored":4865064960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160830,"ondisk_log_size":160830,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3875,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247912,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2113592,"kb_used_data":991524,"kb_used_omap":16,"kb_used_meta":1122031,"kb_avail":731889608,"statfs":{"total":751619276800,"available":749454958592,"internally_reserved":0,"allocated":1015320576,"data_stored":1014800029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16984,"internal_metadata":1148960168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444138,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2417072,"kb_used_data":1185308,"kb_used_omap":19,"kb_used_meta":1231724,"kb_avail":731586128,"statfs":{"total":751619276800,"available":749144195072,"internally_reserved":0,"allocated":1213755392,"data_stored":1213234845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20098,"internal_metadata":1261285758},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,1,12,19,7],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2260988,"kb_used_data":1377896,"kb_used_omap":16,"kb_used_meta":883055,"kb_avail":731742212,"statfs":{"total":751619276800,"available":749304025088,"internally_reserved":0,"allocated":1410965504,"data_stored":1410448509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":904248888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,4,7,10,32,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705774,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2269936,"kb_used_data":1181660,"kb_used_omap":16,"kb_used_meta":1088239,"kb_avail":731733264,"statfs":{"total":751619276800,"available":749294862336,"internally_reserved":0,"allocated":1210019840,"data_stored":1209499293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16846,"internal_metadata":1114357298},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3875,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1214840832,"data_stored":1214840832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1420296192,"data_stored":1420296192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1215758336,"data_stored":1215758336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1014169600,"data_stored":1014169600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:28:55.286 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:28:55.286 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 191 2026-02-24T08:28:55.348 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:55 trial105 ceph-mon[39442]: pgmap v312: 17 pgs: 17 active+clean; 1.5 GiB data, 8.6 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.90k op/s 2026-02-24T08:28:55.429 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:55.468 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:55.556 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:55.552+0000 7f62d8f6e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:55.559 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:55.554+0000 7f62d8f6e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:55.578 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:55.578 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:55.597 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:55.597 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:55.604 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:55.600+0000 7f358a1a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:55.604 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:55.601+0000 7f358a1a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:55.613 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:55.613 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:55.634 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:55.634 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:55.747 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:28:55.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:28:55.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 43 128 215115 214987 39.0553 24.7188 0.038241 0.0255905 2026-02-24T08:28:56.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:56 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:28:56.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:56 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:28:56.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:56 trial105 ceph-mon[39442]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:28:56.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1800122474' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:56.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1387690496' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "191"} : dispatch 2026-02-24T08:28:56.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 44 128 218669 218541 38.7987 27.7656 0.0249939 0.025757 2026-02-24T08:28:57.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:57 trial105 ceph-mon[39442]: pgmap v313: 17 pgs: 17 active+clean; 1.6 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.31k op/s 2026-02-24T08:28:57.680 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:28:57.830 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:28:57.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 45 128 222111 221983 38.534 26.8906 0.0232771 0.0259352 2026-02-24T08:28:57.962 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:57.957+0000 7fef90934640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:57.962 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:28:57.958+0000 7fef90934640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:28:57.976 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:28:57.976 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:28:57.996 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:28:57.996 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:28:58.010 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:28:58.011 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:28:58.026 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:28:58.026 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:28:58.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3225449282' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:28:58.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 46 128 225478 225350 38.2681 26.3047 0.0218223 0.0261149 2026-02-24T08:28:59.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:59 trial105 ceph-mon[39442]: pgmap v314: 17 pgs: 17 active+clean; 1.6 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.84k op/s 2026-02-24T08:28:59.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:28:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:28:59.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 47 128 228980 228852 38.036 27.3594 0.0220923 0.0262759 2026-02-24T08:28:59.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:28:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:28:59.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:28:59.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:28:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:28:59] "GET /metrics HTTP/1.1" 200 4208 "" "Prometheus/3.6.0" 2026-02-24T08:29:00.080 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:00.237 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:00.372 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:00.368+0000 7fce77d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:00.372 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:00.368+0000 7fce77d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:00.390 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:00.390 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:00.405 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:00.405 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:00.422 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:00.422 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:00.434 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:00.435 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:00.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1392307944' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:00.791 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:00.791 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:00.791 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T08:29:00.792 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:00.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 48 128 232391 232263 37.7987 26.6484 0.0763097 0.0264407 2026-02-24T08:29:00.938 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:01.056 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:01.052+0000 7f480ed1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:01.056 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:01.053+0000 7f480ed1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:01.207 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:01.208 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:01.253 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2026-02-24T08:29:00.758706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1761010208,"num_objects":26869,"num_object_clones":0,"num_object_copies":80607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26869,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":215030,"num_write_kb":1721310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160894,"ondisk_log_size":160894,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9576116,"kb_used_data":5142620,"kb_used_omap":69,"kb_used_meta":4433338,"kb_avail":2926436684,"statfs":{"total":3006477107200,"available":2996671164416,"internally_reserved":0,"allocated":5266042880,"data_stored":5263964244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71458,"internal_metadata":4539738334},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,15,22,22,72,7],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":278937600,"num_objects":4260,"num_object_clones":0,"num_object_copies":12780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4260,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34050,"num_write_kb":272400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001652"},"pg_stats":[{"pgid":"6.f","version":"82'14146","reported_seq":14170,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.943104+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:28:55.943104+0000","last_peered":"2026-02-24T08:28:55.943104+0000","last_clean":"2026-02-24T08:28:55.943104+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:28:55.943104+0000","last_undegraded":"2026-02-24T08:28:55.943104+0000","last_fullsized":"2026-02-24T08:28:55.943104+0000","mapping_epoch":75,"log_start":"78'4100","ondisk_log_start":"78'4100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115884032,"num_objects":1769,"num_object_clones":0,"num_object_copies":5307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14146,"num_write_kb":113168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'13128","reported_seq":13152,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.744079+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:28:55.744079+0000","last_peered":"2026-02-24T08:28:55.744079+0000","last_clean":"2026-02-24T08:28:55.744079+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:28:55.744079+0000","last_undegraded":"2026-02-24T08:28:55.744079+0000","last_fullsized":"2026-02-24T08:28:55.744079+0000","mapping_epoch":75,"log_start":"78'3100","ondisk_log_start":"78'3100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107544576,"num_objects":1641,"num_object_clones":0,"num_object_copies":4923,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1641,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13128,"num_write_kb":105024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'13528","reported_seq":13552,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.745713+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:28:55.745713+0000","last_peered":"2026-02-24T08:28:55.745713+0000","last_clean":"2026-02-24T08:28:55.745713+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:28:55.745713+0000","last_undegraded":"2026-02-24T08:28:55.745713+0000","last_fullsized":"2026-02-24T08:28:55.745713+0000","mapping_epoch":75,"log_start":"78'3500","ondisk_log_start":"78'3500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110821376,"num_objects":1691,"num_object_clones":0,"num_object_copies":5073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1691,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13528,"num_write_kb":108224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'13430","reported_seq":13453,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.972322+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:28:55.972322+0000","last_peered":"2026-02-24T08:28:55.972322+0000","last_clean":"2026-02-24T08:28:55.972322+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:28:55.972322+0000","last_undegraded":"2026-02-24T08:28:55.972322+0000","last_fullsized":"2026-02-24T08:28:55.972322+0000","mapping_epoch":75,"log_start":"78'3400","ondisk_log_start":"78'3400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:10.954657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110018560,"num_objects":1679,"num_object_clones":0,"num_object_copies":5037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13430,"num_write_kb":107440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'13005","reported_seq":13029,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.961564+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:28:55.961564+0000","last_peered":"2026-02-24T08:28:55.961564+0000","last_clean":"2026-02-24T08:28:55.961564+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:28:55.961564+0000","last_undegraded":"2026-02-24T08:28:55.961564+0000","last_fullsized":"2026-02-24T08:28:55.961564+0000","mapping_epoch":75,"log_start":"78'3000","ondisk_log_start":"78'3000","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106536960,"num_objects":1626,"num_object_clones":0,"num_object_copies":4878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1626,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13005,"num_write_kb":104040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'13670","reported_seq":13692,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.790611+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:28:55.790611+0000","last_peered":"2026-02-24T08:28:55.790611+0000","last_clean":"2026-02-24T08:28:55.790611+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:28:55.790611+0000","last_undegraded":"2026-02-24T08:28:55.790611+0000","last_fullsized":"2026-02-24T08:28:55.790611+0000","mapping_epoch":75,"log_start":"78'3600","ondisk_log_start":"78'3600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111984640,"num_objects":1709,"num_object_clones":0,"num_object_copies":5127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1709,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13670,"num_write_kb":109360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'13427","reported_seq":13451,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.793307+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:28:55.793307+0000","last_peered":"2026-02-24T08:28:55.793307+0000","last_clean":"2026-02-24T08:28:55.793307+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:28:55.793307+0000","last_undegraded":"2026-02-24T08:28:55.793307+0000","last_fullsized":"2026-02-24T08:28:55.793307+0000","mapping_epoch":75,"log_start":"78'3400","ondisk_log_start":"78'3400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109993984,"num_objects":1679,"num_object_clones":0,"num_object_copies":5037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13427,"num_write_kb":107416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'13544","reported_seq":13568,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.899027+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:28:55.899027+0000","last_peered":"2026-02-24T08:28:55.899027+0000","last_clean":"2026-02-24T08:28:55.899027+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:28:55.899027+0000","last_undegraded":"2026-02-24T08:28:55.899027+0000","last_fullsized":"2026-02-24T08:28:55.899027+0000","mapping_epoch":75,"log_start":"78'3500","ondisk_log_start":"78'3500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110952448,"num_objects":1693,"num_object_clones":0,"num_object_copies":5079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13544,"num_write_kb":108352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'13578","reported_seq":13602,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.973726+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:28:55.973726+0000","last_peered":"2026-02-24T08:28:55.973726+0000","last_clean":"2026-02-24T08:28:55.973726+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:28:55.973726+0000","last_undegraded":"2026-02-24T08:28:55.973726+0000","last_fullsized":"2026-02-24T08:28:55.973726+0000","mapping_epoch":75,"log_start":"78'3500","ondisk_log_start":"78'3500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111230976,"num_objects":1698,"num_object_clones":0,"num_object_copies":5094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13578,"num_write_kb":108624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'13555","reported_seq":13579,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.803877+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:28:55.803877+0000","last_peered":"2026-02-24T08:28:55.803877+0000","last_clean":"2026-02-24T08:28:55.803877+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:28:55.803877+0000","last_undegraded":"2026-02-24T08:28:55.803877+0000","last_fullsized":"2026-02-24T08:28:55.803877+0000","mapping_epoch":75,"log_start":"78'3500","ondisk_log_start":"78'3500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111042560,"num_objects":1695,"num_object_clones":0,"num_object_copies":5085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13555,"num_write_kb":108440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'13584","reported_seq":13608,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.943002+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:28:55.943002+0000","last_peered":"2026-02-24T08:28:55.943002+0000","last_clean":"2026-02-24T08:28:55.943002+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:28:55.943002+0000","last_undegraded":"2026-02-24T08:28:55.943002+0000","last_fullsized":"2026-02-24T08:28:55.943002+0000","mapping_epoch":75,"log_start":"78'3500","ondisk_log_start":"78'3500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111280128,"num_objects":1698,"num_object_clones":0,"num_object_copies":5094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13584,"num_write_kb":108672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'13371","reported_seq":13390,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.804512+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:28:55.804512+0000","last_peered":"2026-02-24T08:28:55.804512+0000","last_clean":"2026-02-24T08:28:55.804512+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:28:55.804512+0000","last_undegraded":"2026-02-24T08:28:55.804512+0000","last_fullsized":"2026-02-24T08:28:55.804512+0000","mapping_epoch":75,"log_start":"78'3300","ondisk_log_start":"78'3300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109535232,"num_objects":1672,"num_object_clones":0,"num_object_copies":5016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13371,"num_write_kb":106968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'13512","reported_seq":13536,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.921754+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:28:55.921754+0000","last_peered":"2026-02-24T08:28:55.921754+0000","last_clean":"2026-02-24T08:28:55.921754+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:28:55.921754+0000","last_undegraded":"2026-02-24T08:28:55.921754+0000","last_fullsized":"2026-02-24T08:28:55.921754+0000","mapping_epoch":75,"log_start":"78'3500","ondisk_log_start":"78'3500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110690304,"num_objects":1689,"num_object_clones":0,"num_object_copies":5067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13512,"num_write_kb":108096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'13130","reported_seq":13150,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.964876+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:28:55.964876+0000","last_peered":"2026-02-24T08:28:55.964876+0000","last_clean":"2026-02-24T08:28:55.964876+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:28:55.964876+0000","last_undegraded":"2026-02-24T08:28:55.964876+0000","last_fullsized":"2026-02-24T08:28:55.964876+0000","mapping_epoch":75,"log_start":"78'3100","ondisk_log_start":"78'3100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107560960,"num_objects":1642,"num_object_clones":0,"num_object_copies":4926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13130,"num_write_kb":105040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'13000","reported_seq":13024,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.671204+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:28:55.671204+0000","last_peered":"2026-02-24T08:28:55.671204+0000","last_clean":"2026-02-24T08:28:55.671204+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:28:55.671204+0000","last_undegraded":"2026-02-24T08:28:55.671204+0000","last_fullsized":"2026-02-24T08:28:55.671204+0000","mapping_epoch":75,"log_start":"78'2900","ondisk_log_start":"78'2900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106496000,"num_objects":1625,"num_object_clones":0,"num_object_copies":4875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13000,"num_write_kb":104000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'13287","reported_seq":13309,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:55.915070+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:28:55.915070+0000","last_peered":"2026-02-24T08:28:55.915070+0000","last_clean":"2026-02-24T08:28:55.915070+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:28:55.915070+0000","last_undegraded":"2026-02-24T08:28:55.915070+0000","last_fullsized":"2026-02-24T08:28:55.915070+0000","mapping_epoch":75,"log_start":"78'3200","ondisk_log_start":"78'3200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108847104,"num_objects":1661,"num_object_clones":0,"num_object_copies":4983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13287,"num_write_kb":106296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1760419840,"num_objects":26867,"num_object_clones":0,"num_object_copies":80601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214895,"num_write_kb":1719160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5280448512,"data_stored":5280448512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160795,"ondisk_log_size":160795,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247913,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2253040,"kb_used_data":1076828,"kb_used_omap":16,"kb_used_meta":1176175,"kb_avail":731750160,"statfs":{"total":751619276800,"available":749312163840,"internally_reserved":0,"allocated":1102671872,"data_stored":1102151325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17022,"internal_metadata":1204403586},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,6,1,19,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444139,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2517648,"kb_used_data":1285876,"kb_used_omap":20,"kb_used_meta":1231723,"kb_avail":731485552,"statfs":{"total":751619276800,"available":749041205248,"internally_reserved":0,"allocated":1316737024,"data_stored":1316216477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1261285106},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,7,9,11,21],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2396836,"kb_used_data":1495696,"kb_used_omap":16,"kb_used_meta":901103,"kb_avail":731606364,"statfs":{"total":751619276800,"available":749164916736,"internally_reserved":0,"allocated":1531592704,"data_stored":1531075709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":922730040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,4,7,10,32,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705775,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2408592,"kb_used_data":1284220,"kb_used_omap":16,"kb_used_meta":1124335,"kb_avail":731594608,"statfs":{"total":751619276800,"available":749152878592,"internally_reserved":0,"allocated":1315041280,"data_stored":1314520733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16846,"internal_metadata":1151319602},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1318043648,"data_stored":1318043648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1540825088,"data_stored":1540825088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1319018496,"data_stored":1319018496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1102561280,"data_stored":1102561280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:01.255 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:29:01.255 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 36 2026-02-24T08:29:01.406 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:01.459 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:01 trial105 ceph-mon[39442]: pgmap v315: 17 pgs: 17 active+clean; 1.6 GiB data, 9.1 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.84k op/s 2026-02-24T08:29:01.543 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:01.539+0000 7f3716d66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:01.543 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:01.540+0000 7f3716d66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:01.702 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:29:01.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:29:01.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 49 128 235687 235559 37.5528 25.75 0.0814904 0.0266078 2026-02-24T08:29:02.484 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:02.640 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:02.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:02 trial105 ceph-mon[39442]: from='client.15178 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:02.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3067690461' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T08:29:02.764 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:02.760+0000 7fa24c615640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:02.765 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:02.760+0000 7fa24c615640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:02.782 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:02.782 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:02.796 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:02.796 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:02.810 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:02.810 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:02.826 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:02.826 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:02.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 50 128 239075 238947 37.3311 26.4688 0.00805673 0.026771 2026-02-24T08:29:03.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:03 trial105 ceph-mon[39442]: pgmap v316: 17 pgs: 17 active+clean; 1.8 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.28k op/s 2026-02-24T08:29:03.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2632046775' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:03.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 51 127 242653 242526 37.1473 27.9609 0.0667206 0.0269067 2026-02-24T08:29:04.872 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:04.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 52 128 246204 246076 36.9662 27.7344 0.0449845 0.0270361 2026-02-24T08:29:05.011 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:05.364 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:05.360+0000 7fbc2aff7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:05.365 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:05.361+0000 7fbc2aff7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:05.382 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:05.383 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:05.398 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:05.398 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:05.413 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:05.413 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:05.427 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:05.427 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:05.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 53 128 249206 249078 36.7112 23.4531 0.0457596 0.0272224 2026-02-24T08:29:06.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:05 trial105 ceph-mon[39442]: pgmap v317: 17 pgs: 17 active+clean; 1.8 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.85k op/s 2026-02-24T08:29:06.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:05 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3615318397' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:06.744 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:06.745 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:06.745 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:29:06.745 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:06.899 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:06.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 54 128 252682 252554 36.5343 27.1562 0.0199028 0.0273515 2026-02-24T08:29:07.023 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:07.020+0000 7fb1036d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:07.024 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:07.020+0000 7fb1036d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:07.185 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:07.185 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:07.236 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2026-02-24T08:29:06.759496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2041004576,"num_objects":31141,"num_object_clones":0,"num_object_copies":93423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31141,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":249209,"num_write_kb":1994742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160973,"ondisk_log_size":160973,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10587044,"kb_used_data":5955020,"kb_used_omap":69,"kb_used_meta":4631866,"kb_avail":2925425756,"statfs":{"total":3006477107200,"available":2995635974144,"internally_reserved":0,"allocated":6097940480,"data_stored":6095861844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71458,"internal_metadata":4743031006},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":418152448,"num_objects":6383,"num_object_clones":0,"num_object_copies":19149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6383,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51044,"num_write_kb":408352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001621"},"pg_stats":[{"pgid":"6.f","version":"82'16248","reported_seq":16272,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.917720+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:29:05.917720+0000","last_peered":"2026-02-24T08:29:05.917720+0000","last_clean":"2026-02-24T08:29:05.917720+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:29:05.917720+0000","last_undegraded":"2026-02-24T08:29:05.917720+0000","last_fullsized":"2026-02-24T08:29:05.917720+0000","mapping_epoch":75,"log_start":"79'6200","ondisk_log_start":"79'6200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133103616,"num_objects":2031,"num_object_clones":0,"num_object_copies":6093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2031,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16248,"num_write_kb":129984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'15355","reported_seq":15377,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.720010+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:29:05.720010+0000","last_peered":"2026-02-24T08:29:05.720010+0000","last_clean":"2026-02-24T08:29:05.720010+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:29:05.720010+0000","last_undegraded":"2026-02-24T08:29:05.720010+0000","last_fullsized":"2026-02-24T08:29:05.720010+0000","mapping_epoch":75,"log_start":"79'5300","ondisk_log_start":"79'5300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125788160,"num_objects":1920,"num_object_clones":0,"num_object_copies":5760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15355,"num_write_kb":122840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'15659","reported_seq":15681,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.793064+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:29:05.793064+0000","last_peered":"2026-02-24T08:29:05.793064+0000","last_clean":"2026-02-24T08:29:05.793064+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:29:05.793064+0000","last_undegraded":"2026-02-24T08:29:05.793064+0000","last_fullsized":"2026-02-24T08:29:05.793064+0000","mapping_epoch":75,"log_start":"79'5600","ondisk_log_start":"79'5600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128278528,"num_objects":1958,"num_object_clones":0,"num_object_copies":5874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1958,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15659,"num_write_kb":125272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'15465","reported_seq":15485,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:06.025413+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:29:06.025413+0000","last_peered":"2026-02-24T08:29:06.025413+0000","last_clean":"2026-02-24T08:29:06.025413+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:29:06.025413+0000","last_undegraded":"2026-02-24T08:29:06.025413+0000","last_fullsized":"2026-02-24T08:29:06.025413+0000","mapping_epoch":75,"log_start":"79'5400","ondisk_log_start":"79'5400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:10.954657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126689280,"num_objects":1934,"num_object_clones":0,"num_object_copies":5802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15465,"num_write_kb":123720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'15291","reported_seq":15313,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.982448+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:29:05.982448+0000","last_peered":"2026-02-24T08:29:05.982448+0000","last_clean":"2026-02-24T08:29:05.982448+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:29:05.982448+0000","last_undegraded":"2026-02-24T08:29:05.982448+0000","last_fullsized":"2026-02-24T08:29:05.982448+0000","mapping_epoch":75,"log_start":"79'5200","ondisk_log_start":"79'5200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125263872,"num_objects":1912,"num_object_clones":0,"num_object_copies":5736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15291,"num_write_kb":122328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'15848","reported_seq":15872,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.710948+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:29:05.710948+0000","last_peered":"2026-02-24T08:29:05.710948+0000","last_clean":"2026-02-24T08:29:05.710948+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:29:05.710948+0000","last_undegraded":"2026-02-24T08:29:05.710948+0000","last_fullsized":"2026-02-24T08:29:05.710948+0000","mapping_epoch":75,"log_start":"79'5800","ondisk_log_start":"79'5800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129826816,"num_objects":1981,"num_object_clones":0,"num_object_copies":5943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15848,"num_write_kb":126784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'15654","reported_seq":15676,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.824670+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:29:05.824670+0000","last_peered":"2026-02-24T08:29:05.824670+0000","last_clean":"2026-02-24T08:29:05.824670+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:29:05.824670+0000","last_undegraded":"2026-02-24T08:29:05.824670+0000","last_fullsized":"2026-02-24T08:29:05.824670+0000","mapping_epoch":75,"log_start":"79'5600","ondisk_log_start":"79'5600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128237568,"num_objects":1957,"num_object_clones":0,"num_object_copies":5871,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1957,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15654,"num_write_kb":125232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'15696","reported_seq":15720,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.862417+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:29:05.862417+0000","last_peered":"2026-02-24T08:29:05.862417+0000","last_clean":"2026-02-24T08:29:05.862417+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:29:05.862417+0000","last_undegraded":"2026-02-24T08:29:05.862417+0000","last_fullsized":"2026-02-24T08:29:05.862417+0000","mapping_epoch":75,"log_start":"79'5600","ondisk_log_start":"79'5600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128581632,"num_objects":1962,"num_object_clones":0,"num_object_copies":5886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1962,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15696,"num_write_kb":125568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'15715","reported_seq":15739,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:06.020895+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:29:06.020895+0000","last_peered":"2026-02-24T08:29:06.020895+0000","last_clean":"2026-02-24T08:29:06.020895+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:29:06.020895+0000","last_undegraded":"2026-02-24T08:29:06.020895+0000","last_fullsized":"2026-02-24T08:29:06.020895+0000","mapping_epoch":75,"log_start":"79'5700","ondisk_log_start":"79'5700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128737280,"num_objects":1965,"num_object_clones":0,"num_object_copies":5895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1965,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15715,"num_write_kb":125720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'15528","reported_seq":15552,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.836305+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:29:05.836305+0000","last_peered":"2026-02-24T08:29:05.836305+0000","last_clean":"2026-02-24T08:29:05.836305+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:29:05.836305+0000","last_undegraded":"2026-02-24T08:29:05.836305+0000","last_fullsized":"2026-02-24T08:29:05.836305+0000","mapping_epoch":75,"log_start":"79'5500","ondisk_log_start":"79'5500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127205376,"num_objects":1941,"num_object_clones":0,"num_object_copies":5823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1941,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15528,"num_write_kb":124224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'15808","reported_seq":15832,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.995464+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:29:05.995464+0000","last_peered":"2026-02-24T08:29:05.995464+0000","last_clean":"2026-02-24T08:29:05.995464+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:29:05.995464+0000","last_undegraded":"2026-02-24T08:29:05.995464+0000","last_fullsized":"2026-02-24T08:29:05.995464+0000","mapping_epoch":75,"log_start":"79'5800","ondisk_log_start":"79'5800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129499136,"num_objects":1976,"num_object_clones":0,"num_object_copies":5928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15808,"num_write_kb":126464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'15581","reported_seq":15603,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.829457+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:29:05.829457+0000","last_peered":"2026-02-24T08:29:05.829457+0000","last_clean":"2026-02-24T08:29:05.829457+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:29:05.829457+0000","last_undegraded":"2026-02-24T08:29:05.829457+0000","last_fullsized":"2026-02-24T08:29:05.829457+0000","mapping_epoch":75,"log_start":"79'5500","ondisk_log_start":"79'5500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127639552,"num_objects":1948,"num_object_clones":0,"num_object_copies":5844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15581,"num_write_kb":124648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'15656","reported_seq":15680,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.842596+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:29:05.842596+0000","last_peered":"2026-02-24T08:29:05.842596+0000","last_clean":"2026-02-24T08:29:05.842596+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:29:05.842596+0000","last_undegraded":"2026-02-24T08:29:05.842596+0000","last_fullsized":"2026-02-24T08:29:05.842596+0000","mapping_epoch":75,"log_start":"79'5600","ondisk_log_start":"79'5600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128253952,"num_objects":1957,"num_object_clones":0,"num_object_copies":5871,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1957,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15656,"num_write_kb":125248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'15248","reported_seq":15272,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:06.005739+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:29:06.005739+0000","last_peered":"2026-02-24T08:29:06.005739+0000","last_clean":"2026-02-24T08:29:06.005739+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:29:06.005739+0000","last_undegraded":"2026-02-24T08:29:06.005739+0000","last_fullsized":"2026-02-24T08:29:06.005739+0000","mapping_epoch":75,"log_start":"79'5200","ondisk_log_start":"79'5200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124911616,"num_objects":1906,"num_object_clones":0,"num_object_copies":5718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15248,"num_write_kb":121984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'14932","reported_seq":14954,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.817614+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:29:05.817614+0000","last_peered":"2026-02-24T08:29:05.817614+0000","last_clean":"2026-02-24T08:29:05.817614+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:29:05.817614+0000","last_undegraded":"2026-02-24T08:29:05.817614+0000","last_fullsized":"2026-02-24T08:29:05.817614+0000","mapping_epoch":75,"log_start":"78'4900","ondisk_log_start":"78'4900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122322944,"num_objects":1867,"num_object_clones":0,"num_object_copies":5601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14932,"num_write_kb":119456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'15390","reported_seq":15407,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:05.940242+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:29:05.940242+0000","last_peered":"2026-02-24T08:29:05.940242+0000","last_clean":"2026-02-24T08:29:05.940242+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:29:05.940242+0000","last_undegraded":"2026-02-24T08:29:05.940242+0000","last_fullsized":"2026-02-24T08:29:05.940242+0000","mapping_epoch":75,"log_start":"79'5300","ondisk_log_start":"79'5300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126074880,"num_objects":1924,"num_object_clones":0,"num_object_copies":5772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1924,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15390,"num_write_kb":123120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2040414208,"num_objects":31139,"num_object_clones":0,"num_object_copies":93417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249074,"num_write_kb":1992592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6121086976,"data_stored":6121086976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160874,"ondisk_log_size":160874,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247915,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2441696,"kb_used_data":1247436,"kb_used_omap":16,"kb_used_meta":1194223,"kb_avail":731561504,"statfs":{"total":751619276800,"available":749118980096,"internally_reserved":0,"allocated":1277374464,"data_stored":1276853917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17022,"internal_metadata":1222884738},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444141,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2753736,"kb_used_data":1485876,"kb_used_omap":20,"kb_used_meta":1267819,"kb_avail":731249464,"statfs":{"total":751619276800,"available":748799451136,"internally_reserved":0,"allocated":1521537024,"data_stored":1521016477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1298247410},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2727940,"kb_used_data":1736560,"kb_used_omap":16,"kb_used_meta":991343,"kb_avail":731275260,"statfs":{"total":751619276800,"available":748825866240,"internally_reserved":0,"allocated":1778237440,"data_stored":1777720445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":1015135800},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705777,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2663672,"kb_used_data":1485148,"kb_used_omap":16,"kb_used_meta":1178479,"kb_avail":731339528,"statfs":{"total":751619276800,"available":748891676672,"internally_reserved":0,"allocated":1520791552,"data_stored":1520271005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16846,"internal_metadata":1206763058},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1526816768,"data_stored":1526816768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1787625472,"data_stored":1787625472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1528627200,"data_stored":1528627200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1278017536,"data_stored":1278017536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:07.238 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 191 2026-02-24T08:29:07.390 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:07.470 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:07.519 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:07.515+0000 7efdae89d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:07.519 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:07.515+0000 7efdae89d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:07.618 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:07.679 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:29:07.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:29:07.750 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:07.746+0000 7fc020b30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:07.750 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:07.747+0000 7fc020b30640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:07.769 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:07.770 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:07.787 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:07.787 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:07.803 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:07.803 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:07.817 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:07.817 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:07.928 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:07 trial105 ceph-mon[39442]: pgmap v318: 17 pgs: 17 active+clean; 1.9 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.25k op/s 2026-02-24T08:29:07.928 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2504192916' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "191"} : dispatch 2026-02-24T08:29:07.928 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1636564867' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:07.930 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 55 128 255803 255675 36.3133 24.3828 0.0527123 0.0275187 2026-02-24T08:29:08.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 56 128 259344 259216 36.1588 27.6641 0.0193216 0.0276421 2026-02-24T08:29:09.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:08 trial105 ceph-mon[39442]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:09.816 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:29:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:29:09] "GET /metrics HTTP/1.1" 200 4208 "" "Prometheus/3.6.0" 2026-02-24T08:29:09.840 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:29:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:29:09.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:29:09.864 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:09.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 57 127 262684 262557 35.9824 26.1016 0.101569 0.0277756 2026-02-24T08:29:10.015 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:10.068 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:09 trial105 ceph-mon[39442]: pgmap v319: 17 pgs: 17 active+clean; 1.9 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.85k op/s 2026-02-24T08:29:10.143 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:10.140+0000 7fbb8b511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:10.143 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:10.141+0000 7fbb8b511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:10.162 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:10.163 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:10.181 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:10.181 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:10.194 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:10.194 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:10.208 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:10.208 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:10.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 58 128 266015 265887 35.8105 26.0156 0.0513505 0.0279136 2026-02-24T08:29:11.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2610912883' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:11.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 59 128 269477 269349 35.6619 27.0469 0.0493512 0.0280257 2026-02-24T08:29:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:11 trial105 ceph-mon[39442]: pgmap v320: 17 pgs: 17 active+clean; 1.9 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.85k op/s 2026-02-24T08:29:12.258 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:12.410 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:12.542 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:12.539+0000 7fa921075640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:12.542 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:12.539+0000 7fa921075640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:12.561 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:12.561 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:12.577 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:12.577 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:12.594 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:12.594 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:12.609 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:12.609 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:12.731 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:12.732 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:12.732 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:12.879 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:12.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:29:12.929753+0000 min lat: 0.00104297 max lat: 0.259833 avg lat: 0.028159 2026-02-24T08:29:12.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:29:12.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 60 128 272759 272631 35.4949 25.6406 0.0533875 0.028159 2026-02-24T08:29:13.017 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:13.014+0000 7f4d11700640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:13.017 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:13.014+0000 7f4d11700640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:13.169 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:13.170 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:13.170 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:13 trial105 ceph-mon[39442]: 6.c scrub starts 2026-02-24T08:29:13.170 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4040738265' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:13.171 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:13 trial105 ceph-mon[39442]: 6.1 scrub starts 2026-02-24T08:29:13.171 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:13 trial105 ceph-mon[39442]: pgmap v321: 17 pgs: 17 active+clean; 2.0 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.25k op/s 2026-02-24T08:29:13.221 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2026-02-24T08:29:12.760323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2178982432,"num_objects":33245,"num_object_clones":0,"num_object_copies":99735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33245,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":266052,"num_write_kb":2129486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160916,"ondisk_log_size":160916,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11063692,"kb_used_data":6359484,"kb_used_omap":69,"kb_used_meta":4704058,"kb_avail":2924949108,"statfs":{"total":3006477107200,"available":2995147886592,"internally_reserved":0,"allocated":6512111616,"data_stored":6510032980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71458,"internal_metadata":4816955614},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,7,5,24,12,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":417972224,"num_objects":6376,"num_object_clones":0,"num_object_copies":19128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51022,"num_write_kb":408176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001617"},"pg_stats":[{"pgid":"6.f","version":"82'17280","reported_seq":17304,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:11.030174+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:29:11.030174+0000","last_peered":"2026-02-24T08:29:11.030174+0000","last_clean":"2026-02-24T08:29:11.030174+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:29:11.030174+0000","last_undegraded":"2026-02-24T08:29:11.030174+0000","last_fullsized":"2026-02-24T08:29:11.030174+0000","mapping_epoch":75,"log_start":"80'7200","ondisk_log_start":"80'7200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141557760,"num_objects":2160,"num_object_clones":0,"num_object_copies":6480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17280,"num_write_kb":138240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'16408","reported_seq":16432,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.836386+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:29:10.836386+0000","last_peered":"2026-02-24T08:29:10.836386+0000","last_clean":"2026-02-24T08:29:10.836386+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:29:10.836386+0000","last_undegraded":"2026-02-24T08:29:10.836386+0000","last_fullsized":"2026-02-24T08:29:10.836386+0000","mapping_epoch":75,"log_start":"79'6400","ondisk_log_start":"79'6400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134414336,"num_objects":2051,"num_object_clones":0,"num_object_copies":6153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16408,"num_write_kb":131264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'16721","reported_seq":16744,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.824609+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:29:10.824609+0000","last_peered":"2026-02-24T08:29:10.824609+0000","last_clean":"2026-02-24T08:29:10.824609+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:29:10.824609+0000","last_undegraded":"2026-02-24T08:29:10.824609+0000","last_fullsized":"2026-02-24T08:29:10.824609+0000","mapping_epoch":75,"log_start":"79'6700","ondisk_log_start":"79'6700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136978432,"num_objects":2091,"num_object_clones":0,"num_object_copies":6273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2091,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16721,"num_write_kb":133768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'16567","reported_seq":16587,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:11.043854+0000","last_change":"2026-02-24T08:28:11.827537+0000","last_active":"2026-02-24T08:29:11.043854+0000","last_peered":"2026-02-24T08:29:11.043854+0000","last_clean":"2026-02-24T08:29:11.043854+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:29:11.043854+0000","last_undegraded":"2026-02-24T08:29:11.043854+0000","last_fullsized":"2026-02-24T08:29:11.043854+0000","mapping_epoch":75,"log_start":"79'6500","ondisk_log_start":"79'6500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135716864,"num_objects":2071,"num_object_clones":0,"num_object_copies":6213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2071,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16567,"num_write_kb":132536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'16408","reported_seq":16432,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:11.018854+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:29:11.018854+0000","last_peered":"2026-02-24T08:29:11.018854+0000","last_clean":"2026-02-24T08:29:11.018854+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:29:11.018854+0000","last_undegraded":"2026-02-24T08:29:11.018854+0000","last_fullsized":"2026-02-24T08:29:11.018854+0000","mapping_epoch":75,"log_start":"79'6400","ondisk_log_start":"79'6400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134414336,"num_objects":2051,"num_object_clones":0,"num_object_copies":6153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2051,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16408,"num_write_kb":131264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'16816","reported_seq":16839,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.844788+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:29:10.844788+0000","last_peered":"2026-02-24T08:29:10.844788+0000","last_clean":"2026-02-24T08:29:10.844788+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:29:10.844788+0000","last_undegraded":"2026-02-24T08:29:10.844788+0000","last_fullsized":"2026-02-24T08:29:10.844788+0000","mapping_epoch":75,"log_start":"80'6800","ondisk_log_start":"80'6800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137756672,"num_objects":2102,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16816,"num_write_kb":134528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'16600","reported_seq":16624,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.715691+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:29:10.715691+0000","last_peered":"2026-02-24T08:29:10.715691+0000","last_clean":"2026-02-24T08:29:10.715691+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:29:10.715691+0000","last_undegraded":"2026-02-24T08:29:10.715691+0000","last_fullsized":"2026-02-24T08:29:10.715691+0000","mapping_epoch":75,"log_start":"79'6500","ondisk_log_start":"79'6500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135987200,"num_objects":2075,"num_object_clones":0,"num_object_copies":6225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16600,"num_write_kb":132800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'16584","reported_seq":16602,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.953962+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:29:10.953962+0000","last_peered":"2026-02-24T08:29:10.953962+0000","last_clean":"2026-02-24T08:29:10.953962+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:29:10.953962+0000","last_undegraded":"2026-02-24T08:29:10.953962+0000","last_fullsized":"2026-02-24T08:29:10.953962+0000","mapping_epoch":75,"log_start":"79'6500","ondisk_log_start":"79'6500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135856128,"num_objects":2073,"num_object_clones":0,"num_object_copies":6219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2073,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16584,"num_write_kb":132672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'17015","reported_seq":17033,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:11.040875+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:29:11.040875+0000","last_peered":"2026-02-24T08:29:11.040875+0000","last_clean":"2026-02-24T08:29:11.040875+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:29:11.040875+0000","last_undegraded":"2026-02-24T08:29:11.040875+0000","last_fullsized":"2026-02-24T08:29:11.040875+0000","mapping_epoch":75,"log_start":"80'7000","ondisk_log_start":"80'7000","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139386880,"num_objects":2127,"num_object_clones":0,"num_object_copies":6381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17015,"num_write_kb":136120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'16544","reported_seq":16568,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.838969+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:29:10.838969+0000","last_peered":"2026-02-24T08:29:10.838969+0000","last_clean":"2026-02-24T08:29:10.838969+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:29:10.838969+0000","last_undegraded":"2026-02-24T08:29:10.838969+0000","last_fullsized":"2026-02-24T08:29:10.838969+0000","mapping_epoch":75,"log_start":"79'6500","ondisk_log_start":"79'6500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135528448,"num_objects":2068,"num_object_clones":0,"num_object_copies":6204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16544,"num_write_kb":132352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'16984","reported_seq":17008,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:11.038912+0000","last_change":"2026-02-24T08:28:11.827608+0000","last_active":"2026-02-24T08:29:11.038912+0000","last_peered":"2026-02-24T08:29:11.038912+0000","last_clean":"2026-02-24T08:29:11.038912+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:29:11.038912+0000","last_undegraded":"2026-02-24T08:29:11.038912+0000","last_fullsized":"2026-02-24T08:29:11.038912+0000","mapping_epoch":75,"log_start":"80'6900","ondisk_log_start":"80'6900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:12.065352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139132928,"num_objects":2123,"num_object_clones":0,"num_object_copies":6369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16984,"num_write_kb":135872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'16761","reported_seq":16782,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.845512+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:29:10.845512+0000","last_peered":"2026-02-24T08:29:10.845512+0000","last_clean":"2026-02-24T08:29:10.845512+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:29:10.845512+0000","last_undegraded":"2026-02-24T08:29:10.845512+0000","last_fullsized":"2026-02-24T08:29:10.845512+0000","mapping_epoch":75,"log_start":"79'6700","ondisk_log_start":"79'6700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137306112,"num_objects":2096,"num_object_clones":0,"num_object_copies":6288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16761,"num_write_kb":134088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'16656","reported_seq":16680,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.926564+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:29:10.926564+0000","last_peered":"2026-02-24T08:29:10.926564+0000","last_clean":"2026-02-24T08:29:10.926564+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:29:10.926564+0000","last_undegraded":"2026-02-24T08:29:10.926564+0000","last_fullsized":"2026-02-24T08:29:10.926564+0000","mapping_epoch":75,"log_start":"79'6600","ondisk_log_start":"79'6600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136445952,"num_objects":2082,"num_object_clones":0,"num_object_copies":6246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2082,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16656,"num_write_kb":133248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'16192","reported_seq":16216,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.961612+0000","last_change":"2026-02-24T08:28:11.826992+0000","last_active":"2026-02-24T08:29:10.961612+0000","last_peered":"2026-02-24T08:29:10.961612+0000","last_clean":"2026-02-24T08:29:10.961612+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:29:10.961612+0000","last_undegraded":"2026-02-24T08:29:10.961612+0000","last_fullsized":"2026-02-24T08:29:10.961612+0000","mapping_epoch":75,"log_start":"79'6100","ondisk_log_start":"79'6100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:11.916258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132644864,"num_objects":2024,"num_object_clones":0,"num_object_copies":6072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16192,"num_write_kb":129536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'15932","reported_seq":15954,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.829471+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:29:10.829471+0000","last_peered":"2026-02-24T08:29:10.829471+0000","last_clean":"2026-02-24T08:29:10.829471+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:29:10.829471+0000","last_undegraded":"2026-02-24T08:29:10.829471+0000","last_fullsized":"2026-02-24T08:29:10.829471+0000","mapping_epoch":75,"log_start":"79'5900","ondisk_log_start":"79'5900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130514944,"num_objects":1992,"num_object_clones":0,"num_object_copies":5976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15932,"num_write_kb":127456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'16449","reported_seq":16466,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:10.949496+0000","last_change":"2026-02-24T08:28:11.830732+0000","last_active":"2026-02-24T08:29:10.949496+0000","last_peered":"2026-02-24T08:29:10.949496+0000","last_clean":"2026-02-24T08:29:10.949496+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:29:10.949496+0000","last_undegraded":"2026-02-24T08:29:10.949496+0000","last_fullsized":"2026-02-24T08:29:10.949496+0000","mapping_epoch":75,"log_start":"79'6400","ondisk_log_start":"79'6400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:13.395712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134750208,"num_objects":2057,"num_object_clones":0,"num_object_copies":6171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16449,"num_write_kb":131592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2178392064,"num_objects":33243,"num_object_clones":0,"num_object_copies":99729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":265917,"num_write_kb":2127336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6534610944,"data_stored":6534610944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160817,"ondisk_log_size":160817,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247916,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2543112,"kb_used_data":1330804,"kb_used_omap":16,"kb_used_meta":1212271,"kb_avail":731460088,"statfs":{"total":751619276800,"available":749015130112,"internally_reserved":0,"allocated":1362743296,"data_stored":1362222749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17022,"internal_metadata":1241365890},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,2,6,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444142,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2874048,"kb_used_data":1588140,"kb_used_omap":20,"kb_used_meta":1285867,"kb_avail":731129152,"statfs":{"total":751619276800,"available":748676251648,"internally_reserved":0,"allocated":1626255360,"data_stored":1625734813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1316728562},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,5,3,18,8,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2864420,"kb_used_data":1854992,"kb_used_omap":16,"kb_used_meta":1009391,"kb_avail":731138780,"statfs":{"total":751619276800,"available":748686110720,"internally_reserved":0,"allocated":1899511808,"data_stored":1898994813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":1033616952},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705778,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2782112,"kb_used_data":1585548,"kb_used_omap":16,"kb_used_meta":1196527,"kb_avail":731221088,"statfs":{"total":751619276800,"available":748770394112,"internally_reserved":0,"allocated":1623601152,"data_stored":1623080605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16846,"internal_metadata":1225244210},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1628774400,"data_stored":1628774400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1909145600,"data_stored":1909145600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1632780288,"data_stored":1632780288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1363910656,"data_stored":1363910656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:13.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 61 127 276121 275994 35.3437 26.2734 0.0617277 0.0282795 2026-02-24T08:29:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:14 trial105 ceph-mon[39442]: 6.c scrub ok 2026-02-24T08:29:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:14 trial105 ceph-mon[39442]: from='client.15196 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:29:14.661 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:14.816 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:14.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 62 128 279488 279360 35.1977 26.2969 0.0426585 0.0283979 2026-02-24T08:29:14.947 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:14.942+0000 7f41ff888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:14.947 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:14.942+0000 7f41ff888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:14.963 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:14.963 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:14.976 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:14.976 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:14.988 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:14.989 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:15.002 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:15.003 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:15.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:15 trial105 ceph-mon[39442]: 6.1 scrub ok 2026-02-24T08:29:15.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:15 trial105 ceph-mon[39442]: 6.4 scrub starts 2026-02-24T08:29:15.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:15 trial105 ceph-mon[39442]: pgmap v322: 17 pgs: 17 active+clean; 2.0 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.81k op/s 2026-02-24T08:29:15.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:15 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1020254132' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:15.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 63 128 282834 282706 35.0539 26.1406 0.0193664 0.0285074 2026-02-24T08:29:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:16 trial105 ceph-mon[39442]: 6.7 scrub starts 2026-02-24T08:29:16.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 64 128 286153 286025 34.9113 25.9297 0.0320205 0.0286335 2026-02-24T08:29:17.051 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:17.206 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:17.326 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:17 trial105 ceph-mon[39442]: 6.7 scrub ok 2026-02-24T08:29:17.326 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:17 trial105 ceph-mon[39442]: 6.4 scrub ok 2026-02-24T08:29:17.326 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:17 trial105 ceph-mon[39442]: pgmap v323: 17 pgs: 17 active+clean; 2.2 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.21k op/s 2026-02-24T08:29:17.340 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:17.337+0000 7fa108f0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:17.340 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:17.338+0000 7fa108f0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:17.356 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:17.357 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:17.371 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:17.371 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:17.391 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:17.392 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:17.407 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:17.407 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:17.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 65 128 289503 289375 34.7768 26.1719 0.0404795 0.0287422 2026-02-24T08:29:18.224 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:18.224 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:18.224 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:18.369 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:18.395 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1571776684' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:18.492 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:18.488+0000 7f3c24496640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:18.493 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:18.490+0000 7f3c24496640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:18.663 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:18.664 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:18.713 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2026-02-24T08:29:16.760911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2317337120,"num_objects":35354,"num_object_clones":0,"num_object_copies":106062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35354,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":282941,"num_write_kb":2264598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161005,"ondisk_log_size":161005,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11535484,"kb_used_data":6759084,"kb_used_omap":69,"kb_used_meta":4776250,"kb_avail":2924477316,"statfs":{"total":3006477107200,"available":2994664771584,"internally_reserved":0,"allocated":6921302016,"data_stored":6919223380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71458,"internal_metadata":4890880222},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,5,19,16,34,16,35,27],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":414277632,"num_objects":6317,"num_object_clones":0,"num_object_copies":18951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6317,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50571,"num_write_kb":404568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001621"},"pg_stats":[{"pgid":"6.f","version":"82'18427","reported_seq":18448,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:16.054535+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:29:16.054535+0000","last_peered":"2026-02-24T08:29:16.054535+0000","last_clean":"2026-02-24T08:29:16.054535+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:29:16.054535+0000","last_undegraded":"2026-02-24T08:29:16.054535+0000","last_fullsized":"2026-02-24T08:29:16.054535+0000","mapping_epoch":75,"log_start":"81'8400","ondisk_log_start":"81'8400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150953984,"num_objects":2304,"num_object_clones":0,"num_object_copies":6912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2304,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18427,"num_write_kb":147416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'17392","reported_seq":17416,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.876301+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:29:15.876301+0000","last_peered":"2026-02-24T08:29:15.876301+0000","last_clean":"2026-02-24T08:29:15.876301+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:29:15.876301+0000","last_undegraded":"2026-02-24T08:29:15.876301+0000","last_fullsized":"2026-02-24T08:29:15.876301+0000","mapping_epoch":75,"log_start":"80'7300","ondisk_log_start":"80'7300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142475264,"num_objects":2174,"num_object_clones":0,"num_object_copies":6522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17392,"num_write_kb":139136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'17880","reported_seq":17904,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.841981+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:29:15.841981+0000","last_peered":"2026-02-24T08:29:15.841981+0000","last_clean":"2026-02-24T08:29:15.841981+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:29:15.841981+0000","last_undegraded":"2026-02-24T08:29:15.841981+0000","last_fullsized":"2026-02-24T08:29:15.841981+0000","mapping_epoch":75,"log_start":"80'7800","ondisk_log_start":"80'7800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146472960,"num_objects":2235,"num_object_clones":0,"num_object_copies":6705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2235,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17880,"num_write_kb":143040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'17656","reported_seq":17709,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:16.026897+0000","last_change":"2026-02-24T08:29:12.932110+0000","last_active":"2026-02-24T08:29:16.026897+0000","last_peered":"2026-02-24T08:29:16.026897+0000","last_clean":"2026-02-24T08:29:16.026897+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:29:16.026897+0000","last_undegraded":"2026-02-24T08:29:16.026897+0000","last_fullsized":"2026-02-24T08:29:16.026897+0000","mapping_epoch":75,"log_start":"80'7600","ondisk_log_start":"80'7600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16960","last_scrub_stamp":"2026-02-24T08:29:12.931966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:12.931966+0000","objects_scrubbed":2108,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:24.382716+0000","scrub_duration":1222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144637952,"num_objects":2207,"num_object_clones":0,"num_object_copies":6621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2207,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17656,"num_write_kb":141248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'17432","reported_seq":17455,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:16.055182+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:29:16.055182+0000","last_peered":"2026-02-24T08:29:16.055182+0000","last_clean":"2026-02-24T08:29:16.055182+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:29:16.055182+0000","last_undegraded":"2026-02-24T08:29:16.055182+0000","last_fullsized":"2026-02-24T08:29:16.055182+0000","mapping_epoch":75,"log_start":"80'7400","ondisk_log_start":"80'7400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142802944,"num_objects":2179,"num_object_clones":0,"num_object_copies":6537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2179,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17432,"num_write_kb":139456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'17776","reported_seq":17800,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.866011+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:29:15.866011+0000","last_peered":"2026-02-24T08:29:15.866011+0000","last_clean":"2026-02-24T08:29:15.866011+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:29:15.866011+0000","last_undegraded":"2026-02-24T08:29:15.866011+0000","last_fullsized":"2026-02-24T08:29:15.866011+0000","mapping_epoch":75,"log_start":"80'7700","ondisk_log_start":"80'7700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145620992,"num_objects":2222,"num_object_clones":0,"num_object_copies":6666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17776,"num_write_kb":142208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'17712","reported_seq":17733,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.851523+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:29:15.851523+0000","last_peered":"2026-02-24T08:29:15.851523+0000","last_clean":"2026-02-24T08:29:15.851523+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:29:15.851523+0000","last_undegraded":"2026-02-24T08:29:15.851523+0000","last_fullsized":"2026-02-24T08:29:15.851523+0000","mapping_epoch":75,"log_start":"80'7700","ondisk_log_start":"80'7700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:19.698303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145096704,"num_objects":2214,"num_object_clones":0,"num_object_copies":6642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17712,"num_write_kb":141696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'17688","reported_seq":17712,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.935152+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:29:15.935152+0000","last_peered":"2026-02-24T08:29:15.935152+0000","last_clean":"2026-02-24T08:29:15.935152+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:29:15.935152+0000","last_undegraded":"2026-02-24T08:29:15.935152+0000","last_fullsized":"2026-02-24T08:29:15.935152+0000","mapping_epoch":75,"log_start":"80'7600","ondisk_log_start":"80'7600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144900096,"num_objects":2211,"num_object_clones":0,"num_object_copies":6633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2211,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17688,"num_write_kb":141504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'18184","reported_seq":18208,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:16.016562+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:29:16.016562+0000","last_peered":"2026-02-24T08:29:16.016562+0000","last_clean":"2026-02-24T08:29:16.016562+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:29:16.016562+0000","last_undegraded":"2026-02-24T08:29:16.016562+0000","last_fullsized":"2026-02-24T08:29:16.016562+0000","mapping_epoch":75,"log_start":"80'8100","ondisk_log_start":"80'8100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148963328,"num_objects":2273,"num_object_clones":0,"num_object_copies":6819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18184,"num_write_kb":145472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'17558","reported_seq":17582,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.872205+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:29:15.872205+0000","last_peered":"2026-02-24T08:29:15.872205+0000","last_clean":"2026-02-24T08:29:15.872205+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:29:15.872205+0000","last_undegraded":"2026-02-24T08:29:15.872205+0000","last_fullsized":"2026-02-24T08:29:15.872205+0000","mapping_epoch":75,"log_start":"80'7500","ondisk_log_start":"80'7500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143835136,"num_objects":2195,"num_object_clones":0,"num_object_copies":6585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17558,"num_write_kb":140464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'17984","reported_seq":18038,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:16.051980+0000","last_change":"2026-02-24T08:29:16.051980+0000","last_active":"2026-02-24T08:29:16.051980+0000","last_peered":"2026-02-24T08:29:16.051980+0000","last_clean":"2026-02-24T08:29:16.051980+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:29:16.051980+0000","last_undegraded":"2026-02-24T08:29:16.051980+0000","last_fullsized":"2026-02-24T08:29:16.051980+0000","mapping_epoch":75,"log_start":"80'7900","ondisk_log_start":"80'7900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17984","last_scrub_stamp":"2026-02-24T08:29:16.051875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:16.051875+0000","objects_scrubbed":2228,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.020725+0000","scrub_duration":1384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147324928,"num_objects":2248,"num_object_clones":0,"num_object_copies":6744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17984,"num_write_kb":143872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'17624","reported_seq":17648,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.819693+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:29:15.819693+0000","last_peered":"2026-02-24T08:29:15.819693+0000","last_clean":"2026-02-24T08:29:15.819693+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:29:15.819693+0000","last_undegraded":"2026-02-24T08:29:15.819693+0000","last_fullsized":"2026-02-24T08:29:15.819693+0000","mapping_epoch":75,"log_start":"80'7600","ondisk_log_start":"80'7600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144375808,"num_objects":2203,"num_object_clones":0,"num_object_copies":6609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17624,"num_write_kb":140992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'17712","reported_seq":17736,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.931483+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:29:15.931483+0000","last_peered":"2026-02-24T08:29:15.931483+0000","last_clean":"2026-02-24T08:29:15.931483+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:29:15.931483+0000","last_undegraded":"2026-02-24T08:29:15.931483+0000","last_fullsized":"2026-02-24T08:29:15.931483+0000","mapping_epoch":75,"log_start":"80'7700","ondisk_log_start":"80'7700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145096704,"num_objects":2214,"num_object_clones":0,"num_object_copies":6642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17712,"num_write_kb":141696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'17261","reported_seq":17312,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:16.049369+0000","last_change":"2026-02-24T08:29:14.052994+0000","last_active":"2026-02-24T08:29:16.049369+0000","last_peered":"2026-02-24T08:29:16.049369+0000","last_clean":"2026-02-24T08:29:16.049369+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:29:16.049369+0000","last_undegraded":"2026-02-24T08:29:16.049369+0000","last_fullsized":"2026-02-24T08:29:16.049369+0000","mapping_epoch":75,"log_start":"80'7200","ondisk_log_start":"80'7200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16840","last_scrub_stamp":"2026-02-24T08:29:14.052945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:14.052945+0000","objects_scrubbed":2092,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:31.241843+0000","scrub_duration":1386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141402112,"num_objects":2158,"num_object_clones":0,"num_object_copies":6474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17261,"num_write_kb":138088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'17024","reported_seq":17046,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.857187+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:29:15.857187+0000","last_peered":"2026-02-24T08:29:15.857187+0000","last_clean":"2026-02-24T08:29:15.857187+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:29:15.857187+0000","last_undegraded":"2026-02-24T08:29:15.857187+0000","last_fullsized":"2026-02-24T08:29:15.857187+0000","mapping_epoch":75,"log_start":"80'7000","ondisk_log_start":"80'7000","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139460608,"num_objects":2128,"num_object_clones":0,"num_object_copies":6384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17024,"num_write_kb":136192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'17496","reported_seq":17550,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:15.938308+0000","last_change":"2026-02-24T08:29:15.834474+0000","last_active":"2026-02-24T08:29:15.938308+0000","last_peered":"2026-02-24T08:29:15.938308+0000","last_clean":"2026-02-24T08:29:15.938308+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:29:15.938308+0000","last_undegraded":"2026-02-24T08:29:15.938308+0000","last_fullsized":"2026-02-24T08:29:15.938308+0000","mapping_epoch":75,"log_start":"80'7400","ondisk_log_start":"80'7400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17480","last_scrub_stamp":"2026-02-24T08:29:15.834411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:15.834411+0000","objects_scrubbed":2172,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:43.605376+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143327232,"num_objects":2187,"num_object_clones":0,"num_object_copies":6561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2187,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17496,"num_write_kb":139968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2316746752,"num_objects":35352,"num_object_clones":0,"num_object_copies":106056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35352,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282806,"num_write_kb":2262448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6948921344,"data_stored":6948921344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160906,"ondisk_log_size":160906,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247917,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2643568,"kb_used_data":1413212,"kb_used_omap":16,"kb_used_meta":1230319,"kb_avail":731359632,"statfs":{"total":751619276800,"available":748912263168,"internally_reserved":0,"allocated":1447129088,"data_stored":1446608541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17022,"internal_metadata":1259847042},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444143,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2990096,"kb_used_data":1686140,"kb_used_omap":20,"kb_used_meta":1303915,"kb_avail":731013104,"statfs":{"total":751619276800,"available":748557418496,"internally_reserved":0,"allocated":1726607360,"data_stored":1726086813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1335209714},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,5,3,18,8,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3000388,"kb_used_data":1972912,"kb_used_omap":16,"kb_used_meta":1027439,"kb_avail":731002812,"statfs":{"total":751619276800,"available":748546879488,"internally_reserved":0,"allocated":2020261888,"data_stored":2019744893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":1052098104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,11,4,6,8,32,27],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705779,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2901432,"kb_used_data":1686820,"kb_used_omap":16,"kb_used_meta":1214575,"kb_avail":731101768,"statfs":{"total":751619276800,"available":748648210432,"internally_reserved":0,"allocated":1727303680,"data_stored":1726783133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16846,"internal_metadata":1243725362},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,3,9,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1733525504,"data_stored":1733525504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2029723648,"data_stored":2029723648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1735057408,"data_stored":1735057408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1450614784,"data_stored":1450614784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:18.931 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 66 128 292894 292766 34.6513 26.4922 0.0104917 0.028848 2026-02-24T08:29:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:19 trial105 ceph-mon[39442]: from='client.15202 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:19 trial105 ceph-mon[39442]: pgmap v324: 17 pgs: 17 active+clean; 2.2 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.81k op/s 2026-02-24T08:29:19.456 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:19.606 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:19.731 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:19.728+0000 7f6a9de47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:19.731 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:19.729+0000 7f6a9de47640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:19.731 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:29:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:29:19] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T08:29:19.746 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:19.746 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:19.762 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:19.762 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:19.777 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:19.777 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:19.792 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:19.792 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:19.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 67 128 296298 296170 34.531 26.5938 0.0734004 0.0289475 2026-02-24T08:29:19.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:29:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:29:19.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:29:20.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:20 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2298007138' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:20.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 68 128 299678 299550 34.4115 26.4062 0.0148054 0.0290501 2026-02-24T08:29:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:21 trial105 ceph-mon[39442]: pgmap v325: 17 pgs: 17 active+clean; 2.2 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.81k op/s 2026-02-24T08:29:21.839 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:21.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 69 128 303079 302951 34.2976 26.5703 0.0368649 0.0291437 2026-02-24T08:29:21.990 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:22.211 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:22.208+0000 7f939193b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:22.211 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:22.208+0000 7f939193b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:22.228 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:22.229 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:22.243 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:22.244 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:22.257 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:22.258 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:22.272 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:22.272 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:22.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 70 128 306264 306136 34.1631 24.8828 0.0128749 0.0292605 2026-02-24T08:29:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3005054522' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:23 trial105 ceph-mon[39442]: pgmap v326: 17 pgs: 17 active+clean; 2.3 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.22k op/s 2026-02-24T08:29:23.716 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:23.716 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:23.716 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T08:29:23.716 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:23.859 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:23.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 71 128 309584 309456 34.0472 25.9375 0.0563484 0.0293564 2026-02-24T08:29:23.995 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:23.992+0000 7f80cc38c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:23.995 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:23.992+0000 7f80cc38c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:24.134 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:24.134 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:24.184 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2026-02-24T08:29:22.761774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2455527968,"num_objects":37463,"num_object_clones":0,"num_object_copies":112389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37463,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":299810,"num_write_kb":2399550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160874,"ondisk_log_size":160874,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12027332,"kb_used_data":7160692,"kb_used_omap":69,"kb_used_meta":4866490,"kb_avail":2923985468,"statfs":{"total":3006477107200,"available":2994161119232,"internally_reserved":0,"allocated":7332548608,"data_stored":7330469972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71458,"internal_metadata":4983285982},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,4,7,18,25,23],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":414523392,"num_objects":6322,"num_object_clones":0,"num_object_copies":18966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6322,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50601,"num_write_kb":404808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001729"},"pg_stats":[{"pgid":"6.f","version":"82'19431","reported_seq":19454,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:21.056731+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:29:21.056731+0000","last_peered":"2026-02-24T08:29:21.056731+0000","last_clean":"2026-02-24T08:29:21.056731+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:29:21.056731+0000","last_undegraded":"2026-02-24T08:29:21.056731+0000","last_fullsized":"2026-02-24T08:29:21.056731+0000","mapping_epoch":75,"log_start":"81'9400","ondisk_log_start":"81'9400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159178752,"num_objects":2429,"num_object_clones":0,"num_object_copies":7287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2429,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19431,"num_write_kb":155448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'18495","reported_seq":18515,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.883514+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:29:20.883514+0000","last_peered":"2026-02-24T08:29:20.883514+0000","last_clean":"2026-02-24T08:29:20.883514+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:29:20.883514+0000","last_undegraded":"2026-02-24T08:29:20.883514+0000","last_fullsized":"2026-02-24T08:29:20.883514+0000","mapping_epoch":75,"log_start":"81'8400","ondisk_log_start":"81'8400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151511040,"num_objects":2312,"num_object_clones":0,"num_object_copies":6936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18495,"num_write_kb":147960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'18840","reported_seq":18864,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.866099+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:29:20.866099+0000","last_peered":"2026-02-24T08:29:20.866099+0000","last_clean":"2026-02-24T08:29:20.866099+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:29:20.866099+0000","last_undegraded":"2026-02-24T08:29:20.866099+0000","last_fullsized":"2026-02-24T08:29:20.866099+0000","mapping_epoch":75,"log_start":"81'8800","ondisk_log_start":"81'8800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154337280,"num_objects":2355,"num_object_clones":0,"num_object_copies":7065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18840,"num_write_kb":150720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'18632","reported_seq":18683,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:21.064287+0000","last_change":"2026-02-24T08:29:12.932110+0000","last_active":"2026-02-24T08:29:21.064287+0000","last_peered":"2026-02-24T08:29:21.064287+0000","last_clean":"2026-02-24T08:29:21.064287+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:29:21.064287+0000","last_undegraded":"2026-02-24T08:29:21.064287+0000","last_fullsized":"2026-02-24T08:29:21.064287+0000","mapping_epoch":75,"log_start":"81'8600","ondisk_log_start":"81'8600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16960","last_scrub_stamp":"2026-02-24T08:29:12.931966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:12.931966+0000","objects_scrubbed":2108,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:24.382716+0000","scrub_duration":1222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152633344,"num_objects":2329,"num_object_clones":0,"num_object_copies":6987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18632,"num_write_kb":149056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'18651","reported_seq":18674,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:21.060842+0000","last_change":"2026-02-24T08:28:11.826306+0000","last_active":"2026-02-24T08:29:21.060842+0000","last_peered":"2026-02-24T08:29:21.060842+0000","last_clean":"2026-02-24T08:29:21.060842+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:29:21.060842+0000","last_undegraded":"2026-02-24T08:29:21.060842+0000","last_fullsized":"2026-02-24T08:29:21.060842+0000","mapping_epoch":75,"log_start":"81'8600","ondisk_log_start":"81'8600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.039005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152788992,"num_objects":2332,"num_object_clones":0,"num_object_copies":6996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18651,"num_write_kb":149208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'18824","reported_seq":18848,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.804334+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:29:20.804334+0000","last_peered":"2026-02-24T08:29:20.804334+0000","last_clean":"2026-02-24T08:29:20.804334+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:29:20.804334+0000","last_undegraded":"2026-02-24T08:29:20.804334+0000","last_fullsized":"2026-02-24T08:29:20.804334+0000","mapping_epoch":75,"log_start":"81'8800","ondisk_log_start":"81'8800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154206208,"num_objects":2353,"num_object_clones":0,"num_object_copies":7059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2353,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18824,"num_write_kb":150592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'18712","reported_seq":18736,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.799165+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:29:20.799165+0000","last_peered":"2026-02-24T08:29:20.799165+0000","last_clean":"2026-02-24T08:29:20.799165+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:29:20.799165+0000","last_undegraded":"2026-02-24T08:29:20.799165+0000","last_fullsized":"2026-02-24T08:29:20.799165+0000","mapping_epoch":75,"log_start":"81'8700","ondisk_log_start":"81'8700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153288704,"num_objects":2339,"num_object_clones":0,"num_object_copies":7017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2339,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18712,"num_write_kb":149696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'18640","reported_seq":18664,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.861253+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:29:20.861253+0000","last_peered":"2026-02-24T08:29:20.861253+0000","last_clean":"2026-02-24T08:29:20.861253+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:29:20.861253+0000","last_undegraded":"2026-02-24T08:29:20.861253+0000","last_fullsized":"2026-02-24T08:29:20.861253+0000","mapping_epoch":75,"log_start":"81'8600","ondisk_log_start":"81'8600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:23.343166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152698880,"num_objects":2330,"num_object_clones":0,"num_object_copies":6990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2330,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18640,"num_write_kb":149120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'19296","reported_seq":19320,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:21.058763+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:29:21.058763+0000","last_peered":"2026-02-24T08:29:21.058763+0000","last_clean":"2026-02-24T08:29:21.058763+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:29:21.058763+0000","last_undegraded":"2026-02-24T08:29:21.058763+0000","last_fullsized":"2026-02-24T08:29:21.058763+0000","mapping_epoch":75,"log_start":"81'9200","ondisk_log_start":"81'9200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158072832,"num_objects":2412,"num_object_clones":0,"num_object_copies":7236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19296,"num_write_kb":154368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'18696","reported_seq":18713,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.889657+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:29:20.889657+0000","last_peered":"2026-02-24T08:29:20.889657+0000","last_clean":"2026-02-24T08:29:20.889657+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:29:20.889657+0000","last_undegraded":"2026-02-24T08:29:20.889657+0000","last_fullsized":"2026-02-24T08:29:20.889657+0000","mapping_epoch":75,"log_start":"81'8600","ondisk_log_start":"81'8600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153157632,"num_objects":2337,"num_object_clones":0,"num_object_copies":7011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18696,"num_write_kb":149568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'19048","reported_seq":19102,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:21.032017+0000","last_change":"2026-02-24T08:29:16.051980+0000","last_active":"2026-02-24T08:29:21.032017+0000","last_peered":"2026-02-24T08:29:21.032017+0000","last_clean":"2026-02-24T08:29:21.032017+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:29:21.032017+0000","last_undegraded":"2026-02-24T08:29:21.032017+0000","last_fullsized":"2026-02-24T08:29:21.032017+0000","mapping_epoch":75,"log_start":"81'9000","ondisk_log_start":"81'9000","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17984","last_scrub_stamp":"2026-02-24T08:29:16.051875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:16.051875+0000","objects_scrubbed":2228,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.020725+0000","scrub_duration":1384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156041216,"num_objects":2381,"num_object_clones":0,"num_object_copies":7143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19048,"num_write_kb":152384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'18544","reported_seq":18568,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.830418+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:29:20.830418+0000","last_peered":"2026-02-24T08:29:20.830418+0000","last_clean":"2026-02-24T08:29:20.830418+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:29:20.830418+0000","last_undegraded":"2026-02-24T08:29:20.830418+0000","last_fullsized":"2026-02-24T08:29:20.830418+0000","mapping_epoch":75,"log_start":"81'8500","ondisk_log_start":"81'8500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151912448,"num_objects":2318,"num_object_clones":0,"num_object_copies":6954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18544,"num_write_kb":148352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'18696","reported_seq":18720,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.929858+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:29:20.929858+0000","last_peered":"2026-02-24T08:29:20.929858+0000","last_clean":"2026-02-24T08:29:20.929858+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:29:20.929858+0000","last_undegraded":"2026-02-24T08:29:20.929858+0000","last_fullsized":"2026-02-24T08:29:20.929858+0000","mapping_epoch":75,"log_start":"81'8600","ondisk_log_start":"81'8600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153157632,"num_objects":2337,"num_object_clones":0,"num_object_copies":7011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18696,"num_write_kb":149568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'18304","reported_seq":18357,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.955016+0000","last_change":"2026-02-24T08:29:14.052994+0000","last_active":"2026-02-24T08:29:20.955016+0000","last_peered":"2026-02-24T08:29:20.955016+0000","last_clean":"2026-02-24T08:29:20.955016+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:29:20.955016+0000","last_undegraded":"2026-02-24T08:29:20.955016+0000","last_fullsized":"2026-02-24T08:29:20.955016+0000","mapping_epoch":75,"log_start":"81'8300","ondisk_log_start":"81'8300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16840","last_scrub_stamp":"2026-02-24T08:29:14.052945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:14.052945+0000","objects_scrubbed":2092,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:31.241843+0000","scrub_duration":1386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149946368,"num_objects":2288,"num_object_clones":0,"num_object_copies":6864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18304,"num_write_kb":146432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'18146","reported_seq":18159,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.871814+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:29:20.871814+0000","last_peered":"2026-02-24T08:29:20.871814+0000","last_clean":"2026-02-24T08:29:20.871814+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:29:20.871814+0000","last_undegraded":"2026-02-24T08:29:20.871814+0000","last_fullsized":"2026-02-24T08:29:20.871814+0000","mapping_epoch":75,"log_start":"81'8100","ondisk_log_start":"81'8100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:25.653061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148652032,"num_objects":2269,"num_object_clones":0,"num_object_copies":6807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2269,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18146,"num_write_kb":145168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'18720","reported_seq":18763,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:20.963057+0000","last_change":"2026-02-24T08:29:15.834474+0000","last_active":"2026-02-24T08:29:20.963057+0000","last_peered":"2026-02-24T08:29:20.963057+0000","last_clean":"2026-02-24T08:29:20.963057+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:29:20.963057+0000","last_undegraded":"2026-02-24T08:29:20.963057+0000","last_fullsized":"2026-02-24T08:29:20.963057+0000","mapping_epoch":75,"log_start":"81'8700","ondisk_log_start":"81'8700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17480","last_scrub_stamp":"2026-02-24T08:29:15.834411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:15.834411+0000","objects_scrubbed":2172,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:43.605376+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153354240,"num_objects":2340,"num_object_clones":0,"num_object_copies":7020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18720,"num_write_kb":149760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2454937600,"num_objects":37461,"num_object_clones":0,"num_object_copies":112383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37461,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299675,"num_write_kb":2397400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7363977216,"data_stored":7363977216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160775,"ondisk_log_size":160775,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247918,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2728312,"kb_used_data":1497956,"kb_used_omap":16,"kb_used_meta":1230319,"kb_avail":731274888,"statfs":{"total":751619276800,"available":748825485312,"internally_reserved":0,"allocated":1533906944,"data_stored":1533386397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17022,"internal_metadata":1259847042},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444144,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3145136,"kb_used_data":1787036,"kb_used_omap":20,"kb_used_meta":1358059,"kb_avail":730858064,"statfs":{"total":751619276800,"available":748398657536,"internally_reserved":0,"allocated":1829924864,"data_stored":1829404317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1390653170},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1,12,9,14],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3135524,"kb_used_data":2090000,"kb_used_omap":16,"kb_used_meta":1045487,"kb_avail":730867676,"statfs":{"total":751619276800,"available":748408500224,"internally_reserved":0,"allocated":2140160000,"data_stored":2139643005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":1070579256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705780,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3018360,"kb_used_data":1785700,"kb_used_omap":16,"kb_used_meta":1232623,"kb_avail":730984840,"statfs":{"total":751619276800,"available":748528476160,"internally_reserved":0,"allocated":1828556800,"data_stored":1828036253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16846,"internal_metadata":1262206514},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2,6,6,16,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1836228608,"data_stored":1836228608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2151186432,"data_stored":2151186432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1839398912,"data_stored":1839398912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1537163264,"data_stored":1537163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:24.186 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:29:24.186 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 46 2026-02-24T08:29:24.320 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:24.336 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:24.343 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:24 trial105 ceph-mon[39442]: 6.b scrub starts 2026-02-24T08:29:24.472 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:24.476 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:24.473+0000 7fae126eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:24.479 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:24.477+0000 7fae126eb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:24.604 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:24.601+0000 7f7c9d067640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:24.604 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:24.601+0000 7f7c9d067640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:24.622 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:24.623 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:24.636 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:24.636 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:24.636 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:29:24.650 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:24.650 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:24.663 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:24.664 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:24.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:29:24.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 72 128 312677 312549 33.91 24.1641 0.01895 0.0294733 2026-02-24T08:29:25.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:25 trial105 ceph-mon[39442]: from='client.15208 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:25.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:25 trial105 ceph-mon[39442]: 6.b scrub ok 2026-02-24T08:29:25.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1434652308' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:25.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1246884123' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T08:29:25.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:25 trial105 ceph-mon[39442]: pgmap v327: 17 pgs: 17 active+clean; 2.3 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.81k op/s 2026-02-24T08:29:25.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 73 128 315987 315859 33.7996 25.8594 0.0288718 0.0295684 2026-02-24T08:29:26.708 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:26.867 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:26.932 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 74 128 319345 319217 33.6974 26.2344 0.0244182 0.0296636 2026-02-24T08:29:26.996 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:26.992+0000 7fd5a3e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:26.996 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:26.992+0000 7fd5a3e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:27.012 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:27.013 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:27.025 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:27.026 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:27.038 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:27.039 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:27.053 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:27.054 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:27.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 75 128 322588 322460 33.5859 25.3359 0.020114 0.029756 2026-02-24T08:29:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:27 trial105 ceph-mon[39442]: 6.9 scrub starts 2026-02-24T08:29:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:27 trial105 ceph-mon[39442]: 6.8 scrub starts 2026-02-24T08:29:28.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:27 trial105 ceph-mon[39442]: pgmap v328: 17 pgs: 17 active+clean; 2.4 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.18k op/s 2026-02-24T08:29:28.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4056442917' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:28.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:27 trial105 ceph-mon[39442]: 6.8 scrub ok 2026-02-24T08:29:28.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 76 127 325907 325780 33.4851 25.9375 0.0742239 0.0298532 2026-02-24T08:29:29.100 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:29.127 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:28 trial105 ceph-mon[39442]: 6.9 scrub ok 2026-02-24T08:29:29.127 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:28 trial105 ceph-mon[39442]: 6.0 scrub starts 2026-02-24T08:29:29.127 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:28 trial105 ceph-mon[39442]: 6.0 scrub ok 2026-02-24T08:29:29.127 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:28 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:29:29.127 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:28 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:29:29.249 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:29.369 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:29.367+0000 7f6a98ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:29.370 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:29.367+0000 7f6a98ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:29.390 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:29.390 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:29.406 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:29.406 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:29.419 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:29.420 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:29.433 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:29.434 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:29.682 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:29.682 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:29.682 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T08:29:29.683 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:29.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:29:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:29:29] "GET /metrics HTTP/1.1" 200 4199 "" "Prometheus/3.6.0" 2026-02-24T08:29:29.832 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:29.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 77 128 329151 329023 33.3792 25.3359 0.0180604 0.0299476 2026-02-24T08:29:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:29:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:29:29.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:29:29.960 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:29.957+0000 7f796bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:29.960 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:29.957+0000 7f796bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:29.960 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:29 trial105 ceph-mon[39442]: pgmap v329: 17 pgs: 17 active+clean; 2.4 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.77k op/s 2026-02-24T08:29:29.960 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:29:29.960 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3595963159' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:30.100 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:30.100 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:30.150 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2026-02-24T08:29:28.762673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2589966880,"num_objects":39515,"num_object_clones":0,"num_object_copies":118545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39515,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":316221,"num_write_kb":2530838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160885,"ondisk_log_size":160885,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12491620,"kb_used_data":7552788,"kb_used_omap":69,"kb_used_meta":4938682,"kb_avail":2923521180,"statfs":{"total":3006477107200,"available":2993685688320,"internally_reserved":0,"allocated":7734054912,"data_stored":7731976276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":71458,"internal_metadata":5057210590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272629760,"num_objects":4161,"num_object_clones":0,"num_object_copies":12483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33280,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001761"},"pg_stats":[{"pgid":"6.f","version":"82'20446","reported_seq":20469,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:26.092291+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:29:26.092291+0000","last_peered":"2026-02-24T08:29:26.092291+0000","last_clean":"2026-02-24T08:29:26.092291+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:29:26.092291+0000","last_undegraded":"2026-02-24T08:29:26.092291+0000","last_fullsized":"2026-02-24T08:29:26.092291+0000","mapping_epoch":75,"log_start":"82'10400","ondisk_log_start":"82'10400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:27.392050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167493632,"num_objects":2556,"num_object_clones":0,"num_object_copies":7668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20446,"num_write_kb":163568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'19648","reported_seq":19672,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.901746+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:29:25.901746+0000","last_peered":"2026-02-24T08:29:25.901746+0000","last_clean":"2026-02-24T08:29:25.901746+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:29:25.901746+0000","last_undegraded":"2026-02-24T08:29:25.901746+0000","last_fullsized":"2026-02-24T08:29:25.901746+0000","mapping_epoch":75,"log_start":"82'9600","ondisk_log_start":"82'9600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160956416,"num_objects":2456,"num_object_clones":0,"num_object_copies":7368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2456,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19648,"num_write_kb":157184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'19869","reported_seq":19888,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.899818+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:29:25.899818+0000","last_peered":"2026-02-24T08:29:25.899818+0000","last_clean":"2026-02-24T08:29:25.899818+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:29:25.899818+0000","last_undegraded":"2026-02-24T08:29:25.899818+0000","last_fullsized":"2026-02-24T08:29:25.899818+0000","mapping_epoch":75,"log_start":"82'9800","ondisk_log_start":"82'9800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162766848,"num_objects":2484,"num_object_clones":0,"num_object_copies":7452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19869,"num_write_kb":158952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'19504","reported_seq":19557,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:26.080825+0000","last_change":"2026-02-24T08:29:12.932110+0000","last_active":"2026-02-24T08:29:26.080825+0000","last_peered":"2026-02-24T08:29:26.080825+0000","last_clean":"2026-02-24T08:29:26.080825+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:29:26.080825+0000","last_undegraded":"2026-02-24T08:29:26.080825+0000","last_fullsized":"2026-02-24T08:29:26.080825+0000","mapping_epoch":75,"log_start":"81'9500","ondisk_log_start":"81'9500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16960","last_scrub_stamp":"2026-02-24T08:29:12.931966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:12.931966+0000","objects_scrubbed":2108,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:24.382716+0000","scrub_duration":1222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159776768,"num_objects":2438,"num_object_clones":0,"num_object_copies":7314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19504,"num_write_kb":156032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'19623","reported_seq":19678,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:26.096448+0000","last_change":"2026-02-24T08:29:24.422069+0000","last_active":"2026-02-24T08:29:26.096448+0000","last_peered":"2026-02-24T08:29:26.096448+0000","last_clean":"2026-02-24T08:29:26.096448+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:29:26.096448+0000","last_undegraded":"2026-02-24T08:29:26.096448+0000","last_fullsized":"2026-02-24T08:29:26.096448+0000","mapping_epoch":75,"log_start":"82'9600","ondisk_log_start":"82'9600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19368","last_scrub_stamp":"2026-02-24T08:29:24.421959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:24.421959+0000","objects_scrubbed":2409,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.721826+0000","scrub_duration":803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160751616,"num_objects":2453,"num_object_clones":0,"num_object_copies":7359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19623,"num_write_kb":156984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'19760","reported_seq":19784,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.850996+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:29:25.850996+0000","last_peered":"2026-02-24T08:29:25.850996+0000","last_clean":"2026-02-24T08:29:25.850996+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:29:25.850996+0000","last_undegraded":"2026-02-24T08:29:25.850996+0000","last_fullsized":"2026-02-24T08:29:25.850996+0000","mapping_epoch":75,"log_start":"82'9700","ondisk_log_start":"82'9700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161873920,"num_objects":2470,"num_object_clones":0,"num_object_copies":7410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19760,"num_write_kb":158080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'19832","reported_seq":19856,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.837098+0000","last_change":"2026-02-24T08:28:11.827287+0000","last_active":"2026-02-24T08:29:25.837098+0000","last_peered":"2026-02-24T08:29:25.837098+0000","last_clean":"2026-02-24T08:29:25.837098+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:29:25.837098+0000","last_undegraded":"2026-02-24T08:29:25.837098+0000","last_fullsized":"2026-02-24T08:29:25.837098+0000","mapping_epoch":75,"log_start":"82'9800","ondisk_log_start":"82'9800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162463744,"num_objects":2479,"num_object_clones":0,"num_object_copies":7437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19832,"num_write_kb":158656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'19574","reported_seq":19595,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.958365+0000","last_change":"2026-02-24T08:28:11.828623+0000","last_active":"2026-02-24T08:29:25.958365+0000","last_peered":"2026-02-24T08:29:25.958365+0000","last_clean":"2026-02-24T08:29:25.958365+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:29:25.958365+0000","last_undegraded":"2026-02-24T08:29:25.958365+0000","last_fullsized":"2026-02-24T08:29:25.958365+0000","mapping_epoch":75,"log_start":"82'9500","ondisk_log_start":"82'9500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160350208,"num_objects":2447,"num_object_clones":0,"num_object_copies":7341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19574,"num_write_kb":156592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'20286","reported_seq":20305,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:26.100748+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:29:26.100748+0000","last_peered":"2026-02-24T08:29:26.100748+0000","last_clean":"2026-02-24T08:29:26.100748+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:29:26.100748+0000","last_undegraded":"2026-02-24T08:29:26.100748+0000","last_fullsized":"2026-02-24T08:29:26.100748+0000","mapping_epoch":75,"log_start":"82'10200","ondisk_log_start":"82'10200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166182912,"num_objects":2536,"num_object_clones":0,"num_object_copies":7608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20286,"num_write_kb":162288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'19592","reported_seq":19616,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.865072+0000","last_change":"2026-02-24T08:28:11.829335+0000","last_active":"2026-02-24T08:29:25.865072+0000","last_peered":"2026-02-24T08:29:25.865072+0000","last_clean":"2026-02-24T08:29:25.865072+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:29:25.865072+0000","last_undegraded":"2026-02-24T08:29:25.865072+0000","last_fullsized":"2026-02-24T08:29:25.865072+0000","mapping_epoch":75,"log_start":"82'9500","ondisk_log_start":"82'9500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:26.975270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160497664,"num_objects":2449,"num_object_clones":0,"num_object_copies":7347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19592,"num_write_kb":156736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'20104","reported_seq":20158,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:26.094369+0000","last_change":"2026-02-24T08:29:16.051980+0000","last_active":"2026-02-24T08:29:26.094369+0000","last_peered":"2026-02-24T08:29:26.094369+0000","last_clean":"2026-02-24T08:29:26.094369+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:29:26.094369+0000","last_undegraded":"2026-02-24T08:29:26.094369+0000","last_fullsized":"2026-02-24T08:29:26.094369+0000","mapping_epoch":75,"log_start":"82'10100","ondisk_log_start":"82'10100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17984","last_scrub_stamp":"2026-02-24T08:29:16.051875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:16.051875+0000","objects_scrubbed":2228,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.020725+0000","scrub_duration":1384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164691968,"num_objects":2513,"num_object_clones":0,"num_object_copies":7539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20104,"num_write_kb":160832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'19758","reported_seq":19778,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.896515+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:29:25.896515+0000","last_peered":"2026-02-24T08:29:25.896515+0000","last_clean":"2026-02-24T08:29:25.896515+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:29:25.896515+0000","last_undegraded":"2026-02-24T08:29:25.896515+0000","last_fullsized":"2026-02-24T08:29:25.896515+0000","mapping_epoch":75,"log_start":"82'9700","ondisk_log_start":"82'9700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161857536,"num_objects":2470,"num_object_clones":0,"num_object_copies":7410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19758,"num_write_kb":158064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'19840","reported_seq":19855,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.964738+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:29:25.964738+0000","last_peered":"2026-02-24T08:29:25.964738+0000","last_clean":"2026-02-24T08:29:25.964738+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:29:25.964738+0000","last_undegraded":"2026-02-24T08:29:25.964738+0000","last_fullsized":"2026-02-24T08:29:25.964738+0000","mapping_epoch":75,"log_start":"82'9800","ondisk_log_start":"82'9800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162529280,"num_objects":2480,"num_object_clones":0,"num_object_copies":7440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2480,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19840,"num_write_kb":158720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'19460","reported_seq":19511,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:26.093479+0000","last_change":"2026-02-24T08:29:14.052994+0000","last_active":"2026-02-24T08:29:26.093479+0000","last_peered":"2026-02-24T08:29:26.093479+0000","last_clean":"2026-02-24T08:29:26.093479+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:29:26.093479+0000","last_undegraded":"2026-02-24T08:29:26.093479+0000","last_fullsized":"2026-02-24T08:29:26.093479+0000","mapping_epoch":75,"log_start":"82'9400","ondisk_log_start":"82'9400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16840","last_scrub_stamp":"2026-02-24T08:29:14.052945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:14.052945+0000","objects_scrubbed":2092,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:31.241843+0000","scrub_duration":1386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159416320,"num_objects":2433,"num_object_clones":0,"num_object_copies":7299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2433,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19460,"num_write_kb":155680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'19302","reported_seq":19321,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.884905+0000","last_change":"2026-02-24T08:28:11.827219+0000","last_active":"2026-02-24T08:29:25.884905+0000","last_peered":"2026-02-24T08:29:25.884905+0000","last_clean":"2026-02-24T08:29:25.884905+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:29:25.884905+0000","last_undegraded":"2026-02-24T08:29:25.884905+0000","last_fullsized":"2026-02-24T08:29:25.884905+0000","mapping_epoch":75,"log_start":"82'9300","ondisk_log_start":"82'9300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158121984,"num_objects":2413,"num_object_clones":0,"num_object_copies":7239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2413,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19302,"num_write_kb":154416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'19488","reported_seq":19542,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:25.859823+0000","last_change":"2026-02-24T08:29:15.834474+0000","last_active":"2026-02-24T08:29:25.859823+0000","last_peered":"2026-02-24T08:29:25.859823+0000","last_clean":"2026-02-24T08:29:25.859823+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:29:25.859823+0000","last_undegraded":"2026-02-24T08:29:25.859823+0000","last_fullsized":"2026-02-24T08:29:25.859823+0000","mapping_epoch":75,"log_start":"82'9400","ondisk_log_start":"82'9400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17480","last_scrub_stamp":"2026-02-24T08:29:15.834411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:15.834411+0000","objects_scrubbed":2172,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:43.605376+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159645696,"num_objects":2436,"num_object_clones":0,"num_object_copies":7308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2436,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19488,"num_write_kb":155904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2589376512,"num_objects":39513,"num_object_clones":0,"num_object_copies":118539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316086,"num_write_kb":2528688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7767056384,"data_stored":7767056384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160786,"ondisk_log_size":160786,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247919,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2826544,"kb_used_data":1578140,"kb_used_omap":16,"kb_used_meta":1248367,"kb_avail":731176656,"statfs":{"total":751619276800,"available":748724895744,"internally_reserved":0,"allocated":1616015360,"data_stored":1615494813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17022,"internal_metadata":1278328194},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444145,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3262352,"kb_used_data":1886204,"kb_used_omap":20,"kb_used_meta":1376107,"kb_avail":730740848,"statfs":{"total":751619276800,"available":748278628352,"internally_reserved":0,"allocated":1931472896,"data_stored":1930952349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1409134322},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3266540,"kb_used_data":2202968,"kb_used_omap":16,"kb_used_meta":1063535,"kb_avail":730736660,"statfs":{"total":751619276800,"available":748274339840,"internally_reserved":0,"allocated":2255839232,"data_stored":2255322237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":1089060408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705781,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3136184,"kb_used_data":1885476,"kb_used_omap":16,"kb_used_meta":1250671,"kb_avail":730867016,"statfs":{"total":751619276800,"available":748407824384,"internally_reserved":0,"allocated":1930727424,"data_stored":1930206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16846,"internal_metadata":1280687666},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6217,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1937719296,"data_stored":1937719296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2268889088,"data_stored":2268889088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1939873792,"data_stored":1939873792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1620574208,"data_stored":1620574208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:30.152 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:29:30.152 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 56 2026-02-24T08:29:30.345 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:30.478 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:30.475+0000 7fa6b7066640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:30.478 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:30.476+0000 7fa6b7066640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:30.632 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:29:30.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:29:30.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 78 128 332405 332277 33.2772 25.4219 0.0281692 0.0300391 2026-02-24T08:29:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:30 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:29:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:30 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:29:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:30 trial105 ceph-mon[39442]: 6.5 scrub starts 2026-02-24T08:29:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2682051364' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T08:29:31.483 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:31.641 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:31.778 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:31.775+0000 7f4d5eaeb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:31.778 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:31.775+0000 7f4d5eaeb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:31.795 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:31.795 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:31.809 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:31.809 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:31.825 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:31.825 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:31.841 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:31.841 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:31.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 79 128 335666 335538 33.1784 25.4766 0.123542 0.0301205 2026-02-24T08:29:32.166 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:31 trial105 ceph-mon[39442]: from='client.15218 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:32.166 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:31 trial105 ceph-mon[39442]: pgmap v330: 17 pgs: 17 active+clean; 2.4 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.77k op/s 2026-02-24T08:29:32.167 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:31 trial105 ceph-mon[39442]: 6.5 scrub ok 2026-02-24T08:29:32.167 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:31 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/191168493' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:32.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:29:32.932066+0000 min lat: 0.00104297 max lat: 0.259833 avg lat: 0.0302439 2026-02-24T08:29:32.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:29:32.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 80 128 338550 338422 33.0453 22.5312 0.0149848 0.0302439 2026-02-24T08:29:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:33 trial105 ceph-mon[39442]: 6.3 scrub starts 2026-02-24T08:29:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:33 trial105 ceph-mon[39442]: pgmap v331: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.5 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.14k op/s 2026-02-24T08:29:33.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 81 128 341896 341768 32.96 26.1406 0.0541891 0.0303289 2026-02-24T08:29:34.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:34 trial105 ceph-mon[39442]: 6.3 scrub ok 2026-02-24T08:29:34.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:34 trial105 ceph-mon[39442]: 6.f scrub starts 2026-02-24T08:29:34.516 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:34.666 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:34.804 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:34.801+0000 7f26380bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:34.804 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:34.802+0000 7f26380bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:34.819 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:34.819 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:34.833 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:34.833 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:34.847 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:34.847 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:34.862 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:34.862 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:34.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 82 128 345185 345057 32.8714 25.6953 0.0642923 0.0304071 2026-02-24T08:29:35.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:35 trial105 ceph-mon[39442]: 6.f scrub ok 2026-02-24T08:29:35.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:35 trial105 ceph-mon[39442]: pgmap v332: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.5 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.74k op/s 2026-02-24T08:29:35.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3821600944' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:35.674 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:35.674 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:35.674 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_4 2026-02-24T08:29:35.675 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:35.825 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:35.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 83 128 348531 348403 32.7903 26.1406 0.0736971 0.0304868 2026-02-24T08:29:35.961 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:35.959+0000 7f1cee760640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:35.961 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:35.959+0000 7f1cee760640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:36.118 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:36.118 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:36.165 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2026-02-24T08:29:34.763576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2724553248,"num_objects":41569,"num_object_clones":0,"num_object_copies":124707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41569,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":332650,"num_write_kb":2662270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160714,"ondisk_log_size":160714,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12992820,"kb_used_data":7945700,"kb_used_omap":71,"kb_used_meta":5046968,"kb_avail":2923019980,"statfs":{"total":3006477107200,"available":2993172459520,"internally_reserved":0,"allocated":8136396800,"data_stored":8134318164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72768,"internal_metadata":5168096192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":269025280,"num_objects":4106,"num_object_clones":0,"num_object_copies":12318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32840,"num_write_kb":262720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001802"},"pg_stats":[{"pgid":"6.f","version":"82'21620","reported_seq":21644,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:31.060239+0000","last_change":"2026-02-24T08:28:11.827720+0000","last_active":"2026-02-24T08:29:31.060239+0000","last_peered":"2026-02-24T08:29:31.060239+0000","last_clean":"2026-02-24T08:29:31.060239+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:29:31.060239+0000","last_undegraded":"2026-02-24T08:29:31.060239+0000","last_fullsized":"2026-02-24T08:29:31.060239+0000","mapping_epoch":75,"log_start":"82'11600","ondisk_log_start":"82'11600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177111040,"num_objects":2703,"num_object_clones":0,"num_object_copies":8109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2703,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21620,"num_write_kb":172960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'20584","reported_seq":20608,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:30.808265+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:29:30.808265+0000","last_peered":"2026-02-24T08:29:30.808265+0000","last_clean":"2026-02-24T08:29:30.808265+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:29:30.808265+0000","last_undegraded":"2026-02-24T08:29:30.808265+0000","last_fullsized":"2026-02-24T08:29:30.808265+0000","mapping_epoch":75,"log_start":"82'10500","ondisk_log_start":"82'10500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168624128,"num_objects":2573,"num_object_clones":0,"num_object_copies":7719,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2573,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20584,"num_write_kb":164672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'21152","reported_seq":21176,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:30.897056+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:29:30.897056+0000","last_peered":"2026-02-24T08:29:30.897056+0000","last_clean":"2026-02-24T08:29:30.897056+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:29:30.897056+0000","last_undegraded":"2026-02-24T08:29:30.897056+0000","last_fullsized":"2026-02-24T08:29:30.897056+0000","mapping_epoch":75,"log_start":"82'11100","ondisk_log_start":"82'11100","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173277184,"num_objects":2644,"num_object_clones":0,"num_object_copies":7932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2644,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21152,"num_write_kb":169216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'20549","reported_seq":20601,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:31.114525+0000","last_change":"2026-02-24T08:29:12.932110+0000","last_active":"2026-02-24T08:29:31.114525+0000","last_peered":"2026-02-24T08:29:31.114525+0000","last_clean":"2026-02-24T08:29:31.114525+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:29:31.114525+0000","last_undegraded":"2026-02-24T08:29:31.114525+0000","last_fullsized":"2026-02-24T08:29:31.114525+0000","mapping_epoch":75,"log_start":"82'10500","ondisk_log_start":"82'10500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16960","last_scrub_stamp":"2026-02-24T08:29:12.931966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:12.931966+0000","objects_scrubbed":2108,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:24.382716+0000","scrub_duration":1222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168337408,"num_objects":2569,"num_object_clones":0,"num_object_copies":7707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20549,"num_write_kb":164392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'20656","reported_seq":20712,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:31.095627+0000","last_change":"2026-02-24T08:29:24.422069+0000","last_active":"2026-02-24T08:29:31.095627+0000","last_peered":"2026-02-24T08:29:31.095627+0000","last_clean":"2026-02-24T08:29:31.095627+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:29:31.095627+0000","last_undegraded":"2026-02-24T08:29:31.095627+0000","last_fullsized":"2026-02-24T08:29:31.095627+0000","mapping_epoch":75,"log_start":"82'10600","ondisk_log_start":"82'10600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19368","last_scrub_stamp":"2026-02-24T08:29:24.421959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:24.421959+0000","objects_scrubbed":2409,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.721826+0000","scrub_duration":803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169213952,"num_objects":2582,"num_object_clones":0,"num_object_copies":7746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2582,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20656,"num_write_kb":165248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'20901","reported_seq":20922,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:30.910320+0000","last_change":"2026-02-24T08:28:11.828027+0000","last_active":"2026-02-24T08:29:30.910320+0000","last_peered":"2026-02-24T08:29:30.910320+0000","last_clean":"2026-02-24T08:29:30.910320+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:29:30.910320+0000","last_undegraded":"2026-02-24T08:29:30.910320+0000","last_fullsized":"2026-02-24T08:29:30.910320+0000","mapping_epoch":75,"log_start":"82'10900","ondisk_log_start":"82'10900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:32.056905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171220992,"num_objects":2613,"num_object_clones":0,"num_object_copies":7839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2613,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20901,"num_write_kb":167208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'20875","reported_seq":20932,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:30.889953+0000","last_change":"2026-02-24T08:29:27.144539+0000","last_active":"2026-02-24T08:29:30.889953+0000","last_peered":"2026-02-24T08:29:30.889953+0000","last_clean":"2026-02-24T08:29:30.889953+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:29:30.889953+0000","last_undegraded":"2026-02-24T08:29:30.889953+0000","last_fullsized":"2026-02-24T08:29:30.889953+0000","mapping_epoch":75,"log_start":"82'10800","ondisk_log_start":"82'10800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'20080","last_scrub_stamp":"2026-02-24T08:29:27.144503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.144503+0000","objects_scrubbed":2504,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:51.900672+0000","scrub_duration":664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171008000,"num_objects":2610,"num_object_clones":0,"num_object_copies":7830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20875,"num_write_kb":167000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'20408","reported_seq":20464,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:30.933874+0000","last_change":"2026-02-24T08:29:27.170789+0000","last_active":"2026-02-24T08:29:30.933874+0000","last_peered":"2026-02-24T08:29:30.933874+0000","last_clean":"2026-02-24T08:29:30.933874+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:29:30.933874+0000","last_undegraded":"2026-02-24T08:29:30.933874+0000","last_fullsized":"2026-02-24T08:29:30.933874+0000","mapping_epoch":75,"log_start":"82'10400","ondisk_log_start":"82'10400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19824","last_scrub_stamp":"2026-02-24T08:29:27.170707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.170707+0000","objects_scrubbed":2471,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:41.632243+0000","scrub_duration":523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167182336,"num_objects":2551,"num_object_clones":0,"num_object_copies":7653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20408,"num_write_kb":163264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'21208","reported_seq":21232,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:31.101257+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:29:31.101257+0000","last_peered":"2026-02-24T08:29:31.101257+0000","last_clean":"2026-02-24T08:29:31.101257+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:29:31.101257+0000","last_undegraded":"2026-02-24T08:29:31.101257+0000","last_fullsized":"2026-02-24T08:29:31.101257+0000","mapping_epoch":75,"log_start":"82'11200","ondisk_log_start":"82'11200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173735936,"num_objects":2651,"num_object_clones":0,"num_object_copies":7953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21208,"num_write_kb":169664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'20536","reported_seq":20573,"reported_epoch":82,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:29:30.928130+0000","last_change":"2026-02-24T08:29:30.448165+0000","last_active":"2026-02-24T08:29:30.928130+0000","last_peered":"2026-02-24T08:29:30.928130+0000","last_clean":"2026-02-24T08:29:30.928130+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:29:30.928130+0000","last_undegraded":"2026-02-24T08:29:30.928130+0000","last_fullsized":"2026-02-24T08:29:30.928130+0000","mapping_epoch":75,"log_start":"82'10500","ondisk_log_start":"82'10500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":1099,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168230912,"num_objects":2567,"num_object_clones":0,"num_object_copies":7701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2567,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20536,"num_write_kb":164288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'21072","reported_seq":21126,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:31.033938+0000","last_change":"2026-02-24T08:29:16.051980+0000","last_active":"2026-02-24T08:29:31.033938+0000","last_peered":"2026-02-24T08:29:31.033938+0000","last_clean":"2026-02-24T08:29:31.033938+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:29:31.033938+0000","last_undegraded":"2026-02-24T08:29:31.033938+0000","last_fullsized":"2026-02-24T08:29:31.033938+0000","mapping_epoch":75,"log_start":"82'11000","ondisk_log_start":"82'11000","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17984","last_scrub_stamp":"2026-02-24T08:29:16.051875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:16.051875+0000","objects_scrubbed":2228,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.020725+0000","scrub_duration":1384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172621824,"num_objects":2634,"num_object_clones":0,"num_object_copies":7902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21072,"num_write_kb":168576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'20848","reported_seq":20872,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:30.906242+0000","last_change":"2026-02-24T08:28:11.829503+0000","last_active":"2026-02-24T08:29:30.906242+0000","last_peered":"2026-02-24T08:29:30.906242+0000","last_clean":"2026-02-24T08:29:30.906242+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:29:30.906242+0000","last_undegraded":"2026-02-24T08:29:30.906242+0000","last_fullsized":"2026-02-24T08:29:30.906242+0000","mapping_epoch":75,"log_start":"82'10800","ondisk_log_start":"82'10800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:31.290787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170786816,"num_objects":2606,"num_object_clones":0,"num_object_copies":7818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2606,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20848,"num_write_kb":166784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'20912","reported_seq":20935,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:30.979379+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:29:30.979379+0000","last_peered":"2026-02-24T08:29:30.979379+0000","last_clean":"2026-02-24T08:29:30.979379+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:29:30.979379+0000","last_undegraded":"2026-02-24T08:29:30.979379+0000","last_fullsized":"2026-02-24T08:29:30.979379+0000","mapping_epoch":75,"log_start":"82'10900","ondisk_log_start":"82'10900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:35.170272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171311104,"num_objects":2614,"num_object_clones":0,"num_object_copies":7842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20912,"num_write_kb":167296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'20426","reported_seq":20479,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:31.116375+0000","last_change":"2026-02-24T08:29:14.052994+0000","last_active":"2026-02-24T08:29:31.116375+0000","last_peered":"2026-02-24T08:29:31.116375+0000","last_clean":"2026-02-24T08:29:31.116375+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:29:31.116375+0000","last_undegraded":"2026-02-24T08:29:31.116375+0000","last_fullsized":"2026-02-24T08:29:31.116375+0000","mapping_epoch":75,"log_start":"82'10400","ondisk_log_start":"82'10400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16840","last_scrub_stamp":"2026-02-24T08:29:14.052945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:14.052945+0000","objects_scrubbed":2092,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:31.241843+0000","scrub_duration":1386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167329792,"num_objects":2554,"num_object_clones":0,"num_object_copies":7662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20426,"num_write_kb":163408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'20248","reported_seq":20304,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:30.841854+0000","last_change":"2026-02-24T08:29:27.818853+0000","last_active":"2026-02-24T08:29:30.841854+0000","last_peered":"2026-02-24T08:29:30.841854+0000","last_clean":"2026-02-24T08:29:30.841854+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:29:30.841854+0000","last_undegraded":"2026-02-24T08:29:30.841854+0000","last_fullsized":"2026-02-24T08:29:30.841854+0000","mapping_epoch":75,"log_start":"82'10200","ondisk_log_start":"82'10200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19592","last_scrub_stamp":"2026-02-24T08:29:27.818810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.818810+0000","objects_scrubbed":2449,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:30.750603+0000","scrub_duration":383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165871616,"num_objects":2531,"num_object_clones":0,"num_object_copies":7593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2531,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20248,"num_write_kb":161984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'20520","reported_seq":20574,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:30.944159+0000","last_change":"2026-02-24T08:29:15.834474+0000","last_active":"2026-02-24T08:29:30.944159+0000","last_peered":"2026-02-24T08:29:30.944159+0000","last_clean":"2026-02-24T08:29:30.944159+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:29:30.944159+0000","last_undegraded":"2026-02-24T08:29:30.944159+0000","last_fullsized":"2026-02-24T08:29:30.944159+0000","mapping_epoch":75,"log_start":"82'10500","ondisk_log_start":"82'10500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17480","last_scrub_stamp":"2026-02-24T08:29:15.834411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:15.834411+0000","objects_scrubbed":2172,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:43.605376+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168099840,"num_objects":2565,"num_object_clones":0,"num_object_copies":7695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20520,"num_write_kb":164160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2723962880,"num_objects":41567,"num_object_clones":0,"num_object_copies":124701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41567,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332515,"num_write_kb":2660120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8171855872,"data_stored":8171855872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160615,"ondisk_log_size":160615,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6271,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247920,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2924512,"kb_used_data":1658060,"kb_used_omap":17,"kb_used_meta":1266414,"kb_avail":731078688,"statfs":{"total":751619276800,"available":748624576512,"internally_reserved":0,"allocated":1697853440,"data_stored":1697332893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17680,"internal_metadata":1296808688},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444146,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3381472,"kb_used_data":1987276,"kb_used_omap":20,"kb_used_meta":1394155,"kb_avail":730621728,"statfs":{"total":751619276800,"available":748156649472,"internally_reserved":0,"allocated":2034970624,"data_stored":2034450077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1427615474},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3418996,"kb_used_data":2319328,"kb_used_omap":16,"kb_used_meta":1099631,"kb_avail":730584204,"statfs":{"total":751619276800,"available":748118224896,"internally_reserved":0,"allocated":2374991872,"data_stored":2374474877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":1126022712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705782,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3267840,"kb_used_data":1981036,"kb_used_omap":17,"kb_used_meta":1286766,"kb_avail":730735360,"statfs":{"total":751619276800,"available":748273008640,"internally_reserved":0,"allocated":2028580864,"data_stored":2028060317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17498,"internal_metadata":1317649318},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6271,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2037112832,"data_stored":2037112832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2387582976,"data_stored":2387582976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2043404288,"data_stored":2043404288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1703755776,"data_stored":1703755776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:36.166 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_4 pgp_num 56 2026-02-24T08:29:36.319 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:36.349 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:36 trial105 ceph-mon[39442]: 6.a scrub starts 2026-02-24T08:29:36.459 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:36.456+0000 7f00d6eea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:36.460 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:36.458+0000 7f00d6eea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:36.619 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:29:36.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:29:36.911 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:36.933 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 84 128 351752 351624 32.6995 25.1641 0.0155258 0.0305709 2026-02-24T08:29:37.062 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:37.183 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:37.179+0000 7fb6ea9f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:37.183 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:37.179+0000 7fb6ea9f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:37.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:37 trial105 ceph-mon[39442]: 6.a scrub ok 2026-02-24T08:29:37.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:37 trial105 ceph-mon[39442]: from='client.15226 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:37.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2286307257' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pgp_num", "val": "56"} : dispatch 2026-02-24T08:29:37.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:37 trial105 ceph-mon[39442]: pgmap v333: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.08k op/s 2026-02-24T08:29:37.196 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:37.197 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:37.212 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:37.213 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:37.227 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:37.227 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:37.241 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:37.241 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:37.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 85 128 354695 354567 32.5853 22.9922 0.0246459 0.0306794 2026-02-24T08:29:38.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/673154636' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:38.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:29:38.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:29:38.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:29:38.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: 6.6 scrub starts 2026-02-24T08:29:38.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: 6.d scrub starts 2026-02-24T08:29:38.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:29:38.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:29:38.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:29:38.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:38 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:29:38.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 86 128 358095 357967 32.5152 26.5625 0.0430617 0.0307435 2026-02-24T08:29:39.290 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:39.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:39 trial105 ceph-mon[39442]: 6.d scrub ok 2026-02-24T08:29:39.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:39 trial105 ceph-mon[39442]: 6.6 scrub ok 2026-02-24T08:29:39.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:39 trial105 ceph-mon[39442]: pgmap v334: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.72k op/s 2026-02-24T08:29:39.445 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:39.577 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:39.574+0000 7fec23838640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:39.577 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:39.574+0000 7fec23838640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:39.594 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:39.594 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:39.611 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:39.611 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:39.625 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:39.625 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:39.639 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:39.639 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:39.841 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:29:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:29:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:29:39.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 87 127 361375 361248 32.4361 25.6328 0.045077 0.0308191 2026-02-24T08:29:39.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:29:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:29:39] "GET /metrics HTTP/1.1" 200 4199 "" "Prometheus/3.6.0" 2026-02-24T08:29:40.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3329012866' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:40.934 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 88 128 364727 364599 32.365 26.1797 0.0204335 0.0308811 2026-02-24T08:29:41.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:41 trial105 ceph-mon[39442]: 6.2 scrub starts 2026-02-24T08:29:41.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:41 trial105 ceph-mon[39442]: 6.2 scrub ok 2026-02-24T08:29:41.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:41 trial105 ceph-mon[39442]: pgmap v335: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.72k op/s 2026-02-24T08:29:41.665 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:41.665 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:41.665 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T08:29:41.666 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:41.688 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:41.840 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:41.875 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:41.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 89 128 368037 367909 32.2916 25.8594 0.0514078 0.0309566 2026-02-24T08:29:42.001 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:41.999+0000 7fc8bcff3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:42.002 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:41.999+0000 7fc8bcff3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:42.008 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:42.005+0000 7f6f1140b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:42.008 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:42.006+0000 7f6f1140b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:42.027 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:42.028 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:42.043 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:42.043 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:42.059 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:42.059 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:42.073 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:42.074 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:42.161 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:42.162 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:42.208 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:42 trial105 ceph-mon[39442]: 6.e scrub starts 2026-02-24T08:29:42.209 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:42 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2517276369' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:42.210 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2026-02-24T08:29:40.764402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2857173536,"num_objects":43594,"num_object_clones":0,"num_object_copies":130782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43594,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":348839,"num_write_kb":2791782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161003,"ondisk_log_size":161003,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13490396,"kb_used_data":8334988,"kb_used_omap":71,"kb_used_meta":5155256,"kb_avail":2922522404,"statfs":{"total":3006477107200,"available":2992662941696,"internally_reserved":0,"allocated":8535027712,"data_stored":8532949076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72768,"internal_metadata":5278983104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,1,2,1,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":267206656,"num_objects":4079,"num_object_clones":0,"num_object_copies":12237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4079,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32618,"num_write_kb":260944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001729"},"pg_stats":[{"pgid":"6.f","version":"82'22552","reported_seq":22611,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:36.100423+0000","last_change":"2026-02-24T08:29:34.155131+0000","last_active":"2026-02-24T08:29:36.100423+0000","last_peered":"2026-02-24T08:29:36.100423+0000","last_clean":"2026-02-24T08:29:36.100423+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:29:36.100423+0000","last_undegraded":"2026-02-24T08:29:36.100423+0000","last_fullsized":"2026-02-24T08:29:36.100423+0000","mapping_epoch":75,"log_start":"82'12500","ondisk_log_start":"82'12500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'22184","last_scrub_stamp":"2026-02-24T08:29:34.155047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:34.155047+0000","objects_scrubbed":2768,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:36.654521+0000","scrub_duration":577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184745984,"num_objects":2819,"num_object_clones":0,"num_object_copies":8457,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2819,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22552,"num_write_kb":180416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'21608","reported_seq":21632,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:35.915841+0000","last_change":"2026-02-24T08:28:11.827963+0000","last_active":"2026-02-24T08:29:35.915841+0000","last_peered":"2026-02-24T08:29:35.915841+0000","last_clean":"2026-02-24T08:29:35.915841+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:29:35.915841+0000","last_undegraded":"2026-02-24T08:29:35.915841+0000","last_fullsized":"2026-02-24T08:29:35.915841+0000","mapping_epoch":75,"log_start":"82'11600","ondisk_log_start":"82'11600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:40.175623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177012736,"num_objects":2701,"num_object_clones":0,"num_object_copies":8103,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2701,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21608,"num_write_kb":172864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'22032","reported_seq":22056,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:35.941790+0000","last_change":"2026-02-24T08:28:11.829071+0000","last_active":"2026-02-24T08:29:35.941790+0000","last_peered":"2026-02-24T08:29:35.941790+0000","last_clean":"2026-02-24T08:29:35.941790+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:29:35.941790+0000","last_undegraded":"2026-02-24T08:29:35.941790+0000","last_fullsized":"2026-02-24T08:29:35.941790+0000","mapping_epoch":75,"log_start":"82'12000","ondisk_log_start":"82'12000","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.937462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180486144,"num_objects":2754,"num_object_clones":0,"num_object_copies":8262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22032,"num_write_kb":176256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'21784","reported_seq":21837,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:36.088717+0000","last_change":"2026-02-24T08:29:12.932110+0000","last_active":"2026-02-24T08:29:36.088717+0000","last_peered":"2026-02-24T08:29:36.088717+0000","last_clean":"2026-02-24T08:29:36.088717+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:29:36.088717+0000","last_undegraded":"2026-02-24T08:29:36.088717+0000","last_fullsized":"2026-02-24T08:29:36.088717+0000","mapping_epoch":75,"log_start":"82'11700","ondisk_log_start":"82'11700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16960","last_scrub_stamp":"2026-02-24T08:29:12.931966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:12.931966+0000","objects_scrubbed":2108,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:24.382716+0000","scrub_duration":1222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178454528,"num_objects":2723,"num_object_clones":0,"num_object_copies":8169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2723,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21784,"num_write_kb":174272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'21612","reported_seq":21668,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:36.097316+0000","last_change":"2026-02-24T08:29:24.422069+0000","last_active":"2026-02-24T08:29:36.097316+0000","last_peered":"2026-02-24T08:29:36.097316+0000","last_clean":"2026-02-24T08:29:36.097316+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:29:36.097316+0000","last_undegraded":"2026-02-24T08:29:36.097316+0000","last_fullsized":"2026-02-24T08:29:36.097316+0000","mapping_epoch":75,"log_start":"82'11600","ondisk_log_start":"82'11600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19368","last_scrub_stamp":"2026-02-24T08:29:24.421959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:24.421959+0000","objects_scrubbed":2409,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.721826+0000","scrub_duration":803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177045504,"num_objects":2702,"num_object_clones":0,"num_object_copies":8106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2702,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21612,"num_write_kb":172896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'21936","reported_seq":21975,"reported_epoch":82,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:29:35.937937+0000","last_change":"2026-02-24T08:29:35.588962+0000","last_active":"2026-02-24T08:29:35.937937+0000","last_peered":"2026-02-24T08:29:35.937937+0000","last_clean":"2026-02-24T08:29:35.937937+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:29:35.937937+0000","last_undegraded":"2026-02-24T08:29:35.937937+0000","last_fullsized":"2026-02-24T08:29:35.937937+0000","mapping_epoch":75,"log_start":"82'11900","ondisk_log_start":"82'11900","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":1649,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179699712,"num_objects":2742,"num_object_clones":0,"num_object_copies":8226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21936,"num_write_kb":175488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'21898","reported_seq":21948,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:35.933572+0000","last_change":"2026-02-24T08:29:27.144539+0000","last_active":"2026-02-24T08:29:35.933572+0000","last_peered":"2026-02-24T08:29:35.933572+0000","last_clean":"2026-02-24T08:29:35.933572+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:29:35.933572+0000","last_undegraded":"2026-02-24T08:29:35.933572+0000","last_fullsized":"2026-02-24T08:29:35.933572+0000","mapping_epoch":75,"log_start":"82'11800","ondisk_log_start":"82'11800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'20080","last_scrub_stamp":"2026-02-24T08:29:27.144503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.144503+0000","objects_scrubbed":2504,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:51.900672+0000","scrub_duration":664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179388416,"num_objects":2738,"num_object_clones":0,"num_object_copies":8214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2738,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21898,"num_write_kb":175184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'21416","reported_seq":21472,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:35.976497+0000","last_change":"2026-02-24T08:29:27.170789+0000","last_active":"2026-02-24T08:29:35.976497+0000","last_peered":"2026-02-24T08:29:35.976497+0000","last_clean":"2026-02-24T08:29:35.976497+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:29:35.976497+0000","last_undegraded":"2026-02-24T08:29:35.976497+0000","last_fullsized":"2026-02-24T08:29:35.976497+0000","mapping_epoch":75,"log_start":"82'11400","ondisk_log_start":"82'11400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19824","last_scrub_stamp":"2026-02-24T08:29:27.170707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.170707+0000","objects_scrubbed":2471,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:41.632243+0000","scrub_duration":523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175439872,"num_objects":2677,"num_object_clones":0,"num_object_copies":8031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2677,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21416,"num_write_kb":171328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'22280","reported_seq":22294,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:36.139202+0000","last_change":"2026-02-24T08:28:11.826611+0000","last_active":"2026-02-24T08:29:36.139202+0000","last_peered":"2026-02-24T08:29:36.139202+0000","last_clean":"2026-02-24T08:29:36.139202+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:29:36.139202+0000","last_undegraded":"2026-02-24T08:29:36.139202+0000","last_fullsized":"2026-02-24T08:29:36.139202+0000","mapping_epoch":75,"log_start":"82'12200","ondisk_log_start":"82'12200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:29:36.954422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182517760,"num_objects":2785,"num_object_clones":0,"num_object_copies":8355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2785,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22280,"num_write_kb":178240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'21490","reported_seq":21547,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:35.942349+0000","last_change":"2026-02-24T08:29:31.559681+0000","last_active":"2026-02-24T08:29:35.942349+0000","last_peered":"2026-02-24T08:29:35.942349+0000","last_clean":"2026-02-24T08:29:35.942349+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:29:35.942349+0000","last_undegraded":"2026-02-24T08:29:35.942349+0000","last_fullsized":"2026-02-24T08:29:35.942349+0000","mapping_epoch":75,"log_start":"82'11400","ondisk_log_start":"82'11400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'20680","last_scrub_stamp":"2026-02-24T08:29:31.559608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:31.559608+0000","objects_scrubbed":2575,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:47.434530+0000","scrub_duration":956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176046080,"num_objects":2687,"num_object_clones":0,"num_object_copies":8061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21490,"num_write_kb":171920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'22098","reported_seq":22149,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:36.134337+0000","last_change":"2026-02-24T08:29:16.051980+0000","last_active":"2026-02-24T08:29:36.134337+0000","last_peered":"2026-02-24T08:29:36.134337+0000","last_clean":"2026-02-24T08:29:36.134337+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:29:36.134337+0000","last_undegraded":"2026-02-24T08:29:36.134337+0000","last_fullsized":"2026-02-24T08:29:36.134337+0000","mapping_epoch":75,"log_start":"82'12000","ondisk_log_start":"82'12000","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17984","last_scrub_stamp":"2026-02-24T08:29:16.051875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:16.051875+0000","objects_scrubbed":2228,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.020725+0000","scrub_duration":1384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181026816,"num_objects":2763,"num_object_clones":0,"num_object_copies":8289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22098,"num_write_kb":176784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'21856","reported_seq":21915,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:35.916172+0000","last_change":"2026-02-24T08:29:33.288774+0000","last_active":"2026-02-24T08:29:35.916172+0000","last_peered":"2026-02-24T08:29:35.916172+0000","last_clean":"2026-02-24T08:29:35.916172+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:29:35.916172+0000","last_undegraded":"2026-02-24T08:29:35.916172+0000","last_fullsized":"2026-02-24T08:29:35.916172+0000","mapping_epoch":75,"log_start":"82'11800","ondisk_log_start":"82'11800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'21344","last_scrub_stamp":"2026-02-24T08:29:33.288747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:33.288747+0000","objects_scrubbed":2656,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:41.029196+0000","scrub_duration":748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179044352,"num_objects":2732,"num_object_clones":0,"num_object_copies":8196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21856,"num_write_kb":174848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'21768","reported_seq":21792,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:35.924077+0000","last_change":"2026-02-24T08:28:11.830812+0000","last_active":"2026-02-24T08:29:35.924077+0000","last_peered":"2026-02-24T08:29:35.924077+0000","last_clean":"2026-02-24T08:29:35.924077+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:29:35.924077+0000","last_undegraded":"2026-02-24T08:29:35.924077+0000","last_fullsized":"2026-02-24T08:29:35.924077+0000","mapping_epoch":75,"log_start":"82'11700","ondisk_log_start":"82'11700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:28:10.813810+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178323456,"num_objects":2721,"num_object_clones":0,"num_object_copies":8163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21768,"num_write_kb":174144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'21472","reported_seq":21525,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:36.132595+0000","last_change":"2026-02-24T08:29:14.052994+0000","last_active":"2026-02-24T08:29:36.132595+0000","last_peered":"2026-02-24T08:29:36.132595+0000","last_clean":"2026-02-24T08:29:36.132595+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:29:36.132595+0000","last_undegraded":"2026-02-24T08:29:36.132595+0000","last_fullsized":"2026-02-24T08:29:36.132595+0000","mapping_epoch":75,"log_start":"82'11400","ondisk_log_start":"82'11400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16840","last_scrub_stamp":"2026-02-24T08:29:14.052945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:14.052945+0000","objects_scrubbed":2092,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:31.241843+0000","scrub_duration":1386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175898624,"num_objects":2684,"num_object_clones":0,"num_object_copies":8052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2684,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21472,"num_write_kb":171776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'21372","reported_seq":21428,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:35.900889+0000","last_change":"2026-02-24T08:29:27.818853+0000","last_active":"2026-02-24T08:29:35.900889+0000","last_peered":"2026-02-24T08:29:35.900889+0000","last_clean":"2026-02-24T08:29:35.900889+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:29:35.900889+0000","last_undegraded":"2026-02-24T08:29:35.900889+0000","last_fullsized":"2026-02-24T08:29:35.900889+0000","mapping_epoch":75,"log_start":"82'11300","ondisk_log_start":"82'11300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19592","last_scrub_stamp":"2026-02-24T08:29:27.818810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.818810+0000","objects_scrubbed":2449,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:30.750603+0000","scrub_duration":383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175079424,"num_objects":2672,"num_object_clones":0,"num_object_copies":8016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21372,"num_write_kb":170976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'21530","reported_seq":21583,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:35.871830+0000","last_change":"2026-02-24T08:29:15.834474+0000","last_active":"2026-02-24T08:29:35.871830+0000","last_peered":"2026-02-24T08:29:35.871830+0000","last_clean":"2026-02-24T08:29:35.871830+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:29:35.871830+0000","last_undegraded":"2026-02-24T08:29:35.871830+0000","last_fullsized":"2026-02-24T08:29:35.871830+0000","mapping_epoch":75,"log_start":"82'11500","ondisk_log_start":"82'11500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17480","last_scrub_stamp":"2026-02-24T08:29:15.834411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:15.834411+0000","objects_scrubbed":2172,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:43.605376+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176373760,"num_objects":2692,"num_object_clones":0,"num_object_copies":8076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2692,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21530,"num_write_kb":172240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2856583168,"num_objects":43592,"num_object_clones":0,"num_object_copies":130776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348704,"num_write_kb":2789632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8569438208,"data_stored":8569438208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160904,"ondisk_log_size":160904,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6271,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3021256,"kb_used_data":1736756,"kb_used_omap":17,"kb_used_meta":1284462,"kb_avail":730981944,"statfs":{"total":751619276800,"available":748525510656,"internally_reserved":0,"allocated":1778438144,"data_stored":1777917597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17680,"internal_metadata":1315289840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444147,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3498816,"kb_used_data":2086572,"kb_used_omap":20,"kb_used_meta":1412203,"kb_avail":730504384,"statfs":{"total":751619276800,"available":748036489216,"internally_reserved":0,"allocated":2136649728,"data_stored":2136129181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1446096626},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3568812,"kb_used_data":2433048,"kb_used_omap":16,"kb_used_meta":1135727,"kb_avail":730434388,"statfs":{"total":751619276800,"available":747964813312,"internally_reserved":0,"allocated":2491441152,"data_stored":2490924157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":1162985016},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3401512,"kb_used_data":2078612,"kb_used_omap":17,"kb_used_meta":1322862,"kb_avail":730601688,"statfs":{"total":751619276800,"available":748136128512,"internally_reserved":0,"allocated":2128498688,"data_stored":2127978141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17498,"internal_metadata":1354611622},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,1,2,1,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6271,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2137767936,"data_stored":2137767936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2505023488,"data_stored":2505023488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2142281728,"data_stored":2142281728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1784365056,"data_stored":1784365056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:42.212 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:29:42.212 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 66 2026-02-24T08:29:42.405 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:42.524 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:42.521+0000 7f0c50536640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:42.524 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:42.521+0000 7f0c50536640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:42.672 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:29:42.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:29:42.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 90 87 371108 371021 32.2029 24.3125 0.0216231 0.0310425 2026-02-24T08:29:43.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:43 trial105 ceph-mon[39442]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:43.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2577992671' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T08:29:43.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:43 trial105 ceph-mon[39442]: pgmap v336: 17 pgs: 17 active+clean; 2.8 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.07k op/s 2026-02-24T08:29:43.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total time run: 90.0433 2026-02-24T08:29:43.935 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total writes made: 371108 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Write size: 8192 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object size: 65536 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Bandwidth (MB/sec): 32.1987 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Bandwidth: 13.1857 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max bandwidth (MB/sec): 82.1406 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min bandwidth (MB/sec): 22.5312 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average IOPS: 4121 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev IOPS: 1687.77 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max IOPS: 10514 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min IOPS: 2884 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average Latency(s): 0.0310469 2026-02-24T08:29:43.936 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Latency(s): 0.0238161 2026-02-24T08:29:43.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max latency(s): 0.283695 2026-02-24T08:29:43.937 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min latency(s): 0.00104297 2026-02-24T08:29:43.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:29:44.124 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:44.280 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:44.347 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:44 trial105 ceph-mon[39442]: 6.e scrub ok 2026-02-24T08:29:44.348 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:29:44.408 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:44.404+0000 7f1a78ddd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:44.408 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:44.405+0000 7f1a78ddd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:44.428 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:44.428 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:44.445 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:44.445 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:44.460 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:44.460 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:44.488 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:44.489 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:45.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/377514248' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:45.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:45 trial105 ceph-mon[39442]: pgmap v337: 17 pgs: 17 active+clean; 2.8 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.70k op/s 2026-02-24T08:29:46.551 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:46.712 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:46.845 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:46.841+0000 7fb0090d2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:46.845 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:46.842+0000 7fb0090d2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:46.868 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:46.868 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:46.888 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:46.888 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:46.902 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:46.902 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:46.917 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:46.917 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:47.715 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:47.715 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:47.715 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:29:47.716 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:47.867 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:47.999 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:47 trial105 ceph-mon[39442]: pgmap v338: 17 pgs: 17 active+clean; 2.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 25 MiB/s wr, 3.79k op/s 2026-02-24T08:29:47.999 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:47 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1371670895' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:48.000 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:47.996+0000 7ffa6706c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:48.000 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:47.997+0000 7ffa6706c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:48.168 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:48.169 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:48.218 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2026-02-24T08:29:46.765246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2587394616,"num_objects":39475,"num_object_clones":0,"num_object_copies":118425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39475,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":378161,"num_write_kb":2971015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160925,"ondisk_log_size":160925,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13287272,"kb_used_data":7951384,"kb_used_omap":71,"kb_used_meta":5335736,"kb_avail":2922725528,"statfs":{"total":3006477107200,"available":2992870940672,"internally_reserved":0,"allocated":8142217216,"data_stored":8140126364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72768,"internal_metadata":5463794624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,7,19,13,21,44,13,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-137158632,"num_objects":-2094,"num_object_clones":0,"num_object_copies":-6282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2094,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":45511,"num_write_kb":308745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001669"},"pg_stats":[{"pgid":"6.f","version":"82'24398","reported_seq":24456,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:46.187385+0000","last_change":"2026-02-24T08:29:34.155131+0000","last_active":"2026-02-24T08:29:46.187385+0000","last_peered":"2026-02-24T08:29:46.187385+0000","last_clean":"2026-02-24T08:29:46.187385+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:29:46.187385+0000","last_undegraded":"2026-02-24T08:29:46.187385+0000","last_fullsized":"2026-02-24T08:29:46.187385+0000","mapping_epoch":75,"log_start":"82'14300","ondisk_log_start":"82'14300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'22184","last_scrub_stamp":"2026-02-24T08:29:34.155047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:34.155047+0000","objects_scrubbed":2768,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:36.654521+0000","scrub_duration":577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167575552,"num_objects":2557,"num_object_clones":0,"num_object_copies":7671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24398,"num_write_kb":191680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'23647","reported_seq":23707,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:45.949734+0000","last_change":"2026-02-24T08:29:42.907926+0000","last_active":"2026-02-24T08:29:45.949734+0000","last_peered":"2026-02-24T08:29:45.949734+0000","last_clean":"2026-02-24T08:29:45.949734+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:29:45.949734+0000","last_undegraded":"2026-02-24T08:29:45.949734+0000","last_fullsized":"2026-02-24T08:29:45.949734+0000","mapping_epoch":75,"log_start":"82'13600","ondisk_log_start":"82'13600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'23216","last_scrub_stamp":"2026-02-24T08:29:42.907855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:42.907855+0000","objects_scrubbed":2889,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:53.347718+0000","scrub_duration":1233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161939456,"num_objects":2471,"num_object_clones":0,"num_object_copies":7413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23647,"num_write_kb":185728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'23879","reported_seq":23936,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:45.959237+0000","last_change":"2026-02-24T08:29:38.059744+0000","last_active":"2026-02-24T08:29:45.959237+0000","last_peered":"2026-02-24T08:29:45.959237+0000","last_clean":"2026-02-24T08:29:45.959237+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:29:45.959237+0000","last_undegraded":"2026-02-24T08:29:45.959237+0000","last_fullsized":"2026-02-24T08:29:45.959237+0000","mapping_epoch":75,"log_start":"82'13800","ondisk_log_start":"82'13800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'22368","last_scrub_stamp":"2026-02-24T08:29:38.059599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:38.059599+0000","objects_scrubbed":2791,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:05.166075+0000","scrub_duration":444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163315736,"num_objects":2493,"num_object_clones":0,"num_object_copies":7479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2493,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23879,"num_write_kb":187521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'23538","reported_seq":23589,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:46.176679+0000","last_change":"2026-02-24T08:29:12.932110+0000","last_active":"2026-02-24T08:29:46.176679+0000","last_peered":"2026-02-24T08:29:46.176679+0000","last_clean":"2026-02-24T08:29:46.176679+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:29:46.176679+0000","last_undegraded":"2026-02-24T08:29:46.176679+0000","last_fullsized":"2026-02-24T08:29:46.176679+0000","mapping_epoch":75,"log_start":"82'13500","ondisk_log_start":"82'13500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16960","last_scrub_stamp":"2026-02-24T08:29:12.931966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:12.931966+0000","objects_scrubbed":2108,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:24.382716+0000","scrub_duration":1222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159940608,"num_objects":2441,"num_object_clones":0,"num_object_copies":7323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2441,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23538,"num_write_kb":184736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'23382","reported_seq":23435,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:46.182283+0000","last_change":"2026-02-24T08:29:24.422069+0000","last_active":"2026-02-24T08:29:46.182283+0000","last_peered":"2026-02-24T08:29:46.182283+0000","last_clean":"2026-02-24T08:29:46.182283+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:29:46.182283+0000","last_undegraded":"2026-02-24T08:29:46.182283+0000","last_fullsized":"2026-02-24T08:29:46.182283+0000","mapping_epoch":75,"log_start":"82'13300","ondisk_log_start":"82'13300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19368","last_scrub_stamp":"2026-02-24T08:29:24.421959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:24.421959+0000","objects_scrubbed":2409,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.721826+0000","scrub_duration":803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158662656,"num_objects":2421,"num_object_clones":0,"num_object_copies":7263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23382,"num_write_kb":183488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'23629","reported_seq":23687,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:45.967056+0000","last_change":"2026-02-24T08:29:36.105644+0000","last_active":"2026-02-24T08:29:45.967056+0000","last_peered":"2026-02-24T08:29:45.967056+0000","last_clean":"2026-02-24T08:29:45.967056+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:29:45.967056+0000","last_undegraded":"2026-02-24T08:29:45.967056+0000","last_fullsized":"2026-02-24T08:29:45.967056+0000","mapping_epoch":75,"log_start":"82'13600","ondisk_log_start":"82'13600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'21952","last_scrub_stamp":"2026-02-24T08:29:36.105570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:36.105570+0000","objects_scrubbed":2739,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:49.908151+0000","scrub_duration":516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163119104,"num_objects":2489,"num_object_clones":0,"num_object_copies":7467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2489,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23629,"num_write_kb":185728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'23830","reported_seq":23887,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:45.927138+0000","last_change":"2026-02-24T08:29:27.144539+0000","last_active":"2026-02-24T08:29:45.927138+0000","last_peered":"2026-02-24T08:29:45.927138+0000","last_clean":"2026-02-24T08:29:45.927138+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:29:45.927138+0000","last_undegraded":"2026-02-24T08:29:45.927138+0000","last_fullsized":"2026-02-24T08:29:45.927138+0000","mapping_epoch":75,"log_start":"82'13800","ondisk_log_start":"82'13800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'20080","last_scrub_stamp":"2026-02-24T08:29:27.144503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.144503+0000","objects_scrubbed":2504,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:51.900672+0000","scrub_duration":664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164691968,"num_objects":2513,"num_object_clones":0,"num_object_copies":7539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23830,"num_write_kb":187328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'23280","reported_seq":23336,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:46.010668+0000","last_change":"2026-02-24T08:29:27.170789+0000","last_active":"2026-02-24T08:29:46.010668+0000","last_peered":"2026-02-24T08:29:46.010668+0000","last_clean":"2026-02-24T08:29:46.010668+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:29:46.010668+0000","last_undegraded":"2026-02-24T08:29:46.010668+0000","last_fullsized":"2026-02-24T08:29:46.010668+0000","mapping_epoch":75,"log_start":"82'13200","ondisk_log_start":"82'13200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19824","last_scrub_stamp":"2026-02-24T08:29:27.170707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.170707+0000","objects_scrubbed":2471,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:41.632243+0000","scrub_duration":523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158859264,"num_objects":2424,"num_object_clones":0,"num_object_copies":7272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2424,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23280,"num_write_kb":182784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'24038","reported_seq":24098,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:46.169610+0000","last_change":"2026-02-24T08:29:38.438454+0000","last_active":"2026-02-24T08:29:46.169610+0000","last_peered":"2026-02-24T08:29:46.169610+0000","last_clean":"2026-02-24T08:29:46.169610+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:29:46.169610+0000","last_undegraded":"2026-02-24T08:29:46.169610+0000","last_fullsized":"2026-02-24T08:29:46.169610+0000","mapping_epoch":75,"log_start":"82'14000","ondisk_log_start":"82'14000","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'22696","last_scrub_stamp":"2026-02-24T08:29:38.438394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:38.438394+0000","objects_scrubbed":2823,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:48.551160+0000","scrub_duration":906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164626432,"num_objects":2512,"num_object_clones":0,"num_object_copies":7536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24038,"num_write_kb":188800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'23255","reported_seq":23313,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:45.967187+0000","last_change":"2026-02-24T08:29:31.559681+0000","last_active":"2026-02-24T08:29:45.967187+0000","last_peered":"2026-02-24T08:29:45.967187+0000","last_clean":"2026-02-24T08:29:45.967187+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:29:45.967187+0000","last_undegraded":"2026-02-24T08:29:45.967187+0000","last_fullsized":"2026-02-24T08:29:45.967187+0000","mapping_epoch":75,"log_start":"82'13200","ondisk_log_start":"82'13200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'20680","last_scrub_stamp":"2026-02-24T08:29:31.559608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:31.559608+0000","objects_scrubbed":2575,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:47.434530+0000","scrub_duration":956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158728192,"num_objects":2422,"num_object_clones":0,"num_object_copies":7266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2422,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23255,"num_write_kb":182592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'23732","reported_seq":23785,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:46.183823+0000","last_change":"2026-02-24T08:29:16.051980+0000","last_active":"2026-02-24T08:29:46.183823+0000","last_peered":"2026-02-24T08:29:46.183823+0000","last_clean":"2026-02-24T08:29:46.183823+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:29:46.183823+0000","last_undegraded":"2026-02-24T08:29:46.183823+0000","last_fullsized":"2026-02-24T08:29:46.183823+0000","mapping_epoch":75,"log_start":"82'13700","ondisk_log_start":"82'13700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17984","last_scrub_stamp":"2026-02-24T08:29:16.051875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:16.051875+0000","objects_scrubbed":2228,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.020725+0000","scrub_duration":1384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161087488,"num_objects":2458,"num_object_clones":0,"num_object_copies":7374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23732,"num_write_kb":186240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'23592","reported_seq":23645,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:45.933583+0000","last_change":"2026-02-24T08:29:33.288774+0000","last_active":"2026-02-24T08:29:45.933583+0000","last_peered":"2026-02-24T08:29:45.933583+0000","last_clean":"2026-02-24T08:29:45.933583+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:29:45.933583+0000","last_undegraded":"2026-02-24T08:29:45.933583+0000","last_fullsized":"2026-02-24T08:29:45.933583+0000","mapping_epoch":75,"log_start":"82'13500","ondisk_log_start":"82'13500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'21344","last_scrub_stamp":"2026-02-24T08:29:33.288747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:33.288747+0000","objects_scrubbed":2656,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:41.029196+0000","scrub_duration":748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160235520,"num_objects":2445,"num_object_clones":0,"num_object_copies":7335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2445,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23592,"num_write_kb":185152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'23517","reported_seq":23577,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:45.988845+0000","last_change":"2026-02-24T08:29:40.313239+0000","last_active":"2026-02-24T08:29:45.988845+0000","last_peered":"2026-02-24T08:29:45.988845+0000","last_clean":"2026-02-24T08:29:45.988845+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:29:45.988845+0000","last_undegraded":"2026-02-24T08:29:45.988845+0000","last_fullsized":"2026-02-24T08:29:45.988845+0000","mapping_epoch":75,"log_start":"82'13500","ondisk_log_start":"82'13500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'22640","last_scrub_stamp":"2026-02-24T08:29:40.313177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:40.313177+0000","objects_scrubbed":2809,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:47.001121+0000","scrub_duration":767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162201600,"num_objects":2475,"num_object_clones":0,"num_object_copies":7425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23517,"num_write_kb":184832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'23408","reported_seq":23457,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:46.157039+0000","last_change":"2026-02-24T08:29:14.052994+0000","last_active":"2026-02-24T08:29:46.157039+0000","last_peered":"2026-02-24T08:29:46.157039+0000","last_clean":"2026-02-24T08:29:46.157039+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:29:46.157039+0000","last_undegraded":"2026-02-24T08:29:46.157039+0000","last_fullsized":"2026-02-24T08:29:46.157039+0000","mapping_epoch":75,"log_start":"82'13400","ondisk_log_start":"82'13400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16840","last_scrub_stamp":"2026-02-24T08:29:14.052945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:14.052945+0000","objects_scrubbed":2092,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:31.241843+0000","scrub_duration":1386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159318016,"num_objects":2431,"num_object_clones":0,"num_object_copies":7293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2431,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23408,"num_write_kb":183744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'23438","reported_seq":23494,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:45.961071+0000","last_change":"2026-02-24T08:29:27.818853+0000","last_active":"2026-02-24T08:29:45.961071+0000","last_peered":"2026-02-24T08:29:45.961071+0000","last_clean":"2026-02-24T08:29:45.961071+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:29:45.961071+0000","last_undegraded":"2026-02-24T08:29:45.961071+0000","last_fullsized":"2026-02-24T08:29:45.961071+0000","mapping_epoch":75,"log_start":"82'13400","ondisk_log_start":"82'13400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19592","last_scrub_stamp":"2026-02-24T08:29:27.818810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.818810+0000","objects_scrubbed":2449,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:30.750603+0000","scrub_duration":383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162070528,"num_objects":2473,"num_object_clones":0,"num_object_copies":7419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2473,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23438,"num_write_kb":184256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'23463","reported_seq":23517,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:45.996641+0000","last_change":"2026-02-24T08:29:15.834474+0000","last_active":"2026-02-24T08:29:45.996641+0000","last_peered":"2026-02-24T08:29:45.996641+0000","last_clean":"2026-02-24T08:29:45.996641+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:29:45.996641+0000","last_undegraded":"2026-02-24T08:29:45.996641+0000","last_fullsized":"2026-02-24T08:29:45.996641+0000","mapping_epoch":75,"log_start":"82'13400","ondisk_log_start":"82'13400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17480","last_scrub_stamp":"2026-02-24T08:29:15.834411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:15.834411+0000","objects_scrubbed":2172,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:43.605376+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160432128,"num_objects":2448,"num_object_clones":0,"num_object_copies":7344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23463,"num_write_kb":184256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":2586804248,"num_objects":39473,"num_object_clones":0,"num_object_copies":118419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39473,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":378026,"num_write_kb":2968865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7767568384,"data_stored":7767556168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160826,"ondisk_log_size":160826,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6271,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247923,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3007744,"kb_used_data":1651052,"kb_used_omap":17,"kb_used_meta":1356654,"kb_avail":730995456,"statfs":{"total":751619276800,"available":748539346944,"internally_reserved":0,"allocated":1690677248,"data_stored":1690156701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17680,"internal_metadata":1389214448},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,11,0,12,16],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3405348,"kb_used_data":1957008,"kb_used_omap":20,"kb_used_meta":1448299,"kb_avail":730597852,"statfs":{"total":751619276800,"available":748132200448,"internally_reserved":0,"allocated":2003976192,"data_stored":2003451573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1483058930},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3495904,"kb_used_data":2324044,"kb_used_omap":16,"kb_used_meta":1171823,"kb_avail":730507296,"statfs":{"total":751619276800,"available":748039471104,"internally_reserved":0,"allocated":2379821056,"data_stored":2379299989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":1199947320},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3378276,"kb_used_data":2019280,"kb_used_omap":17,"kb_used_meta":1358958,"kb_avail":730624924,"statfs":{"total":751619276800,"available":748159922176,"internally_reserved":0,"allocated":2067742720,"data_stored":2067218101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17498,"internal_metadata":1391573926},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,8,13,9,28,13,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6271,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1952026624,"data_stored":1952022552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2243072000,"data_stored":2243067928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1950322688,"data_stored":1950318616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1622147072,"data_stored":1622147072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:48.221 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 191 2026-02-24T08:29:48.370 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:48.511 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:48.509+0000 7f095227b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:48.512 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:48.509+0000 7f095227b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:48.673 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:29:48.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:29:48.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:48 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2662528170' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "191"} : dispatch 2026-02-24T08:29:48.966 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:49.120 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:49.251 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:49.247+0000 7f057a2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:49.251 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:49.247+0000 7f057a2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:49.274 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:49.274 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:49.288 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:49.288 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:49.310 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:49.310 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:49.327 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:49.327 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:49.821 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:29:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:29:49] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-24T08:29:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:29:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:29:49.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:29:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:49 trial105 ceph-mon[39442]: from='client.15244 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:49 trial105 ceph-mon[39442]: pgmap v339: 17 pgs: 17 active+clean; 2.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 15 MiB/s wr, 2.44k op/s 2026-02-24T08:29:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2252127848' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:51.376 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:51.521 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:51.660 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:51.657+0000 7f803f7bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:51.662 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:51.658+0000 7f803f7bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:51.682 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:51.682 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:51.706 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:51.706 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:51.725 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:51.725 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:51.745 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:51.745 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:51.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:51 trial105 ceph-mon[39442]: pgmap v340: 17 pgs: 17 active+clean; 2.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 15 MiB/s wr, 2.44k op/s 2026-02-24T08:29:51.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/489278800' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:53 trial105 ceph-mon[39442]: pgmap v341: 17 pgs: 17 active+clean; 1.4 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 15 MiB/s wr, 3.77k op/s 2026-02-24T08:29:53.744 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:53.744 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:29:53.745 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_4 2026-02-24T08:29:53.745 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:29:53.799 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:53.901 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:53.956 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:54.040 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:54.036+0000 7f2720c0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:54.040 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:54.037+0000 7f2720c0a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:54.086 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:54.080+0000 7f6e07a0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:54.087 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:54.085+0000 7f6e07a0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:54.111 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:54.111 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:54.127 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:54.127 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:54.144 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:54.144 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:54.160 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:54.160 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:54.210 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:29:54.211 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:29:54.259 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2026-02-24T08:29:52.766128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1544716856,"num_objects":23565,"num_object_clones":0,"num_object_copies":70695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23565,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":394071,"num_write_kb":2971015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160835,"ondisk_log_size":160835,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10240680,"kb_used_data":4886104,"kb_used_omap":71,"kb_used_meta":5353784,"kb_avail":2925772120,"statfs":{"total":3006477107200,"available":2995990650880,"internally_reserved":0,"allocated":5003370496,"data_stored":5001279644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72768,"internal_metadata":5482275776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,5,10,19,14,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1312456680,"num_objects":-20029,"num_object_clones":0,"num_object_copies":-60087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20029,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":45232,"num_write_kb":179233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001725"},"pg_stats":[{"pgid":"6.f","version":"82'25480","reported_seq":25534,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:51.247421+0000","last_change":"2026-02-24T08:29:34.155131+0000","last_active":"2026-02-24T08:29:51.247421+0000","last_peered":"2026-02-24T08:29:51.247421+0000","last_clean":"2026-02-24T08:29:51.247421+0000","last_became_active":"2026-02-24T08:28:11.827459+0000","last_became_peered":"2026-02-24T08:28:11.827459+0000","last_unstale":"2026-02-24T08:29:51.247421+0000","last_undegraded":"2026-02-24T08:29:51.247421+0000","last_fullsized":"2026-02-24T08:29:51.247421+0000","mapping_epoch":75,"log_start":"82'15400","ondisk_log_start":"82'15400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'22184","last_scrub_stamp":"2026-02-24T08:29:34.155047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:34.155047+0000","objects_scrubbed":2768,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:36.654521+0000","scrub_duration":577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96665600,"num_objects":1475,"num_object_clones":0,"num_object_copies":4425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1475,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25480,"num_write_kb":191680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"82'24611","reported_seq":24666,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:50.982307+0000","last_change":"2026-02-24T08:29:42.907926+0000","last_active":"2026-02-24T08:29:50.982307+0000","last_peered":"2026-02-24T08:29:50.982307+0000","last_clean":"2026-02-24T08:29:50.982307+0000","last_became_active":"2026-02-24T08:28:11.827474+0000","last_became_peered":"2026-02-24T08:28:11.827474+0000","last_unstale":"2026-02-24T08:29:50.982307+0000","last_undegraded":"2026-02-24T08:29:50.982307+0000","last_fullsized":"2026-02-24T08:29:50.982307+0000","mapping_epoch":75,"log_start":"82'14600","ondisk_log_start":"82'14600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'23216","last_scrub_stamp":"2026-02-24T08:29:42.907855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:42.907855+0000","objects_scrubbed":2889,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:53.347718+0000","scrub_duration":1233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98762752,"num_objects":1507,"num_object_clones":0,"num_object_copies":4521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1507,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24611,"num_write_kb":185728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"82'24845","reported_seq":24897,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:50.946003+0000","last_change":"2026-02-24T08:29:38.059744+0000","last_active":"2026-02-24T08:29:50.946003+0000","last_peered":"2026-02-24T08:29:50.946003+0000","last_clean":"2026-02-24T08:29:50.946003+0000","last_became_active":"2026-02-24T08:28:11.828444+0000","last_became_peered":"2026-02-24T08:28:11.828444+0000","last_unstale":"2026-02-24T08:29:50.946003+0000","last_undegraded":"2026-02-24T08:29:50.946003+0000","last_fullsized":"2026-02-24T08:29:50.946003+0000","mapping_epoch":75,"log_start":"82'14800","ondisk_log_start":"82'14800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'22368","last_scrub_stamp":"2026-02-24T08:29:38.059599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:38.059599+0000","objects_scrubbed":2791,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:05.166075+0000","scrub_duration":444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100007960,"num_objects":1527,"num_object_clones":0,"num_object_copies":4581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1527,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24845,"num_write_kb":187521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"82'24562","reported_seq":24615,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:51.228141+0000","last_change":"2026-02-24T08:29:12.932110+0000","last_active":"2026-02-24T08:29:51.228141+0000","last_peered":"2026-02-24T08:29:51.228141+0000","last_clean":"2026-02-24T08:29:51.228141+0000","last_became_active":"2026-02-24T08:28:11.827253+0000","last_became_peered":"2026-02-24T08:28:11.827253+0000","last_unstale":"2026-02-24T08:29:51.228141+0000","last_undegraded":"2026-02-24T08:29:51.228141+0000","last_fullsized":"2026-02-24T08:29:51.228141+0000","mapping_epoch":75,"log_start":"82'14500","ondisk_log_start":"82'14500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16960","last_scrub_stamp":"2026-02-24T08:29:12.931966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:12.931966+0000","objects_scrubbed":2108,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:24.382716+0000","scrub_duration":1222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92831744,"num_objects":1417,"num_object_clones":0,"num_object_copies":4251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24562,"num_write_kb":184736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"82'24324","reported_seq":24380,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:51.231060+0000","last_change":"2026-02-24T08:29:24.422069+0000","last_active":"2026-02-24T08:29:51.231060+0000","last_peered":"2026-02-24T08:29:51.231060+0000","last_clean":"2026-02-24T08:29:51.231060+0000","last_became_active":"2026-02-24T08:28:11.826010+0000","last_became_peered":"2026-02-24T08:28:11.826010+0000","last_unstale":"2026-02-24T08:29:51.231060+0000","last_undegraded":"2026-02-24T08:29:51.231060+0000","last_fullsized":"2026-02-24T08:29:51.231060+0000","mapping_epoch":75,"log_start":"82'14300","ondisk_log_start":"82'14300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19368","last_scrub_stamp":"2026-02-24T08:29:24.421959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:24.421959+0000","objects_scrubbed":2409,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.721826+0000","scrub_duration":803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96927744,"num_objects":1479,"num_object_clones":0,"num_object_copies":4437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24324,"num_write_kb":183488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"82'24653","reported_seq":24708,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:50.970835+0000","last_change":"2026-02-24T08:29:36.105644+0000","last_active":"2026-02-24T08:29:50.970835+0000","last_peered":"2026-02-24T08:29:50.970835+0000","last_clean":"2026-02-24T08:29:50.970835+0000","last_became_active":"2026-02-24T08:28:11.827560+0000","last_became_peered":"2026-02-24T08:28:11.827560+0000","last_unstale":"2026-02-24T08:29:50.970835+0000","last_undegraded":"2026-02-24T08:29:50.970835+0000","last_fullsized":"2026-02-24T08:29:50.970835+0000","mapping_epoch":75,"log_start":"82'14600","ondisk_log_start":"82'14600","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'21952","last_scrub_stamp":"2026-02-24T08:29:36.105570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:36.105570+0000","objects_scrubbed":2739,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:49.908151+0000","scrub_duration":516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96010240,"num_objects":1465,"num_object_clones":0,"num_object_copies":4395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24653,"num_write_kb":185728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'24831","reported_seq":24888,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:50.972288+0000","last_change":"2026-02-24T08:29:27.144539+0000","last_active":"2026-02-24T08:29:50.972288+0000","last_peered":"2026-02-24T08:29:50.972288+0000","last_clean":"2026-02-24T08:29:50.972288+0000","last_became_active":"2026-02-24T08:28:11.826998+0000","last_became_peered":"2026-02-24T08:28:11.826998+0000","last_unstale":"2026-02-24T08:29:50.972288+0000","last_undegraded":"2026-02-24T08:29:50.972288+0000","last_fullsized":"2026-02-24T08:29:50.972288+0000","mapping_epoch":75,"log_start":"82'14800","ondisk_log_start":"82'14800","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'20080","last_scrub_stamp":"2026-02-24T08:29:27.144503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.144503+0000","objects_scrubbed":2504,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:51.900672+0000","scrub_duration":664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99090432,"num_objects":1512,"num_object_clones":0,"num_object_copies":4536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24831,"num_write_kb":187328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"82'24270","reported_seq":24324,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:51.020493+0000","last_change":"2026-02-24T08:29:27.170789+0000","last_active":"2026-02-24T08:29:51.020493+0000","last_peered":"2026-02-24T08:29:51.020493+0000","last_clean":"2026-02-24T08:29:51.020493+0000","last_became_active":"2026-02-24T08:28:11.828342+0000","last_became_peered":"2026-02-24T08:28:11.828342+0000","last_unstale":"2026-02-24T08:29:51.020493+0000","last_undegraded":"2026-02-24T08:29:51.020493+0000","last_fullsized":"2026-02-24T08:29:51.020493+0000","mapping_epoch":75,"log_start":"82'14200","ondisk_log_start":"82'14200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19824","last_scrub_stamp":"2026-02-24T08:29:27.170707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.170707+0000","objects_scrubbed":2471,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:41.632243+0000","scrub_duration":523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93978624,"num_objects":1434,"num_object_clones":0,"num_object_copies":4302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24270,"num_write_kb":182784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"82'25078","reported_seq":25138,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:51.231963+0000","last_change":"2026-02-24T08:29:38.438454+0000","last_active":"2026-02-24T08:29:51.231963+0000","last_peered":"2026-02-24T08:29:51.231963+0000","last_clean":"2026-02-24T08:29:51.231963+0000","last_became_active":"2026-02-24T08:28:11.826257+0000","last_became_peered":"2026-02-24T08:28:11.826257+0000","last_unstale":"2026-02-24T08:29:51.231963+0000","last_undegraded":"2026-02-24T08:29:51.231963+0000","last_fullsized":"2026-02-24T08:29:51.231963+0000","mapping_epoch":75,"log_start":"82'15000","ondisk_log_start":"82'15000","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'22696","last_scrub_stamp":"2026-02-24T08:29:38.438394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:38.438394+0000","objects_scrubbed":2823,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:48.551160+0000","scrub_duration":906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":1472,"num_object_clones":0,"num_object_copies":4416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1472,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25078,"num_write_kb":188800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"82'24249","reported_seq":24303,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:50.967700+0000","last_change":"2026-02-24T08:29:31.559681+0000","last_active":"2026-02-24T08:29:50.967700+0000","last_peered":"2026-02-24T08:29:50.967700+0000","last_clean":"2026-02-24T08:29:50.967700+0000","last_became_active":"2026-02-24T08:28:11.828881+0000","last_became_peered":"2026-02-24T08:28:11.828881+0000","last_unstale":"2026-02-24T08:29:50.967700+0000","last_undegraded":"2026-02-24T08:29:50.967700+0000","last_fullsized":"2026-02-24T08:29:50.967700+0000","mapping_epoch":75,"log_start":"82'14200","ondisk_log_start":"82'14200","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'20680","last_scrub_stamp":"2026-02-24T08:29:31.559608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:31.559608+0000","objects_scrubbed":2575,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:47.434530+0000","scrub_duration":956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93585408,"num_objects":1428,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24249,"num_write_kb":182592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"82'24750","reported_seq":24802,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:51.236180+0000","last_change":"2026-02-24T08:29:16.051980+0000","last_active":"2026-02-24T08:29:51.236180+0000","last_peered":"2026-02-24T08:29:51.236180+0000","last_clean":"2026-02-24T08:29:51.236180+0000","last_became_active":"2026-02-24T08:28:11.827347+0000","last_became_peered":"2026-02-24T08:28:11.827347+0000","last_unstale":"2026-02-24T08:29:51.236180+0000","last_undegraded":"2026-02-24T08:29:51.236180+0000","last_fullsized":"2026-02-24T08:29:51.236180+0000","mapping_epoch":75,"log_start":"82'14700","ondisk_log_start":"82'14700","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17984","last_scrub_stamp":"2026-02-24T08:29:16.051875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:16.051875+0000","objects_scrubbed":2228,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:26.020725+0000","scrub_duration":1384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94371840,"num_objects":1440,"num_object_clones":0,"num_object_copies":4320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1440,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24750,"num_write_kb":186240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"82'24540","reported_seq":24598,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:50.978399+0000","last_change":"2026-02-24T08:29:33.288774+0000","last_active":"2026-02-24T08:29:50.978399+0000","last_peered":"2026-02-24T08:29:50.978399+0000","last_clean":"2026-02-24T08:29:50.978399+0000","last_became_active":"2026-02-24T08:28:11.829051+0000","last_became_peered":"2026-02-24T08:28:11.829051+0000","last_unstale":"2026-02-24T08:29:50.978399+0000","last_undegraded":"2026-02-24T08:29:50.978399+0000","last_fullsized":"2026-02-24T08:29:50.978399+0000","mapping_epoch":75,"log_start":"82'14500","ondisk_log_start":"82'14500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'21344","last_scrub_stamp":"2026-02-24T08:29:33.288747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:33.288747+0000","objects_scrubbed":2656,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:41.029196+0000","scrub_duration":748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98107392,"num_objects":1497,"num_object_clones":0,"num_object_copies":4491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24540,"num_write_kb":185152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"82'24550","reported_seq":24610,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:51.022651+0000","last_change":"2026-02-24T08:29:40.313239+0000","last_active":"2026-02-24T08:29:51.022651+0000","last_peered":"2026-02-24T08:29:51.022651+0000","last_clean":"2026-02-24T08:29:51.022651+0000","last_became_active":"2026-02-24T08:28:11.830343+0000","last_became_peered":"2026-02-24T08:28:11.830343+0000","last_unstale":"2026-02-24T08:29:51.022651+0000","last_undegraded":"2026-02-24T08:29:51.022651+0000","last_fullsized":"2026-02-24T08:29:51.022651+0000","mapping_epoch":75,"log_start":"82'14500","ondisk_log_start":"82'14500","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'22640","last_scrub_stamp":"2026-02-24T08:29:40.313177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:40.313177+0000","objects_scrubbed":2809,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:47.001121+0000","scrub_duration":767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94502912,"num_objects":1442,"num_object_clones":0,"num_object_copies":4326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24550,"num_write_kb":184832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"82'24353","reported_seq":24406,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:51.213420+0000","last_change":"2026-02-24T08:29:14.052994+0000","last_active":"2026-02-24T08:29:51.213420+0000","last_peered":"2026-02-24T08:29:51.213420+0000","last_clean":"2026-02-24T08:29:51.213420+0000","last_became_active":"2026-02-24T08:28:11.826788+0000","last_became_peered":"2026-02-24T08:28:11.826788+0000","last_unstale":"2026-02-24T08:29:51.213420+0000","last_undegraded":"2026-02-24T08:29:51.213420+0000","last_fullsized":"2026-02-24T08:29:51.213420+0000","mapping_epoch":75,"log_start":"82'14300","ondisk_log_start":"82'14300","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'16840","last_scrub_stamp":"2026-02-24T08:29:14.052945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:14.052945+0000","objects_scrubbed":2092,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:31.241843+0000","scrub_duration":1386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97386496,"num_objects":1486,"num_object_clones":0,"num_object_copies":4458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24353,"num_write_kb":183744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"82'24415","reported_seq":24470,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:50.969282+0000","last_change":"2026-02-24T08:29:27.818853+0000","last_active":"2026-02-24T08:29:50.969282+0000","last_peered":"2026-02-24T08:29:50.969282+0000","last_clean":"2026-02-24T08:29:50.969282+0000","last_became_active":"2026-02-24T08:28:11.826952+0000","last_became_peered":"2026-02-24T08:28:11.826952+0000","last_unstale":"2026-02-24T08:29:50.969282+0000","last_undegraded":"2026-02-24T08:29:50.969282+0000","last_fullsized":"2026-02-24T08:29:50.969282+0000","mapping_epoch":75,"log_start":"82'14400","ondisk_log_start":"82'14400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'19592","last_scrub_stamp":"2026-02-24T08:29:27.818810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:27.818810+0000","objects_scrubbed":2449,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:30.750603+0000","scrub_duration":383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98041856,"num_objects":1496,"num_object_clones":0,"num_object_copies":4488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24415,"num_write_kb":184256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"82'24425","reported_seq":24479,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:29:50.986861+0000","last_change":"2026-02-24T08:29:15.834474+0000","last_active":"2026-02-24T08:29:50.986861+0000","last_peered":"2026-02-24T08:29:50.986861+0000","last_clean":"2026-02-24T08:29:50.986861+0000","last_became_active":"2026-02-24T08:28:11.830406+0000","last_became_peered":"2026-02-24T08:28:11.830406+0000","last_unstale":"2026-02-24T08:29:50.986861+0000","last_undegraded":"2026-02-24T08:29:50.986861+0000","last_fullsized":"2026-02-24T08:29:50.986861+0000","mapping_epoch":75,"log_start":"82'14400","ondisk_log_start":"82'14400","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'17480","last_scrub_stamp":"2026-02-24T08:29:15.834411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:28:10.813810+0000","last_clean_scrub_stamp":"2026-02-24T08:29:15.834411+0000","objects_scrubbed":2172,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:43.605376+0000","scrub_duration":1115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97386496,"num_objects":1486,"num_object_clones":0,"num_object_copies":4458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24425,"num_write_kb":184256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2026-02-24T08:28:54.925371+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:28:54.925371+0000","last_peered":"2026-02-24T08:28:54.925371+0000","last_clean":"2026-02-24T08:28:54.925371+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:28:54.925371+0000","last_undegraded":"2026-02-24T08:28:54.925371+0000","last_fullsized":"2026-02-24T08:28:54.925371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1544126488,"num_objects":23563,"num_object_clones":0,"num_object_copies":70689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23563,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":393936,"num_write_kb":2968865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4641435648,"data_stored":4641423432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160736,"ondisk_log_size":160736,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6271,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247924,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2385664,"kb_used_data":1028972,"kb_used_omap":17,"kb_used_meta":1356654,"kb_avail":731617536,"statfs":{"total":751619276800,"available":749176356864,"internally_reserved":0,"allocated":1053667328,"data_stored":1053146781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17680,"internal_metadata":1389214448},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2642212,"kb_used_data":1193872,"kb_used_omap":20,"kb_used_meta":1448299,"kb_avail":731360988,"statfs":{"total":751619276800,"available":748913651712,"internally_reserved":0,"allocated":1222524928,"data_stored":1222000309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20750,"internal_metadata":1483058930},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2602464,"kb_used_data":1412492,"kb_used_omap":16,"kb_used_meta":1189871,"kb_avail":731400736,"statfs":{"total":751619276800,"available":748954353664,"internally_reserved":0,"allocated":1446391808,"data_stored":1445870741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16840,"internal_metadata":1218428472},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705786,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2610340,"kb_used_data":1250768,"kb_used_omap":17,"kb_used_meta":1358958,"kb_avail":731392860,"statfs":{"total":751619276800,"available":748946288640,"internally_reserved":0,"allocated":1280786432,"data_stored":1280261813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17498,"internal_metadata":1391573926},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,5,10,19,14,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6271,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1168871424,"data_stored":1168867352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1327730688,"data_stored":1327726616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1171623936,"data_stored":1171619864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":973209600,"data_stored":973209600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:29:54.261 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:29:54.261 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_4 pg_num 76 2026-02-24T08:29:54.284 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/558369013' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:54.409 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:54.561 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:54.554+0000 7f489799b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:54.561 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:54.556+0000 7f489799b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:54.711 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:29:54.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:29:55.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:55 trial105 ceph-mon[39442]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:29:55.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3307994548' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_4", "var": "pg_num", "val": "76"} : dispatch 2026-02-24T08:29:55.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:55 trial105 ceph-mon[39442]: pgmap v342: 17 pgs: 17 active+clean; 1.4 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 4.0 MiB/s wr, 2.41k op/s 2026-02-24T08:29:56.214 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:29:56.372 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:56.496 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:56.492+0000 7fef25d76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:56.496 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:56.493+0000 7fef25d76640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:56.514 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:56.514 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:56.528 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:56.529 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:56.543 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:56.543 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:56.559 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:56.560 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:56.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2451314756' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:57.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:57 trial105 ceph-mon[39442]: pgmap v343: 17 pgs: 17 active+clean; 467 MiB data, 6.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 4.0 MiB/s wr, 3.75k op/s 2026-02-24T08:29:58.421 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Removed 46389 objects 2026-02-24T08:29:58.421 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Clean up completed and total clean up time :14.4787 2026-02-24T08:29:58.607 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:29:58.724 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:58.819 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:58.816+0000 7fef68ad5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:58.820 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:58 trial105 ceph-mon[39442]: osdmap e83: 4 total, 4 up, 4 in 2026-02-24T08:29:58.820 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:58.817+0000 7fef68ad5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:58.832 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:29:58.833 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:29:58.843 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:29:58.843 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:29:58.855 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:29:58.855 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:29:58.865 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:29:58.866 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:29:59.753 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:29:59.754 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:29:59.871 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:29:59.892 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:29:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:29:59] "GET /metrics HTTP/1.1" 200 4230 "" "Prometheus/3.6.0" 2026-02-24T08:29:59.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:59 trial105 ceph-mon[39442]: pgmap v345: 17 pgs: 17 active+clean; 467 MiB data, 6.9 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 3.20k op/s 2026-02-24T08:29:59.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/211710488' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:29:59.893 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:29:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:29:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:29:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:29:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:29:59.968 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:59.964+0000 7f3234de7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:29:59.968 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:29:59.965+0000 7f3234de7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:00.560 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:30:00.608 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:30:00.725 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:00.828 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:00.824+0000 7fb88a809640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:00.828 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:00.824+0000 7fb88a809640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:00.828 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4251332617' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:30:00.900 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:01.015 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:01.113 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:01.110+0000 7f083c3cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:01.114 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:01.110+0000 7f083c3cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:01.126 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:01.126 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:01.136 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:01.137 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:01.148 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:01.148 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:01.159 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:01.159 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:01.560 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:30:01.598 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:30:01.711 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:01.813 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:01.809+0000 7fe0c4af8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:01.813 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:01.809+0000 7fe0c4af8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:01.813 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4251332617' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:30:01.813 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:01 trial105 ceph-mon[39442]: osdmap e84: 4 total, 4 up, 4 in 2026-02-24T08:30:01.813 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:01 trial105 ceph-mon[39442]: pgmap v347: 17 pgs: 17 active+clean; 467 MiB data, 6.9 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.01k op/s 2026-02-24T08:30:01.813 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3723014007' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:30:01.813 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1077426838' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:02.077 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:30:02.115 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:30:02.232 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:02.332 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:02.328+0000 7f630b3d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:02.332 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:02.328+0000 7f630b3d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:02.687 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_4 2026-02-24T08:30:02.687 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2026-02-24T08:30:02.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3723014007' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:30:02.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:02 trial105 ceph-mon[39442]: osdmap e85: 4 total, 4 up, 4 in 2026-02-24T08:30:02.690 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3934768206' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:30:02.690 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3934768206' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:30:02.690 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:02 trial105 ceph-mon[39442]: osdmap e86: 4 total, 4 up, 4 in 2026-02-24T08:30:02.690 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/622207491' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:30:02.804 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:02.910 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:02.906+0000 7fbd67e18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:02.910 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:02.906+0000 7fbd67e18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:03.078 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_4' removed 2026-02-24T08:30:03.078 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:30:03.121 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T08:30:03.121 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T08:30:03.122 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_5 2026-02-24T08:30:03.122 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool create unique_pool_5 16 2026-02-24T08:30:03.126 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:30:03.127 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:03.194 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:03.237 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:03.282 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:03.328 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:03.350 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:03.347+0000 7f806ea1b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:03.351 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:03.347+0000 7f806ea1b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:03.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:03.379+0000 7ff8a4a80640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:03.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:03.380+0000 7ff8a4a80640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:03.442 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:03.439+0000 7f54dccf8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:03.443 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:03.439+0000 7f54dccf8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:03.457 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:03.458 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:03.468 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:03.468 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:03.480 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:03.480 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:03.492 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:03.493 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:03.495 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:30:03.496 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:30:03.535 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2026-02-24T08:30:03.077134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5449400,"kb_used_data":5032,"kb_used_omap":74,"kb_used_meta":5444213,"kb_avail":2930563400,"statfs":{"total":3006477107200,"available":3000896921600,"internally_reserved":0,"allocated":5152768,"data_stored":3034905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":76046,"internal_metadata":5574874866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,11,22,24,22,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-489521176,"num_objects":-7471,"num_object_clones":0,"num_object_copies":-22413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7471,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-410028,"num_write_kb":-2968865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.310171"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2026-02-24T08:30:00.559807+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:30:00.559807+0000","last_peered":"2026-02-24T08:30:00.559807+0000","last_clean":"2026-02-24T08:30:00.559807+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:00.559807+0000","last_undegraded":"2026-02-24T08:30:00.559807+0000","last_fullsized":"2026-02-24T08:30:00.559807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6361,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247926,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1394188,"kb_used_data":1400,"kb_used_omap":17,"kb_used_meta":1392750,"kb_avail":732609012,"statfs":{"total":751619276800,"available":750191628288,"internally_reserved":0,"allocated":1433600,"data_stored":905216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18350,"internal_metadata":1426176082},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1467992,"kb_used_data":1412,"kb_used_omap":21,"kb_used_meta":1466538,"kb_avail":732535208,"statfs":{"total":751619276800,"available":750116052992,"internally_reserved":0,"allocated":1445888,"data_stored":909625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22054,"internal_metadata":1501735386},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1208776,"kb_used_data":820,"kb_used_omap":17,"kb_used_meta":1207918,"kb_avail":732794424,"statfs":{"total":751619276800,"available":750381490176,"internally_reserved":0,"allocated":839680,"data_stored":314848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17492,"internal_metadata":1236908972},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,11,22,24,22,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705788,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1378444,"kb_used_data":1400,"kb_used_omap":17,"kb_used_meta":1377006,"kb_avail":732624756,"statfs":{"total":751619276800,"available":750207750144,"internally_reserved":0,"allocated":1433600,"data_stored":905216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18150,"internal_metadata":1410054426},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6361,"internal_metadata":0}]}} 2026-02-24T08:30:03.536 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:03.599 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:03 trial105 ceph-mon[39442]: pgmap v350: 17 pgs: 17 active+clean; 577 KiB data, 5.2 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 1.43k op/s 2026-02-24T08:30:03.599 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/226093793' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:30:03.599 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/622207491' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:30:03.599 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/226093793' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_4", "pool2": "unique_pool_4", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:30:03.599 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:03 trial105 ceph-mon[39442]: osdmap e87: 4 total, 4 up, 4 in 2026-02-24T08:30:03.599 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4035102271' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:03.599 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1586227983' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16} : dispatch 2026-02-24T08:30:03.698 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:03.792 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:03.789+0000 7f49c1589640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:03.792 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:03.789+0000 7f49c1589640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:03.901 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:30:03.901 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:30:03.936 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2026-02-24T08:30:03.077134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5449400,"kb_used_data":5032,"kb_used_omap":74,"kb_used_meta":5444213,"kb_avail":2930563400,"statfs":{"total":3006477107200,"available":3000896921600,"internally_reserved":0,"allocated":5152768,"data_stored":3034905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":76046,"internal_metadata":5574874866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,11,22,24,22,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-489521176,"num_objects":-7471,"num_object_clones":0,"num_object_copies":-22413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7471,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-410028,"num_write_kb":-2968865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.310171"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2026-02-24T08:30:00.559807+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:30:00.559807+0000","last_peered":"2026-02-24T08:30:00.559807+0000","last_clean":"2026-02-24T08:30:00.559807+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:00.559807+0000","last_undegraded":"2026-02-24T08:30:00.559807+0000","last_fullsized":"2026-02-24T08:30:00.559807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6361,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247926,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1394188,"kb_used_data":1400,"kb_used_omap":17,"kb_used_meta":1392750,"kb_avail":732609012,"statfs":{"total":751619276800,"available":750191628288,"internally_reserved":0,"allocated":1433600,"data_stored":905216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18350,"internal_metadata":1426176082},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1467992,"kb_used_data":1412,"kb_used_omap":21,"kb_used_meta":1466538,"kb_avail":732535208,"statfs":{"total":751619276800,"available":750116052992,"internally_reserved":0,"allocated":1445888,"data_stored":909625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22054,"internal_metadata":1501735386},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1208776,"kb_used_data":820,"kb_used_omap":17,"kb_used_meta":1207918,"kb_avail":732794424,"statfs":{"total":751619276800,"available":750381490176,"internally_reserved":0,"allocated":839680,"data_stored":314848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17492,"internal_metadata":1236908972},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,11,22,24,22,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705788,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1378444,"kb_used_data":1400,"kb_used_omap":17,"kb_used_meta":1377006,"kb_avail":732624756,"statfs":{"total":751619276800,"available":750207750144,"internally_reserved":0,"allocated":1433600,"data_stored":905216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18150,"internal_metadata":1410054426},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6361,"internal_metadata":0}]}} 2026-02-24T08:30:03.937 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:30:03.937 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:30:04.078 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_5' created 2026-02-24T08:30:04.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:04 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:30:04.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:04 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:30:04.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:04 trial105 ceph-mon[39442]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:30:04.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:04 trial105 ceph-mon[39442]: from='client.15280 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:30:04.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:04 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1586227983' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_5", "pg_num": 16}]': finished 2026-02-24T08:30:04.690 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:04 trial105 ceph-mon[39442]: osdmap e88: 4 total, 4 up, 4 in 2026-02-24T08:30:04.792 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2026-02-24T08:30:04.908 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:05.342 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:05.314+0000 7f1234124640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:05.343 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:05.315+0000 7f1234124640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:05.532 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:05.650 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:05.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:05 trial105 ceph-mon[39442]: pgmap v353: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 5.2 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:30:05.688 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:05 trial105 ceph-mon[39442]: osdmap e89: 4 total, 4 up, 4 in 2026-02-24T08:30:05.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:05 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/141042431' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:30:06.079 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:06.079 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:06.080 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:06.042+0000 7f1f25f46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:06.080 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:06.043+0000 7f1f25f46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:06.080 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:06.080 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:06.081 INFO:teuthology.orchestra.run.trial105.stderr:enabled application 'rados' on pool 'unique_pool_5' 2026-02-24T08:30:06.081 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:06.081 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:06.092 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:06.093 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:06.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:06 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3909015282' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:06.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:06 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/141042431' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_5", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:30:06.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:06 trial105 ceph-mon[39442]: osdmap e90: 4 total, 4 up, 4 in 2026-02-24T08:30:07.644 DEBUG:teuthology.orchestra.run.trial105:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_5 bench 90 write' 2026-02-24T08:30:07.644 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:30:07.645 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:07.648 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T08:30:07.648 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T08:30:07.696 INFO:tasks.radosbench.radosbench.0.trial105.stdout:hints = 1 2026-02-24T08:30:07.696 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T08:30:07.696 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object prefix: benchmark_data_trial105_129399 2026-02-24T08:30:07.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:30:07.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 0 0 0 0 0 0 - 0 2026-02-24T08:30:07.781 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:07.840 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:07 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:30:07.840 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:07 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:30:07.840 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:07 trial105 ceph-mon[39442]: pgmap v356: 17 pgs: 17 active+clean; 577 KiB data, 5.2 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:30:07.907 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:07.903+0000 7f2826214640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:07.907 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:07.904+0000 7f2826214640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:08.057 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:30:08.057 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:30:08.107 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2026-02-24T08:30:07.568885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5449676,"kb_used_data":5308,"kb_used_omap":86,"kb_used_meta":5444201,"kb_avail":2930563124,"statfs":{"total":3006477107200,"available":3000896638976,"internally_reserved":0,"allocated":5435392,"data_stored":3137804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":88409,"internal_metadata":5574862503},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.491751"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.106386+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:30:05.106386+0000","last_peered":"2026-02-24T08:30:05.106386+0000","last_clean":"2026-02-24T08:30:05.106386+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:30:05.106386+0000","last_undegraded":"2026-02-24T08:30:05.106386+0000","last_fullsized":"2026-02-24T08:30:05.106386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.989791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.105215+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:30:05.105215+0000","last_peered":"2026-02-24T08:30:05.105215+0000","last_clean":"2026-02-24T08:30:05.105215+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:30:05.105215+0000","last_undegraded":"2026-02-24T08:30:05.105215+0000","last_fullsized":"2026-02-24T08:30:05.105215+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:17.151562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.105683+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:30:05.105683+0000","last_peered":"2026-02-24T08:30:05.105683+0000","last_clean":"2026-02-24T08:30:05.105683+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:30:05.105683+0000","last_undegraded":"2026-02-24T08:30:05.105683+0000","last_fullsized":"2026-02-24T08:30:05.105683+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:18.153946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.099956+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:30:05.099956+0000","last_peered":"2026-02-24T08:30:05.099956+0000","last_clean":"2026-02-24T08:30:05.099956+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:30:05.099956+0000","last_undegraded":"2026-02-24T08:30:05.099956+0000","last_fullsized":"2026-02-24T08:30:05.099956+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.238003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.105061+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:30:05.105061+0000","last_peered":"2026-02-24T08:30:05.105061+0000","last_clean":"2026-02-24T08:30:05.105061+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:30:05.105061+0000","last_undegraded":"2026-02-24T08:30:05.105061+0000","last_fullsized":"2026-02-24T08:30:05.105061+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.639921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.105083+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:30:05.105083+0000","last_peered":"2026-02-24T08:30:05.105083+0000","last_clean":"2026-02-24T08:30:05.105083+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:30:05.105083+0000","last_undegraded":"2026-02-24T08:30:05.105083+0000","last_fullsized":"2026-02-24T08:30:05.105083+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.606964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.106076+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:30:05.106076+0000","last_peered":"2026-02-24T08:30:05.106076+0000","last_clean":"2026-02-24T08:30:05.106076+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:30:05.106076+0000","last_undegraded":"2026-02-24T08:30:05.106076+0000","last_fullsized":"2026-02-24T08:30:05.106076+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:24.704600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.105073+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:30:05.105073+0000","last_peered":"2026-02-24T08:30:05.105073+0000","last_clean":"2026-02-24T08:30:05.105073+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:30:05.105073+0000","last_undegraded":"2026-02-24T08:30:05.105073+0000","last_fullsized":"2026-02-24T08:30:05.105073+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:09.467206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.105443+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:30:05.105443+0000","last_peered":"2026-02-24T08:30:05.105443+0000","last_clean":"2026-02-24T08:30:05.105443+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:30:05.105443+0000","last_undegraded":"2026-02-24T08:30:05.105443+0000","last_fullsized":"2026-02-24T08:30:05.105443+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.141845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.105355+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:30:05.105355+0000","last_peered":"2026-02-24T08:30:05.105355+0000","last_clean":"2026-02-24T08:30:05.105355+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:30:05.105355+0000","last_undegraded":"2026-02-24T08:30:05.105355+0000","last_fullsized":"2026-02-24T08:30:05.105355+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:10.445186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.106383+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:30:05.106383+0000","last_peered":"2026-02-24T08:30:05.106383+0000","last_clean":"2026-02-24T08:30:05.106383+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:30:05.106383+0000","last_undegraded":"2026-02-24T08:30:05.106383+0000","last_fullsized":"2026-02-24T08:30:05.106383+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.076000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.106923+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:30:05.106923+0000","last_peered":"2026-02-24T08:30:05.106923+0000","last_clean":"2026-02-24T08:30:05.106923+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:30:05.106923+0000","last_undegraded":"2026-02-24T08:30:05.106923+0000","last_fullsized":"2026-02-24T08:30:05.106923+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.961925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.104496+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:30:05.104496+0000","last_peered":"2026-02-24T08:30:05.104496+0000","last_clean":"2026-02-24T08:30:05.104496+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:30:05.104496+0000","last_undegraded":"2026-02-24T08:30:05.104496+0000","last_fullsized":"2026-02-24T08:30:05.104496+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.448917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.105638+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:30:05.105638+0000","last_peered":"2026-02-24T08:30:05.105638+0000","last_clean":"2026-02-24T08:30:05.105638+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:30:05.105638+0000","last_undegraded":"2026-02-24T08:30:05.105638+0000","last_fullsized":"2026-02-24T08:30:05.105638+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.632360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.099860+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:30:05.099860+0000","last_peered":"2026-02-24T08:30:05.099860+0000","last_clean":"2026-02-24T08:30:05.099860+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:30:05.099860+0000","last_undegraded":"2026-02-24T08:30:05.099860+0000","last_fullsized":"2026-02-24T08:30:05.099860+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.218896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.106092+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:30:05.106092+0000","last_peered":"2026-02-24T08:30:05.106092+0000","last_clean":"2026-02-24T08:30:05.106092+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:30:05.106092+0000","last_undegraded":"2026-02-24T08:30:05.106092+0000","last_fullsized":"2026-02-24T08:30:05.106092+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:32.997707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":229,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-24T08:30:05.079160+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:30:05.079160+0000","last_peered":"2026-02-24T08:30:05.079160+0000","last_clean":"2026-02-24T08:30:05.079160+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:05.079160+0000","last_undegraded":"2026-02-24T08:30:05.079160+0000","last_fullsized":"2026-02-24T08:30:05.079160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6478,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1394260,"kb_used_data":1472,"kb_used_omap":20,"kb_used_meta":1392747,"kb_avail":732608940,"statfs":{"total":751619276800,"available":750191554560,"internally_reserved":0,"allocated":1507328,"data_stored":932043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20933,"internal_metadata":1426173499},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444153,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1468052,"kb_used_data":1472,"kb_used_omap":24,"kb_used_meta":1466535,"kb_avail":732535148,"statfs":{"total":751619276800,"available":750115991552,"internally_reserved":0,"allocated":1507328,"data_stored":932043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24662,"internal_metadata":1501732778},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1208848,"kb_used_data":892,"kb_used_omap":20,"kb_used_meta":1207915,"kb_avail":732794352,"statfs":{"total":751619276800,"available":750381416448,"internally_reserved":0,"allocated":913408,"data_stored":341675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21404,"internal_metadata":1236905060},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705789,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1378516,"kb_used_data":1472,"kb_used_omap":20,"kb_used_meta":1377003,"kb_avail":732624684,"statfs":{"total":751619276800,"available":750207676416,"internally_reserved":0,"allocated":1507328,"data_stored":932043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21410,"internal_metadata":1410051166},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6478,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:30:08.109 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:30:08.109 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 201 2026-02-24T08:30:08.263 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:08.401 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:08.397+0000 7f0408f32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:08.401 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:08.398+0000 7f0408f32640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:08.554 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:30:08.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:30:08.658 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:08.683 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:08 trial105 ceph-mon[39442]: osdmap e91: 4 total, 4 up, 4 in 2026-02-24T08:30:08.684 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4107838332' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "201"} : dispatch 2026-02-24T08:30:08.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 1 128 10203 10075 78.7008 78.7109 0.0030652 0.0125592 2026-02-24T08:30:08.809 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:08.932 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:08.928+0000 7fed9cd0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:08.933 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:08.929+0000 7fed9cd0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:08.953 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:08.954 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:08.969 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:08.969 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:08.982 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:08.982 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:08.995 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:08.995 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:09.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:30:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:30:09.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:30:09.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 2 128 19455 19327 75.4881 72.2812 0.00306617 0.0131867 2026-02-24T08:30:09.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:09 trial105 ceph-mon[39442]: from='client.15289 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:30:09.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:09 trial105 ceph-mon[39442]: pgmap v358: 17 pgs: 17 active+clean; 577 KiB data, 5.2 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:30:09.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:09 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1693555757' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:09.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:30:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:30:09] "GET /metrics HTTP/1.1" 200 4230 "" "Prometheus/3.6.0" 2026-02-24T08:30:10.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 3 128 28784 28656 74.6177 72.8828 0.013234 0.0133594 2026-02-24T08:30:11.043 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:11.216 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:11.347 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:11.344+0000 7fb452139640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:11.347 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:11.344+0000 7fb452139640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:11.367 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:11.367 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:11.383 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:11.383 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:11.398 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:11.398 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:11.415 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:11.415 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:11.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 4 127 38041 37914 74.0439 72.3281 0.00964371 0.0134717 2026-02-24T08:30:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:11 trial105 ceph-mon[39442]: pgmap v359: 17 pgs: 17 active+clean; 577 KiB data, 5.2 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:30:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4172188358' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:12.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 5 128 46867 46739 73.0231 68.9453 0.010365 0.0136656 2026-02-24T08:30:13.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:13 trial105 ceph-mon[39442]: osdmap e92: 4 total, 4 up, 4 in 2026-02-24T08:30:13.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:13 trial105 ceph-mon[39442]: pgmap v361: 17 pgs: 17 active+clean; 253 MiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 38 MiB/s wr, 4.84k op/s 2026-02-24T08:30:13.466 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:13.599 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:30:13.599 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:30:13.599 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:30:13.600 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:13.625 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:13.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 6 127 54990 54863 71.4302 63.4688 0.00632219 0.0139635 2026-02-24T08:30:13.759 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:13.764 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:13.760+0000 7f3adb766640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:13.764 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:13.761+0000 7f3adb766640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:13.793 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:13.793 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:13.808 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:13.808 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:13.823 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:13.823 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:13.838 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:13.838 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:13.901 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:13.898+0000 7f33f7a61640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:13.902 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:13.899+0000 7f33f7a61640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:14.077 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:30:14.078 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:30:14.131 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2026-02-24T08:30:12.768660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":265691680,"num_objects":4050,"num_object_clones":0,"num_object_copies":12150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4050,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":32496,"num_write_kb":261038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32460,"ondisk_log_size":32460,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6169068,"kb_used_data":634460,"kb_used_omap":91,"kb_used_meta":5534436,"kb_avail":2929843732,"statfs":{"total":3006477107200,"available":3000159981568,"internally_reserved":0,"allocated":649687040,"data_stored":647327928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93647,"internal_metadata":5667263025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,8,11,28],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":265101312,"num_objects":4048,"num_object_clones":0,"num_object_copies":12144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32361,"num_write_kb":258888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.690033"},"pg_stats":[{"pgid":"7.f","version":"91'1821","reported_seq":1831,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.015051+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:30:11.015051+0000","last_peered":"2026-02-24T08:30:11.015051+0000","last_clean":"2026-02-24T08:30:11.015051+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:30:11.015051+0000","last_undegraded":"2026-02-24T08:30:11.015051+0000","last_fullsized":"2026-02-24T08:30:11.015051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:14.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14917632,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1821,"num_write_kb":14568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"91'2216","reported_seq":2232,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.271127+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:30:11.271127+0000","last_peered":"2026-02-24T08:30:11.271127+0000","last_clean":"2026-02-24T08:30:11.271127+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:30:11.271127+0000","last_undegraded":"2026-02-24T08:30:11.271127+0000","last_fullsized":"2026-02-24T08:30:11.271127+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":2216,"log_dups_size":0,"ondisk_log_size":2216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.818357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2216,"num_write_kb":17728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"91'2008","reported_seq":2023,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.001860+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:30:11.001860+0000","last_peered":"2026-02-24T08:30:11.001860+0000","last_clean":"2026-02-24T08:30:11.001860+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:30:11.001860+0000","last_undegraded":"2026-02-24T08:30:11.001860+0000","last_fullsized":"2026-02-24T08:30:11.001860+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:25.219394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2008,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"91'1992","reported_seq":2007,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.002445+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:30:11.002445+0000","last_peered":"2026-02-24T08:30:11.002445+0000","last_clean":"2026-02-24T08:30:11.002445+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:30:11.002445+0000","last_undegraded":"2026-02-24T08:30:11.002445+0000","last_fullsized":"2026-02-24T08:30:11.002445+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16318464,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":15936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"91'2224","reported_seq":2240,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.271017+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:30:11.271017+0000","last_peered":"2026-02-24T08:30:11.271017+0000","last_clean":"2026-02-24T08:30:11.271017+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:30:11.271017+0000","last_undegraded":"2026-02-24T08:30:11.271017+0000","last_fullsized":"2026-02-24T08:30:11.271017+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:27.543130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2224,"num_write_kb":17792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"91'2088","reported_seq":2099,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.271554+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:30:11.271554+0000","last_peered":"2026-02-24T08:30:11.271554+0000","last_clean":"2026-02-24T08:30:11.271554+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:30:11.271554+0000","last_undegraded":"2026-02-24T08:30:11.271554+0000","last_fullsized":"2026-02-24T08:30:11.271554+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.952817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2088,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"91'1920","reported_seq":1934,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.016308+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:30:11.016308+0000","last_peered":"2026-02-24T08:30:11.016308+0000","last_clean":"2026-02-24T08:30:11.016308+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:30:11.016308+0000","last_undegraded":"2026-02-24T08:30:11.016308+0000","last_fullsized":"2026-02-24T08:30:11.016308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.381504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1920,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"91'2128","reported_seq":2144,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.261951+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:30:11.261951+0000","last_peered":"2026-02-24T08:30:11.261951+0000","last_clean":"2026-02-24T08:30:11.261951+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:30:11.261951+0000","last_undegraded":"2026-02-24T08:30:11.261951+0000","last_fullsized":"2026-02-24T08:30:11.261951+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":2128,"log_dups_size":0,"ondisk_log_size":2128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.844678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2128,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"91'1912","reported_seq":1925,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.050330+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:30:11.050330+0000","last_peered":"2026-02-24T08:30:11.050330+0000","last_clean":"2026-02-24T08:30:11.050330+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:30:11.050330+0000","last_undegraded":"2026-02-24T08:30:11.050330+0000","last_fullsized":"2026-02-24T08:30:11.050330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:09.068967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"91'2241","reported_seq":2249,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.047109+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:30:11.047109+0000","last_peered":"2026-02-24T08:30:11.047109+0000","last_clean":"2026-02-24T08:30:11.047109+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:30:11.047109+0000","last_undegraded":"2026-02-24T08:30:11.047109+0000","last_fullsized":"2026-02-24T08:30:11.047109+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":2241,"log_dups_size":0,"ondisk_log_size":2241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:26.161441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18358272,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2241,"num_write_kb":17928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"91'1988","reported_seq":1997,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.013356+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:30:11.013356+0000","last_peered":"2026-02-24T08:30:11.013356+0000","last_clean":"2026-02-24T08:30:11.013356+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:30:11.013356+0000","last_undegraded":"2026-02-24T08:30:11.013356+0000","last_fullsized":"2026-02-24T08:30:11.013356+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":1988,"log_dups_size":0,"ondisk_log_size":1988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.934365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16285696,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":249,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1988,"num_write_kb":15904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"91'1904","reported_seq":1914,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.013437+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:30:11.013437+0000","last_peered":"2026-02-24T08:30:11.013437+0000","last_clean":"2026-02-24T08:30:11.013437+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:30:11.013437+0000","last_undegraded":"2026-02-24T08:30:11.013437+0000","last_fullsized":"2026-02-24T08:30:11.013437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":1904,"log_dups_size":0,"ondisk_log_size":1904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.117167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":238,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1904,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"91'2000","reported_seq":2016,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:10.991265+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:30:10.991265+0000","last_peered":"2026-02-24T08:30:10.991265+0000","last_clean":"2026-02-24T08:30:10.991265+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:30:10.991265+0000","last_undegraded":"2026-02-24T08:30:10.991265+0000","last_fullsized":"2026-02-24T08:30:10.991265+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.550268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2000,"num_write_kb":16000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"91'1936","reported_seq":1949,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.007244+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:30:11.007244+0000","last_peered":"2026-02-24T08:30:11.007244+0000","last_clean":"2026-02-24T08:30:11.007244+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:30:11.007244+0000","last_undegraded":"2026-02-24T08:30:11.007244+0000","last_fullsized":"2026-02-24T08:30:11.007244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":1936,"log_dups_size":0,"ondisk_log_size":1936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:16.331857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1936,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"91'1914","reported_seq":1923,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.009777+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:30:11.009777+0000","last_peered":"2026-02-24T08:30:11.009777+0000","last_clean":"2026-02-24T08:30:11.009777+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:30:11.009777+0000","last_undegraded":"2026-02-24T08:30:11.009777+0000","last_fullsized":"2026-02-24T08:30:11.009777+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:24.692891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15679488,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1914,"num_write_kb":15312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"91'2069","reported_seq":2080,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:11.014323+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:30:11.014323+0000","last_peered":"2026-02-24T08:30:11.014323+0000","last_clean":"2026-02-24T08:30:11.014323+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:30:11.014323+0000","last_undegraded":"2026-02-24T08:30:11.014323+0000","last_fullsized":"2026-02-24T08:30:11.014323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":2069,"log_dups_size":0,"ondisk_log_size":2069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.282586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16949248,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2069,"num_write_kb":16552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":233,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-24T08:30:07.699585+0000","last_change":"2026-02-24T08:28:54.925371+0000","last_active":"2026-02-24T08:30:07.699585+0000","last_peered":"2026-02-24T08:30:07.699585+0000","last_clean":"2026-02-24T08:30:07.699585+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:07.699585+0000","last_undegraded":"2026-02-24T08:30:07.699585+0000","last_fullsized":"2026-02-24T08:30:07.699585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:28:54.925334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:28:54.925334+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:30:16.307544+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":265101312,"num_objects":4048,"num_object_clones":0,"num_object_copies":12144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32361,"num_write_kb":258888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":797925376,"data_stored":797925376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32361,"ondisk_log_size":32361,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6550,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247928,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1544556,"kb_used_data":133720,"kb_used_omap":21,"kb_used_meta":1410794,"kb_avail":732458644,"statfs":{"total":751619276800,"available":750037651456,"internally_reserved":0,"allocated":136929280,"data_stored":136338614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22259,"internal_metadata":1444653325},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444154,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1635684,"kb_used_data":151056,"kb_used_omap":25,"kb_used_meta":1484582,"kb_avail":732367516,"statfs":{"total":751619276800,"available":749944336384,"internally_reserved":0,"allocated":154681344,"data_stored":154090678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25966,"internal_metadata":1520212626},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1430440,"kb_used_data":186388,"kb_used_omap":22,"kb_used_meta":1244009,"kb_avail":732572760,"statfs":{"total":751619276800,"available":750154506240,"internally_reserved":0,"allocated":190861312,"data_stored":190274198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22708,"internal_metadata":1273866060},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[12,8,11,28],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705790,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1558388,"kb_used_data":163296,"kb_used_omap":22,"kb_used_meta":1395049,"kb_avail":732444812,"statfs":{"total":751619276800,"available":750023487488,"internally_reserved":0,"allocated":167215104,"data_stored":166624438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22714,"internal_metadata":1428531014},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6550,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":227500032,"data_stored":227500032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":229269504,"data_stored":229269504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159760384,"data_stored":159760384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":181395456,"data_stored":181395456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:30:14.132 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 201 2026-02-24T08:30:14.337 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:14.367 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:14 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/800314625' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:14.368 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:30:14.490 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:14.488+0000 7fb325e05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:14.493 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:14.490+0000 7fb325e05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:14.659 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:30:14.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 7 128 62262 62134 69.3402 56.8047 0.00529515 0.0143944 2026-02-24T08:30:14.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:30:15.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:15 trial105 ceph-mon[39442]: from='client.15299 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:30:15.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:15 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3575988862' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "201"} : dispatch 2026-02-24T08:30:15.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:15 trial105 ceph-mon[39442]: pgmap v362: 17 pgs: 17 active+clean; 253 MiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.04k op/s 2026-02-24T08:30:15.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 8 128 69567 69439 67.8059 57.0703 0.0173559 0.0147286 2026-02-24T08:30:15.897 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:16.056 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:16.178 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:16.175+0000 7f96b1d1c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:16.178 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:16.175+0000 7f96b1d1c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:16.179 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:16 trial105 ceph-mon[39442]: osdmap e93: 4 total, 4 up, 4 in 2026-02-24T08:30:16.202 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:16.203 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:16.220 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:16.220 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:16.237 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:16.237 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:16.253 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:16.253 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:16.697 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 9 127 76194 76067 66.0249 51.7812 0.00948531 0.0151152 2026-02-24T08:30:17.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:17 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2110199985' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:17.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:17 trial105 ceph-mon[39442]: pgmap v364: 17 pgs: 17 active+clean; 564 MiB data, 6.8 GiB used, 2.7 TiB / 2.7 TiB avail; 70 MiB/s wr, 9.01k op/s 2026-02-24T08:30:17.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:17 trial105 ceph-mon[39442]: osdmap e94: 4 total, 4 up, 4 in 2026-02-24T08:30:17.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 10 128 82560 82432 64.3946 49.7266 0.019808 0.0155111 2026-02-24T08:30:18.305 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:18.469 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:18.598 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:18.595+0000 7fa518b6a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:18.599 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:18.597+0000 7fa518b6a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:18.622 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:18.622 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:18.640 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:18.641 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:18.659 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:18.659 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:18.677 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:18.677 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:18.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 11 128 88975 88847 63.0964 50.1172 0.0299636 0.0158243 2026-02-24T08:30:18.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3228281771' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:19.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 12 128 94886 94758 61.6863 46.1797 0.0496329 0.0161902 2026-02-24T08:30:19.708 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:30:19.708 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:30:19.709 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:30:19.709 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:30:19.876 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:19.901 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:19 trial105 ceph-mon[39442]: pgmap v366: 17 pgs: 17 active+clean; 564 MiB data, 6.8 GiB used, 2.7 TiB / 2.7 TiB avail; 46 MiB/s wr, 5.94k op/s 2026-02-24T08:30:19.902 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:30:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:30:19] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-24T08:30:19.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:30:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:30:19.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:30:20.010 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:20.007+0000 7f1cab5d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:20.010 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:20.007+0000 7f1cab5d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:20.037 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:30:20.037 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:30:20.037 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:30:20.037 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:30:20.037 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:30:20.037 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:30:20.038 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:30:20.038 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:30:20.038 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:30:20.038 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:30:20.038 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:30:20.038 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:30:20.085 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:30:20.086 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:30:20.086 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:30:20.243 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:20.376 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:20.372+0000 7ff3013f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:20.376 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:20.373+0000 7ff3013f3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:20.400 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:30:20.401 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:30:20.443 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:30:20.443 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:30:20.444 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:30:20.603 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:20.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 13 128 100206 100078 60.1378 41.5625 0.0183533 0.016611 2026-02-24T08:30:20.735 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:20.741 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:20.737+0000 7fd10a7e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:20.743 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:20.740+0000 7fd10a7e8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:20.769 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:30:20.769 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:30:20.769 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:30:20.770 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:30:20.770 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:30:20.770 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:30:20.770 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:30:20.770 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:30:20.770 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:30:20.770 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:30:20.770 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:30:20.770 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:30:20.815 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:30:20.816 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:30:20.816 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:30:20.899 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:21.014 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:21.045 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:21.041+0000 7f3eebfe7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:21.045 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:21.042+0000 7f3eebfe7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:21.075 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:21.076 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:21.091 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:21.091 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:21.105 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:21.105 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:21.121 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:21.122 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:21.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 14 128 104111 103983 58.0214 30.5078 0.0122749 0.0171907 2026-02-24T08:30:22.113 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:21 trial105 ceph-mon[39442]: pgmap v367: 17 pgs: 17 active+clean; 564 MiB data, 6.8 GiB used, 2.7 TiB / 2.7 TiB avail; 39 MiB/s wr, 4.97k op/s 2026-02-24T08:30:22.114 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1622702926' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:22.159 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:22.111+0000 7f1a68efe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:22.159 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:22.111+0000 7f1a68efe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:22.160 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:30:22.160 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:30:22.160 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:30:22.160 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:30:22.160 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:30:22.160 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:30:22.160 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:30:22.160 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:30:22.160 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:30:22.161 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:30:22.161 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:30:22.161 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:30:22.428 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:30:22.429 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:30:22.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 15 127 108355 108228 56.3641 33.1641 0.00624708 0.0177209 2026-02-24T08:30:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:23 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:30:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:23 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:30:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:23 trial105 ceph-mon[39442]: pgmap v368: 17 pgs: 17 active+clean; 797 MiB data, 7.4 GiB used, 2.7 TiB / 2.7 TiB avail; 68 MiB/s wr, 8.70k op/s 2026-02-24T08:30:23.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 16 127 113572 113445 55.3885 40.7578 0.0666749 0.0180306 2026-02-24T08:30:23.956 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:24.111 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:24.256 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:24.253+0000 7f49e4e17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:24.257 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:24.255+0000 7f49e4e17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:24.279 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:24.279 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:24.293 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:24.293 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:24.310 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:24.310 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:24.326 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:24.326 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:24.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 17 128 118353 118225 54.3269 37.3438 0.00843451 0.0183802 2026-02-24T08:30:25.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:25 trial105 ceph-mon[39442]: osdmap e95: 4 total, 4 up, 4 in 2026-02-24T08:30:25.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/879036973' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:25.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:25 trial105 ceph-mon[39442]: pgmap v370: 17 pgs: 17 active+clean; 797 MiB data, 7.4 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.73k op/s 2026-02-24T08:30:25.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 18 128 123014 122886 53.3316 36.4141 0.0326709 0.0187299 2026-02-24T08:30:26.377 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:26.539 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:26.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:26.663+0000 7f83e5342640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:26.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:26.663+0000 7f83e5342640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:26.687 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:26.688 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:26.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 19 127 127418 127291 52.3358 34.4141 0.0860889 0.0190871 2026-02-24T08:30:26.705 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:26.705 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:26.722 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:26.722 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:26.737 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:26.738 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:26.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1354456160' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:27.430 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:30:27.430 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:30:27.430 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_5 2026-02-24T08:30:27.431 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:27.585 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:27.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:30:27.697271+0000 min lat: 0.000722661 max lat: 0.212026 avg lat: 0.0194457 2026-02-24T08:30:27.699 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:30:27.699 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 20 128 131623 131495 51.361 32.8438 0.0601929 0.0194457 2026-02-24T08:30:27.981 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:27 trial105 ceph-mon[39442]: pgmap v371: 17 pgs: 17 active+clean; 976 MiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 43 MiB/s wr, 5.45k op/s 2026-02-24T08:30:27.981 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:27 trial105 ceph-mon[39442]: osdmap e96: 4 total, 4 up, 4 in 2026-02-24T08:30:28.012 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:27.979+0000 7f4935695640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:28.012 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:27.979+0000 7f4935695640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:28.144 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:30:28.144 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:30:28.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 21 128 134697 134569 50.0588 24.0156 0.0227576 0.0199244 2026-02-24T08:30:28.785 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:28.863 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2026-02-24T08:30:27.080706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1023705632,"num_objects":15616,"num_object_clones":0,"num_object_copies":46848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15616,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":125027,"num_write_kb":1001286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124991,"ondisk_log_size":124991,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8447540,"kb_used_data":2954980,"kb_used_omap":101,"kb_used_meta":5492378,"kb_avail":2927565260,"statfs":{"total":3006477107200,"available":2997826826240,"internally_reserved":0,"allocated":3025899520,"data_stored":3023414616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104120,"internal_metadata":5624195400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,8,3,3,14,0,12,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":432373760,"num_objects":6599,"num_object_clones":0,"num_object_copies":19797,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6599,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52780,"num_write_kb":422240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.311200"},"pg_stats":[{"pgid":"7.f","version":"95'7504","reported_seq":7526,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.073813+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:30:26.073813+0000","last_peered":"2026-02-24T08:30:26.073813+0000","last_clean":"2026-02-24T08:30:26.073813+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:30:26.073813+0000","last_undegraded":"2026-02-24T08:30:26.073813+0000","last_fullsized":"2026-02-24T08:30:26.073813+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7504,"log_dups_size":0,"ondisk_log_size":7504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:14.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61472768,"num_objects":938,"num_object_clones":0,"num_object_copies":2814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7504,"num_write_kb":60032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"95'7936","reported_seq":7959,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.326288+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:30:26.326288+0000","last_peered":"2026-02-24T08:30:26.326288+0000","last_clean":"2026-02-24T08:30:26.326288+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:30:26.326288+0000","last_undegraded":"2026-02-24T08:30:26.326288+0000","last_fullsized":"2026-02-24T08:30:26.326288+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7936,"log_dups_size":0,"ondisk_log_size":7936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.818357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":992,"num_object_clones":0,"num_object_copies":2976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":992,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7936,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"95'8055","reported_seq":8072,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:25.976663+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:30:25.976663+0000","last_peered":"2026-02-24T08:30:25.976663+0000","last_clean":"2026-02-24T08:30:25.976663+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:30:25.976663+0000","last_undegraded":"2026-02-24T08:30:25.976663+0000","last_fullsized":"2026-02-24T08:30:25.976663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8055,"log_dups_size":0,"ondisk_log_size":8055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:25.219394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65986560,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1007,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8055,"num_write_kb":64440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"95'7743","reported_seq":7762,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.029536+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:30:26.029536+0000","last_peered":"2026-02-24T08:30:26.029536+0000","last_clean":"2026-02-24T08:30:26.029536+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:30:26.029536+0000","last_undegraded":"2026-02-24T08:30:26.029536+0000","last_fullsized":"2026-02-24T08:30:26.029536+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7743,"log_dups_size":0,"ondisk_log_size":7743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.445628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63430656,"num_objects":968,"num_object_clones":0,"num_object_copies":2904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":968,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7743,"num_write_kb":61944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"95'8096","reported_seq":8120,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.317863+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:30:26.317863+0000","last_peered":"2026-02-24T08:30:26.317863+0000","last_clean":"2026-02-24T08:30:26.317863+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:30:26.317863+0000","last_undegraded":"2026-02-24T08:30:26.317863+0000","last_fullsized":"2026-02-24T08:30:26.317863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8096,"log_dups_size":0,"ondisk_log_size":8096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:27.543130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66322432,"num_objects":1012,"num_object_clones":0,"num_object_copies":3036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8096,"num_write_kb":64768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"95'7682","reported_seq":7706,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.312606+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:30:26.312606+0000","last_peered":"2026-02-24T08:30:26.312606+0000","last_clean":"2026-02-24T08:30:26.312606+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:30:26.312606+0000","last_undegraded":"2026-02-24T08:30:26.312606+0000","last_fullsized":"2026-02-24T08:30:26.312606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7682,"log_dups_size":0,"ondisk_log_size":7682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.952817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62930944,"num_objects":961,"num_object_clones":0,"num_object_copies":2883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7682,"num_write_kb":61456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"95'7766","reported_seq":7773,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.066736+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:30:26.066736+0000","last_peered":"2026-02-24T08:30:26.066736+0000","last_clean":"2026-02-24T08:30:26.066736+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:30:26.066736+0000","last_undegraded":"2026-02-24T08:30:26.066736+0000","last_fullsized":"2026-02-24T08:30:26.066736+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7766,"log_dups_size":0,"ondisk_log_size":7766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.381504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63619072,"num_objects":971,"num_object_clones":0,"num_object_copies":2913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":971,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7766,"num_write_kb":62128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"95'7752","reported_seq":7776,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.305724+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:30:26.305724+0000","last_peered":"2026-02-24T08:30:26.305724+0000","last_clean":"2026-02-24T08:30:26.305724+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:30:26.305724+0000","last_undegraded":"2026-02-24T08:30:26.305724+0000","last_fullsized":"2026-02-24T08:30:26.305724+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7752,"log_dups_size":0,"ondisk_log_size":7752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.844678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63504384,"num_objects":969,"num_object_clones":0,"num_object_copies":2907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":969,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7752,"num_write_kb":62016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"95'7808","reported_seq":7832,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.058071+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:30:26.058071+0000","last_peered":"2026-02-24T08:30:26.058071+0000","last_clean":"2026-02-24T08:30:26.058071+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:30:26.058071+0000","last_undegraded":"2026-02-24T08:30:26.058071+0000","last_fullsized":"2026-02-24T08:30:26.058071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7808,"log_dups_size":0,"ondisk_log_size":7808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:09.068967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63963136,"num_objects":976,"num_object_clones":0,"num_object_copies":2928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7808,"num_write_kb":62464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"95'7912","reported_seq":7936,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.047607+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:30:26.047607+0000","last_peered":"2026-02-24T08:30:26.047607+0000","last_clean":"2026-02-24T08:30:26.047607+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:30:26.047607+0000","last_undegraded":"2026-02-24T08:30:26.047607+0000","last_fullsized":"2026-02-24T08:30:26.047607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7912,"log_dups_size":0,"ondisk_log_size":7912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:26.161441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64815104,"num_objects":989,"num_object_clones":0,"num_object_copies":2967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":989,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7912,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"95'8147","reported_seq":8169,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.030956+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:30:26.030956+0000","last_peered":"2026-02-24T08:30:26.030956+0000","last_clean":"2026-02-24T08:30:26.030956+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:30:26.030956+0000","last_undegraded":"2026-02-24T08:30:26.030956+0000","last_fullsized":"2026-02-24T08:30:26.030956+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8147,"log_dups_size":0,"ondisk_log_size":8147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.934365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66740224,"num_objects":1019,"num_object_clones":0,"num_object_copies":3057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1019,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8147,"num_write_kb":65176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"95'7519","reported_seq":7543,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.066989+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:30:26.066989+0000","last_peered":"2026-02-24T08:30:26.066989+0000","last_clean":"2026-02-24T08:30:26.066989+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:30:26.066989+0000","last_undegraded":"2026-02-24T08:30:26.066989+0000","last_fullsized":"2026-02-24T08:30:26.066989+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7519,"log_dups_size":0,"ondisk_log_size":7519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.117167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61595648,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7519,"num_write_kb":60152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"95'8040","reported_seq":8064,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.057737+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:30:26.057737+0000","last_peered":"2026-02-24T08:30:26.057737+0000","last_clean":"2026-02-24T08:30:26.057737+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:30:26.057737+0000","last_undegraded":"2026-02-24T08:30:26.057737+0000","last_fullsized":"2026-02-24T08:30:26.057737+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8040,"log_dups_size":0,"ondisk_log_size":8040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.550268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65863680,"num_objects":1005,"num_object_clones":0,"num_object_copies":3015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8040,"num_write_kb":64320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"95'7808","reported_seq":7831,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.022708+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:30:26.022708+0000","last_peered":"2026-02-24T08:30:26.022708+0000","last_clean":"2026-02-24T08:30:26.022708+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:30:26.022708+0000","last_undegraded":"2026-02-24T08:30:26.022708+0000","last_fullsized":"2026-02-24T08:30:26.022708+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7808,"log_dups_size":0,"ondisk_log_size":7808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:16.331857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63963136,"num_objects":976,"num_object_clones":0,"num_object_copies":2928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7808,"num_write_kb":62464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"95'7445","reported_seq":7463,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.026415+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:30:26.026415+0000","last_peered":"2026-02-24T08:30:26.026415+0000","last_clean":"2026-02-24T08:30:26.026415+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:30:26.026415+0000","last_undegraded":"2026-02-24T08:30:26.026415+0000","last_fullsized":"2026-02-24T08:30:26.026415+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7445,"log_dups_size":0,"ondisk_log_size":7445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:24.692891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60989440,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":931,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7445,"num_write_kb":59560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"95'7679","reported_seq":7697,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:26.012222+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:30:26.012222+0000","last_peered":"2026-02-24T08:30:26.012222+0000","last_clean":"2026-02-24T08:30:26.012222+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:30:26.012222+0000","last_undegraded":"2026-02-24T08:30:26.012222+0000","last_fullsized":"2026-02-24T08:30:26.012222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":7679,"log_dups_size":0,"ondisk_log_size":7679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.282586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62906368,"num_objects":960,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7679,"num_write_kb":61432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":250,"reported_epoch":95,"state":"active+clean","last_fresh":"2026-02-24T08:30:24.084983+0000","last_change":"2026-02-24T08:30:22.276827+0000","last_active":"2026-02-24T08:30:24.084983+0000","last_peered":"2026-02-24T08:30:24.084983+0000","last_clean":"2026-02-24T08:30:24.084983+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:24.084983+0000","last_undegraded":"2026-02-24T08:30:24.084983+0000","last_fullsized":"2026-02-24T08:30:24.084983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:30:22.276795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:30:22.276795+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:23.675207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1023115264,"num_objects":15614,"num_object_clones":0,"num_object_copies":46842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15614,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124892,"num_write_kb":999136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3070164992,"data_stored":3070164992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124892,"ondisk_log_size":124892,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8511,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247931,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2204500,"kb_used_data":667328,"kb_used_omap":24,"kb_used_meta":1537127,"kb_avail":731798700,"statfs":{"total":751619276800,"available":749361868800,"internally_reserved":0,"allocated":683343872,"data_stored":682721758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24908,"internal_metadata":1574018740},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444157,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1919268,"kb_used_data":619024,"kb_used_omap":27,"kb_used_meta":1300196,"kb_avail":732083932,"statfs":{"total":751619276800,"available":749653946368,"internally_reserved":0,"allocated":633880576,"data_stored":633258462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28574,"internal_metadata":1331400802},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2166544,"kb_used_data":796156,"kb_used_omap":24,"kb_used_meta":1370343,"kb_avail":731836656,"statfs":{"total":751619276800,"available":749400735744,"internally_reserved":0,"allocated":815263744,"data_stored":814645182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25316,"internal_metadata":1403231516},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705793,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2157228,"kb_used_data":872472,"kb_used_omap":24,"kb_used_meta":1284711,"kb_avail":731845972,"statfs":{"total":751619276800,"available":749410275328,"internally_reserved":0,"allocated":893411328,"data_stored":892789214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25322,"internal_metadata":1315544342},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,7,3,3,12,0,12,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8511,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":894631936,"data_stored":894631936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":839565312,"data_stored":839565312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":633962496,"data_stored":633962496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":702005248,"data_stored":702005248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:30:28.866 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_5 pgp_num 16 2026-02-24T08:30:28.936 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:29.040 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:29.459 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:29.459 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:29.459 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:29.459 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:29.459 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:29.269+0000 7ff645a72640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:29.460 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:29.269+0000 7ff645a72640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:29.460 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:29.460 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:29.460 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:29.460 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:29.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:30:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:30:29] "GET /metrics HTTP/1.1" 200 4216 "" "Prometheus/3.6.0" 2026-02-24T08:30:29.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 22 128 137417 137289 48.7492 21.25 0.0340945 0.0204767 2026-02-24T08:30:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:30:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:30:29.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:30:29.994 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:29 trial105 ceph-mon[39442]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:30:29.994 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:29 trial105 ceph-mon[39442]: pgmap v373: 17 pgs: 17 active+clean; 976 MiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 52 MiB/s wr, 6.60k op/s 2026-02-24T08:30:29.994 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:30:29.994 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3063115707' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:30.058 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:30.055+0000 7fa0303d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:30.058 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:30.056+0000 7fa0303d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:30.699 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 23 128 141197 141069 47.9135 29.5312 0.0354531 0.0208469 2026-02-24T08:30:30.827 INFO:teuthology.orchestra.run.trial105.stderr:set pool 7 pgp_num to 16 2026-02-24T08:30:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2015597618' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pgp_num", "val": "16"} : dispatch 2026-02-24T08:30:31.698 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 24 128 145079 144951 47.1807 30.3281 0.0822557 0.0211668 2026-02-24T08:30:31.970 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:32.117 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:32.149 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:31 trial105 ceph-mon[39442]: pgmap v374: 17 pgs: 17 active+clean; 976 MiB data, 8.1 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.87k op/s 2026-02-24T08:30:32.150 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:31 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2015597618' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pgp_num", "val": "16"}]': finished 2026-02-24T08:30:32.150 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:31 trial105 ceph-mon[39442]: osdmap e97: 4 total, 4 up, 4 in 2026-02-24T08:30:32.257 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:32.254+0000 7fec23065640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:32.257 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:32.254+0000 7fec23065640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:32.277 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:32.278 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:32.294 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:32.294 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:32.312 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:32.312 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:32.326 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:32.326 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:32.699 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 25 128 148651 148523 46.4096 27.9062 0.0354597 0.0215211 2026-02-24T08:30:33.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:33 trial105 ceph-mon[39442]: osdmap e98: 4 total, 4 up, 4 in 2026-02-24T08:30:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/110976729' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:33 trial105 ceph-mon[39442]: pgmap v377: 17 pgs: 17 active+clean; 1.1 GiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.99k op/s 2026-02-24T08:30:33.699 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 26 128 152170 152042 45.682 27.4922 0.0103274 0.0218694 2026-02-24T08:30:34.375 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:34.531 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:34.665 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:34.662+0000 7f44b51bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:34.672 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:34.670+0000 7f44b51bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:34.690 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:34.690 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:34.699 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 27 127 155516 155389 44.9584 26.1484 0.0334485 0.0222165 2026-02-24T08:30:34.705 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:34.705 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:34.719 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:34.719 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:34.734 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:34.734 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:34.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:34 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2099509720' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:35.699 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 28 128 158766 158638 44.2592 25.3828 0.0355206 0.0225562 2026-02-24T08:30:35.879 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:30:35.880 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:30:35.880 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T08:30:35.880 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:36.033 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:36.059 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:35 trial105 ceph-mon[39442]: pgmap v378: 17 pgs: 17 active+clean; 1.1 GiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 18 MiB/s wr, 2.33k op/s 2026-02-24T08:30:36.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:36.159+0000 7ff71d54c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:36.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:36.159+0000 7ff71d54c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:36.320 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:30:36.320 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:30:36.371 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2026-02-24T08:30:34.771887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1170588192,"num_objects":17857,"num_object_clones":0,"num_object_copies":53571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17857,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":142957,"num_write_kb":1144726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142921,"ondisk_log_size":142921,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8950748,"kb_used_data":3385996,"kb_used_omap":105,"kb_used_meta":5564566,"kb_avail":2927062052,"statfs":{"total":3006477107200,"available":2997311541248,"internally_reserved":0,"allocated":3467259904,"data_stored":3464728364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108024,"internal_metadata":5698116104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":146882560,"num_objects":2241,"num_object_clones":0,"num_object_copies":6723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17930,"num_write_kb":143440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.691181"},"pg_stats":[{"pgid":"7.f","version":"97'8592","reported_seq":8620,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.092619+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:30:31.092619+0000","last_peered":"2026-02-24T08:30:31.092619+0000","last_clean":"2026-02-24T08:30:31.092619+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:30:31.092619+0000","last_undegraded":"2026-02-24T08:30:31.092619+0000","last_fullsized":"2026-02-24T08:30:31.092619+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8592,"log_dups_size":0,"ondisk_log_size":8592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.266863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70385664,"num_objects":1074,"num_object_clones":0,"num_object_copies":3222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1074,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8592,"num_write_kb":68736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"97'8992","reported_seq":9021,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.095616+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:30:31.095616+0000","last_peered":"2026-02-24T08:30:31.095616+0000","last_clean":"2026-02-24T08:30:31.095616+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:30:31.095616+0000","last_undegraded":"2026-02-24T08:30:31.095616+0000","last_fullsized":"2026-02-24T08:30:31.095616+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8992,"log_dups_size":0,"ondisk_log_size":8992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.957276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73662464,"num_objects":1124,"num_object_clones":0,"num_object_copies":3372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8992,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"97'9183","reported_seq":9194,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.035756+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:30:31.035756+0000","last_peered":"2026-02-24T08:30:31.035756+0000","last_clean":"2026-02-24T08:30:31.035756+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:30:31.035756+0000","last_undegraded":"2026-02-24T08:30:31.035756+0000","last_fullsized":"2026-02-24T08:30:31.035756+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9183,"log_dups_size":0,"ondisk_log_size":9183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.913078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75227136,"num_objects":1148,"num_object_clones":0,"num_object_copies":3444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9183,"num_write_kb":73464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"97'8840","reported_seq":8868,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.034789+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:30:31.034789+0000","last_peered":"2026-02-24T08:30:31.034789+0000","last_clean":"2026-02-24T08:30:31.034789+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:30:31.034789+0000","last_undegraded":"2026-02-24T08:30:31.034789+0000","last_fullsized":"2026-02-24T08:30:31.034789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8840,"log_dups_size":0,"ondisk_log_size":8840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.009121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72417280,"num_objects":1105,"num_object_clones":0,"num_object_copies":3315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8840,"num_write_kb":70720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"97'9216","reported_seq":9245,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.315485+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:30:31.315485+0000","last_peered":"2026-02-24T08:30:31.315485+0000","last_clean":"2026-02-24T08:30:31.315485+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:30:31.315485+0000","last_undegraded":"2026-02-24T08:30:31.315485+0000","last_fullsized":"2026-02-24T08:30:31.315485+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9216,"log_dups_size":0,"ondisk_log_size":9216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.268781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":1152,"num_object_clones":0,"num_object_copies":3456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"97'8888","reported_seq":8917,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.327762+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:30:31.327762+0000","last_peered":"2026-02-24T08:30:31.327762+0000","last_clean":"2026-02-24T08:30:31.327762+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:30:31.327762+0000","last_undegraded":"2026-02-24T08:30:31.327762+0000","last_fullsized":"2026-02-24T08:30:31.327762+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8888,"log_dups_size":0,"ondisk_log_size":8888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.805707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72810496,"num_objects":1111,"num_object_clones":0,"num_object_copies":3333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8888,"num_write_kb":71104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"97'8961","reported_seq":8984,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.087836+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:30:31.087836+0000","last_peered":"2026-02-24T08:30:31.087836+0000","last_clean":"2026-02-24T08:30:31.087836+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:30:31.087836+0000","last_undegraded":"2026-02-24T08:30:31.087836+0000","last_fullsized":"2026-02-24T08:30:31.087836+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8961,"log_dups_size":0,"ondisk_log_size":8961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.362625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73408512,"num_objects":1121,"num_object_clones":0,"num_object_copies":3363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8961,"num_write_kb":71688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"97'8752","reported_seq":8781,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.324205+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:30:31.324205+0000","last_peered":"2026-02-24T08:30:31.324205+0000","last_clean":"2026-02-24T08:30:31.324205+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:30:31.324205+0000","last_undegraded":"2026-02-24T08:30:31.324205+0000","last_fullsized":"2026-02-24T08:30:31.324205+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8752,"log_dups_size":0,"ondisk_log_size":8752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71696384,"num_objects":1094,"num_object_clones":0,"num_object_copies":3282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8752,"num_write_kb":70016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"97'8744","reported_seq":8773,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.021227+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:30:31.021227+0000","last_peered":"2026-02-24T08:30:31.021227+0000","last_clean":"2026-02-24T08:30:31.021227+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:30:31.021227+0000","last_undegraded":"2026-02-24T08:30:31.021227+0000","last_fullsized":"2026-02-24T08:30:31.021227+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8744,"log_dups_size":0,"ondisk_log_size":8744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:17.055002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71630848,"num_objects":1093,"num_object_clones":0,"num_object_copies":3279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1093,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8744,"num_write_kb":69952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"97'8984","reported_seq":8995,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.069494+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:30:31.069494+0000","last_peered":"2026-02-24T08:30:31.069494+0000","last_clean":"2026-02-24T08:30:31.069494+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:30:31.069494+0000","last_undegraded":"2026-02-24T08:30:31.069494+0000","last_fullsized":"2026-02-24T08:30:31.069494+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8984,"log_dups_size":0,"ondisk_log_size":8984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73596928,"num_objects":1123,"num_object_clones":0,"num_object_copies":3369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8984,"num_write_kb":71872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"97'9456","reported_seq":9485,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.085562+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:30:31.085562+0000","last_peered":"2026-02-24T08:30:31.085562+0000","last_clean":"2026-02-24T08:30:31.085562+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:30:31.085562+0000","last_undegraded":"2026-02-24T08:30:31.085562+0000","last_fullsized":"2026-02-24T08:30:31.085562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9456,"log_dups_size":0,"ondisk_log_size":9456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:04.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77463552,"num_objects":1182,"num_object_clones":0,"num_object_copies":3546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1182,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9456,"num_write_kb":75648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"97'8755","reported_seq":8783,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.092908+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:30:31.092908+0000","last_peered":"2026-02-24T08:30:31.092908+0000","last_clean":"2026-02-24T08:30:31.092908+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:30:31.092908+0000","last_undegraded":"2026-02-24T08:30:31.092908+0000","last_fullsized":"2026-02-24T08:30:31.092908+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8755,"log_dups_size":0,"ondisk_log_size":8755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.792005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71720960,"num_objects":1095,"num_object_clones":0,"num_object_copies":3285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8755,"num_write_kb":70040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"97'9344","reported_seq":9369,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.092324+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:30:31.092324+0000","last_peered":"2026-02-24T08:30:31.092324+0000","last_clean":"2026-02-24T08:30:31.092324+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:30:31.092324+0000","last_undegraded":"2026-02-24T08:30:31.092324+0000","last_fullsized":"2026-02-24T08:30:31.092324+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9344,"log_dups_size":0,"ondisk_log_size":9344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76546048,"num_objects":1168,"num_object_clones":0,"num_object_copies":3504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1168,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9344,"num_write_kb":74752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"97'8747","reported_seq":8772,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.034386+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:30:31.034386+0000","last_peered":"2026-02-24T08:30:31.034386+0000","last_clean":"2026-02-24T08:30:31.034386+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:30:31.034386+0000","last_undegraded":"2026-02-24T08:30:31.034386+0000","last_fullsized":"2026-02-24T08:30:31.034386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8747,"log_dups_size":0,"ondisk_log_size":8747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:34.044430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71655424,"num_objects":1094,"num_object_clones":0,"num_object_copies":3282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1094,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8747,"num_write_kb":69976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"97'8576","reported_seq":8604,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.016986+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:30:31.016986+0000","last_peered":"2026-02-24T08:30:31.016986+0000","last_clean":"2026-02-24T08:30:31.016986+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:30:31.016986+0000","last_undegraded":"2026-02-24T08:30:31.016986+0000","last_fullsized":"2026-02-24T08:30:31.016986+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8576,"log_dups_size":0,"ondisk_log_size":8576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70254592,"num_objects":1072,"num_object_clones":0,"num_object_copies":3216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1072,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8576,"num_write_kb":68608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"97'8792","reported_seq":8821,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:31.007290+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:30:31.007290+0000","last_peered":"2026-02-24T08:30:31.007290+0000","last_clean":"2026-02-24T08:30:31.007290+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:30:31.007290+0000","last_undegraded":"2026-02-24T08:30:31.007290+0000","last_fullsized":"2026-02-24T08:30:31.007290+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":8792,"log_dups_size":0,"ondisk_log_size":8792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72024064,"num_objects":1099,"num_object_clones":0,"num_object_copies":3297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1099,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8792,"num_write_kb":70336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":254,"reported_epoch":97,"state":"active+clean","last_fresh":"2026-02-24T08:30:30.828026+0000","last_change":"2026-02-24T08:30:22.276827+0000","last_active":"2026-02-24T08:30:30.828026+0000","last_peered":"2026-02-24T08:30:30.828026+0000","last_clean":"2026-02-24T08:30:30.828026+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:30.828026+0000","last_undegraded":"2026-02-24T08:30:30.828026+0000","last_fullsized":"2026-02-24T08:30:30.828026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:30:22.276795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:30:22.276795+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:23.675207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1169997824,"num_objects":17855,"num_object_clones":0,"num_object_copies":53565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17855,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142822,"num_write_kb":1142576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3510665216,"data_stored":3510665216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142822,"ondisk_log_size":142822,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8589,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247932,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2321752,"kb_used_data":766532,"kb_used_omap":24,"kb_used_meta":1555175,"kb_avail":731681448,"statfs":{"total":751619276800,"available":749241802752,"internally_reserved":0,"allocated":784928768,"data_stored":784298767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25552,"internal_metadata":1592499248},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444158,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2023796,"kb_used_data":705504,"kb_used_omap":29,"kb_used_meta":1318242,"kb_avail":731979404,"statfs":{"total":751619276800,"available":749546909696,"internally_reserved":0,"allocated":722436096,"data_stored":721798551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29878,"internal_metadata":1349880650},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2302604,"kb_used_data":914168,"kb_used_omap":25,"kb_used_meta":1388390,"kb_avail":731700596,"statfs":{"total":751619276800,"available":749261410304,"internally_reserved":0,"allocated":936108032,"data_stored":935481583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25968,"internal_metadata":1421712016},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705794,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2302596,"kb_used_data":999792,"kb_used_omap":26,"kb_used_meta":1302757,"kb_avail":731700604,"statfs":{"total":751619276800,"available":749261418496,"internally_reserved":0,"allocated":1023787008,"data_stored":1023149463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26626,"internal_metadata":1334024190},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8589,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1024950272,"data_stored":1024950272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":959275008,"data_stored":959275008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":724123648,"data_stored":724123648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":802316288,"data_stored":802316288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:30:36.373 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:30:36.374 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 26 2026-02-24T08:30:36.517 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:36.651 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:36.647+0000 7fc2e7ea0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:36.652 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:36.647+0000 7fc2e7ea0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:36.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 29 128 161877 161749 43.5669 24.3047 0.125704 0.0229273 2026-02-24T08:30:36.776 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:36.818 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:30:36.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:30:36.927 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:37.052 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:37.049+0000 7f0946eaa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:37.052 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:37.049+0000 7f0946eaa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:37.072 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:37.072 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:37.088 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:36 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4061084227' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T08:30:37.088 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:37.089 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:37.105 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:37.105 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:37.118 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:37.119 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:37.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 30 128 164991 164863 42.9256 24.3281 0.0202395 0.0232659 2026-02-24T08:30:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:37 trial105 ceph-mon[39442]: from='client.15331 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:30:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:37 trial105 ceph-mon[39442]: pgmap v379: 17 pgs: 17 active+clean; 1.2 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.41k op/s 2026-02-24T08:30:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3534780139' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:37 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:30:38.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 31 128 167529 167401 42.1805 19.8281 0.0554861 0.0236875 2026-02-24T08:30:39.170 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:39.325 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:39.353 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:39 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:30:39.353 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:39 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:30:39.353 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:39 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:30:39.353 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:39 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:30:39.354 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:39 trial105 ceph-mon[39442]: pgmap v380: 17 pgs: 17 active+clean; 1.2 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.41k op/s 2026-02-24T08:30:39.354 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:39 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T08:30:39.354 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:39 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T08:30:39.354 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:39 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:30:39.457 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:39.453+0000 7f17aff0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:39.457 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:39.454+0000 7f17aff0d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:39.476 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:39.476 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:39.493 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:39.493 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:39.512 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:39.512 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:39.526 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:39.526 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:39.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:30:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:30:39] "GET /metrics HTTP/1.1" 200 4216 "" "Prometheus/3.6.0" 2026-02-24T08:30:39.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 32 128 170294 170166 41.5375 21.6016 0.0517134 0.0240473 2026-02-24T08:30:39.835 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:30:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:30:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:30:40.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: Adjusting osd_memory_target on trial165 to 43559M 2026-02-24T08:30:40.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:30:40.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:30:40.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2443289830' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:40.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T08:30:40.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T08:30:40.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: Adjusting osd_memory_target on trial105 to 41511M 2026-02-24T08:30:40.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:30:40.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:30:40.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:30:40.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:30:40.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:30:40.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 33 128 173480 173352 41.033 24.8906 0.0150216 0.0243391 2026-02-24T08:30:41.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:41 trial105 ceph-mon[39442]: pgmap v381: 17 pgs: 17 active+clean; 1.2 GiB data, 8.8 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.55k op/s 2026-02-24T08:30:41.575 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:41.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 34 128 176652 176524 40.555 24.7812 0.0698022 0.024621 2026-02-24T08:30:41.727 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:41.855 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:41.850+0000 7f34dc901640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:41.855 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:41.851+0000 7f34dc901640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:41.863 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:30:41.863 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:30:41.864 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T08:30:41.864 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:41.876 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:41.876 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:41.893 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:41.894 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:41.911 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:41.911 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:41.928 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:41.928 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:42.018 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:42.147 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:42.143+0000 7fb00fd5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:42.147 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:42.144+0000 7fb00fd5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:42.298 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:30:42.299 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:30:42.346 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":381,"stamp":"2026-02-24T08:30:40.772738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1312735776,"num_objects":20026,"num_object_clones":0,"num_object_copies":60078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20026,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":160309,"num_write_kb":1283542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158973,"ondisk_log_size":158973,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9213732,"kb_used_data":3814932,"kb_used_omap":109,"kb_used_meta":5398610,"kb_avail":2926799068,"statfs":{"total":3006477107200,"available":2997042245632,"internally_reserved":0,"allocated":3906490368,"data_stored":3903912192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":111938,"internal_metadata":5528177342},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,1,8,0,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":289030144,"num_objects":4410,"num_object_clones":0,"num_object_copies":13230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35282,"num_write_kb":282256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.946865"},"pg_stats":[{"pgid":"7.f","version":"98'9529","reported_seq":9558,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.100884+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:30:36.100884+0000","last_peered":"2026-02-24T08:30:36.100884+0000","last_clean":"2026-02-24T08:30:36.100884+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:30:36.100884+0000","last_undegraded":"2026-02-24T08:30:36.100884+0000","last_fullsized":"2026-02-24T08:30:36.100884+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9529,"log_dups_size":0,"ondisk_log_size":9529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.266863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78061568,"num_objects":1192,"num_object_clones":0,"num_object_copies":3576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9529,"num_write_kb":76232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'9928","reported_seq":9959,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.301505+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:30:36.301505+0000","last_peered":"2026-02-24T08:30:36.301505+0000","last_clean":"2026-02-24T08:30:36.301505+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:30:36.301505+0000","last_undegraded":"2026-02-24T08:30:36.301505+0000","last_fullsized":"2026-02-24T08:30:36.301505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9928,"log_dups_size":0,"ondisk_log_size":9928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.957276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81330176,"num_objects":1241,"num_object_clones":0,"num_object_copies":3723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1241,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9928,"num_write_kb":79424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'10328","reported_seq":10352,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.035676+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:30:36.035676+0000","last_peered":"2026-02-24T08:30:36.035676+0000","last_clean":"2026-02-24T08:30:36.035676+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:30:36.035676+0000","last_undegraded":"2026-02-24T08:30:36.035676+0000","last_fullsized":"2026-02-24T08:30:36.035676+0000","mapping_epoch":88,"log_start":"91'300","ondisk_log_start":"91'300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.913078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84606976,"num_objects":1291,"num_object_clones":0,"num_object_copies":3873,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1291,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10328,"num_write_kb":82624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'9896","reported_seq":9926,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.015896+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:30:36.015896+0000","last_peered":"2026-02-24T08:30:36.015896+0000","last_clean":"2026-02-24T08:30:36.015896+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:30:36.015896+0000","last_undegraded":"2026-02-24T08:30:36.015896+0000","last_fullsized":"2026-02-24T08:30:36.015896+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9896,"log_dups_size":0,"ondisk_log_size":9896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.009121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81068032,"num_objects":1237,"num_object_clones":0,"num_object_copies":3711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9896,"num_write_kb":79168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'10264","reported_seq":10295,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.345510+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:30:36.345510+0000","last_peered":"2026-02-24T08:30:36.345510+0000","last_clean":"2026-02-24T08:30:36.345510+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:30:36.345510+0000","last_undegraded":"2026-02-24T08:30:36.345510+0000","last_fullsized":"2026-02-24T08:30:36.345510+0000","mapping_epoch":88,"log_start":"91'200","ondisk_log_start":"91'200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.268781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84082688,"num_objects":1283,"num_object_clones":0,"num_object_copies":3849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1283,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10264,"num_write_kb":82112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'10056","reported_seq":10087,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.215546+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:30:36.215546+0000","last_peered":"2026-02-24T08:30:36.215546+0000","last_clean":"2026-02-24T08:30:36.215546+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:30:36.215546+0000","last_undegraded":"2026-02-24T08:30:36.215546+0000","last_fullsized":"2026-02-24T08:30:36.215546+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.805707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82378752,"num_objects":1257,"num_object_clones":0,"num_object_copies":3771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1257,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10056,"num_write_kb":80448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'9983","reported_seq":10014,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.090195+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:30:36.090195+0000","last_peered":"2026-02-24T08:30:36.090195+0000","last_clean":"2026-02-24T08:30:36.090195+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:30:36.090195+0000","last_undegraded":"2026-02-24T08:30:36.090195+0000","last_fullsized":"2026-02-24T08:30:36.090195+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9983,"log_dups_size":0,"ondisk_log_size":9983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.362625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81780736,"num_objects":1248,"num_object_clones":0,"num_object_copies":3744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9983,"num_write_kb":79864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'9946","reported_seq":9970,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.342612+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:30:36.342612+0000","last_peered":"2026-02-24T08:30:36.342612+0000","last_clean":"2026-02-24T08:30:36.342612+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:30:36.342612+0000","last_undegraded":"2026-02-24T08:30:36.342612+0000","last_fullsized":"2026-02-24T08:30:36.342612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9946,"log_dups_size":0,"ondisk_log_size":9946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81477632,"num_objects":1244,"num_object_clones":0,"num_object_copies":3732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9946,"num_write_kb":79568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'9968","reported_seq":9997,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.085440+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:30:36.085440+0000","last_peered":"2026-02-24T08:30:36.085440+0000","last_clean":"2026-02-24T08:30:36.085440+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:30:36.085440+0000","last_undegraded":"2026-02-24T08:30:36.085440+0000","last_fullsized":"2026-02-24T08:30:36.085440+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9968,"log_dups_size":0,"ondisk_log_size":9968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:17.055002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81657856,"num_objects":1246,"num_object_clones":0,"num_object_copies":3738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1246,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9968,"num_write_kb":79744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'10192","reported_seq":10223,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.044795+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:30:36.044795+0000","last_peered":"2026-02-24T08:30:36.044795+0000","last_clean":"2026-02-24T08:30:36.044795+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:30:36.044795+0000","last_undegraded":"2026-02-24T08:30:36.044795+0000","last_fullsized":"2026-02-24T08:30:36.044795+0000","mapping_epoch":88,"log_start":"91'100","ondisk_log_start":"91'100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83492864,"num_objects":1274,"num_object_clones":0,"num_object_copies":3822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10192,"num_write_kb":81536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'10464","reported_seq":10489,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.099498+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:30:36.099498+0000","last_peered":"2026-02-24T08:30:36.099498+0000","last_clean":"2026-02-24T08:30:36.099498+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:30:36.099498+0000","last_undegraded":"2026-02-24T08:30:36.099498+0000","last_fullsized":"2026-02-24T08:30:36.099498+0000","mapping_epoch":88,"log_start":"91'400","ondisk_log_start":"91'400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:04.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85721088,"num_objects":1308,"num_object_clones":0,"num_object_copies":3924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1308,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10464,"num_write_kb":83712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'9984","reported_seq":10015,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.099046+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:30:36.099046+0000","last_peered":"2026-02-24T08:30:36.099046+0000","last_clean":"2026-02-24T08:30:36.099046+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:30:36.099046+0000","last_undegraded":"2026-02-24T08:30:36.099046+0000","last_fullsized":"2026-02-24T08:30:36.099046+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9984,"log_dups_size":0,"ondisk_log_size":9984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.792005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":1248,"num_object_clones":0,"num_object_copies":3744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1248,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9984,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'10400","reported_seq":10431,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.058103+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:30:36.058103+0000","last_peered":"2026-02-24T08:30:36.058103+0000","last_clean":"2026-02-24T08:30:36.058103+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:30:36.058103+0000","last_undegraded":"2026-02-24T08:30:36.058103+0000","last_fullsized":"2026-02-24T08:30:36.058103+0000","mapping_epoch":88,"log_start":"91'300","ondisk_log_start":"91'300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85196800,"num_objects":1300,"num_object_clones":0,"num_object_copies":3900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1300,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10400,"num_write_kb":83200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'9832","reported_seq":9862,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.030718+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:30:36.030718+0000","last_peered":"2026-02-24T08:30:36.030718+0000","last_clean":"2026-02-24T08:30:36.030718+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:30:36.030718+0000","last_undegraded":"2026-02-24T08:30:36.030718+0000","last_fullsized":"2026-02-24T08:30:36.030718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9832,"log_dups_size":0,"ondisk_log_size":9832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:34.044430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80543744,"num_objects":1229,"num_object_clones":0,"num_object_copies":3687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9832,"num_write_kb":78656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'9536","reported_seq":9566,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.024215+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:30:36.024215+0000","last_peered":"2026-02-24T08:30:36.024215+0000","last_clean":"2026-02-24T08:30:36.024215+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:30:36.024215+0000","last_undegraded":"2026-02-24T08:30:36.024215+0000","last_fullsized":"2026-02-24T08:30:36.024215+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9536,"log_dups_size":0,"ondisk_log_size":9536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78118912,"num_objects":1192,"num_object_clones":0,"num_object_copies":3576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9536,"num_write_kb":76288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'9868","reported_seq":9896,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:36.063649+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:30:36.063649+0000","last_peered":"2026-02-24T08:30:36.063649+0000","last_clean":"2026-02-24T08:30:36.063649+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:30:36.063649+0000","last_undegraded":"2026-02-24T08:30:36.063649+0000","last_fullsized":"2026-02-24T08:30:36.063649+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":9868,"log_dups_size":0,"ondisk_log_size":9868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80838656,"num_objects":1234,"num_object_clones":0,"num_object_copies":3702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9868,"num_write_kb":78944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":256,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:32.083256+0000","last_change":"2026-02-24T08:30:22.276827+0000","last_active":"2026-02-24T08:30:32.083256+0000","last_peered":"2026-02-24T08:30:32.083256+0000","last_clean":"2026-02-24T08:30:32.083256+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:32.083256+0000","last_undegraded":"2026-02-24T08:30:32.083256+0000","last_fullsized":"2026-02-24T08:30:32.083256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:30:22.276795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:30:22.276795+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:23.675207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1312145408,"num_objects":20024,"num_object_clones":0,"num_object_copies":60072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160174,"num_write_kb":1281392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3935821824,"data_stored":3935821824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158874,"ondisk_log_size":158874,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8628,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247933,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2169152,"kb_used_data":866668,"kb_used_omap":26,"kb_used_meta":1302437,"kb_avail":731834048,"statfs":{"total":751619276800,"available":749398065152,"internally_reserved":0,"allocated":887468032,"data_stored":886822600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26858,"internal_metadata":1333696278},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444159,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2133456,"kb_used_data":797116,"kb_used_omap":29,"kb_used_meta":1336290,"kb_avail":731869744,"statfs":{"total":751619276800,"available":749434617856,"internally_reserved":0,"allocated":816246784,"data_stored":815601352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30530,"internal_metadata":1368361150},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,1,8,0,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2435636,"kb_used_data":1029152,"kb_used_omap":26,"kb_used_meta":1406437,"kb_avail":731567564,"statfs":{"total":751619276800,"available":749125185536,"internally_reserved":0,"allocated":1053851648,"data_stored":1053209768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27272,"internal_metadata":1440191864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705795,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2475488,"kb_used_data":1121996,"kb_used_omap":26,"kb_used_meta":1353445,"kb_avail":731527712,"statfs":{"total":751619276800,"available":749084377088,"internally_reserved":0,"allocated":1148923904,"data_stored":1148278472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27278,"internal_metadata":1385928050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8628,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1148395520,"data_stored":1148395520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1071947776,"data_stored":1071947776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":815398912,"data_stored":815398912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":900079616,"data_stored":900079616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:30:42.348 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:30:42.349 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 36 2026-02-24T08:30:42.409 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:42 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1000843868' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:42.534 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:42.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:42.662+0000 7f31de9e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:42.666 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:42.662+0000 7f31de9e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:42.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 35 128 179508 179380 40.0337 22.3125 0.0664597 0.0249591 2026-02-24T08:30:42.818 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:30:42.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:30:43.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:43 trial105 ceph-mon[39442]: from='client.15341 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:30:43.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:43 trial105 ceph-mon[39442]: pgmap v382: 17 pgs: 17 active+clean; 1.3 GiB data, 9.2 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 3.00k op/s 2026-02-24T08:30:43.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2268063104' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T08:30:43.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 36 128 182688 182560 39.6118 24.8438 0.0142546 0.0252214 2026-02-24T08:30:43.981 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:44.145 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:44.266 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:44.262+0000 7fbb88941640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:44.266 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:44.262+0000 7fbb88941640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:44.266 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:44 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:30:44.266 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:44 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:30:44.266 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:30:44.281 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:44.281 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:44.295 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:44.295 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:44.308 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:44.308 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:44.323 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:44.323 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:44.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 37 128 185909 185781 39.2213 25.1641 0.0751428 0.0254781 2026-02-24T08:30:45.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2070750113' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:45.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:45 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:30:45.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:45 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:30:45.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:45 trial105 ceph-mon[39442]: pgmap v383: 17 pgs: 17 active+clean; 1.3 GiB data, 9.2 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.67k op/s 2026-02-24T08:30:45.702 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 38 128 189149 189021 38.8552 25.3125 0.0273045 0.0257155 2026-02-24T08:30:46.375 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:46.527 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:46.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 39 127 192297 192170 38.4897 24.6016 0.0297842 0.0259642 2026-02-24T08:30:46.966 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:46.893+0000 7fb862806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:46.967 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:46.893+0000 7fb862806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:46.967 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:46.967 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:46.967 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:46.967 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:46.967 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:46.967 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:46.976 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:46.976 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:47.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:30:47.701659+0000 min lat: 0.000722661 max lat: 0.258613 avg lat: 0.0262276 2026-02-24T08:30:47.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:30:47.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 40 128 195231 195103 38.1003 22.9141 0.0645593 0.0262276 2026-02-24T08:30:47.858 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:30:47.859 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:30:47.859 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T08:30:47.859 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:48.010 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:48.077 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:47 trial105 ceph-mon[39442]: pgmap v384: 17 pgs: 17 active+clean; 1.5 GiB data, 9.7 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 3.98k op/s 2026-02-24T08:30:48.077 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:47 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4093850447' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:48.146 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:48.141+0000 7f3daf0ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:48.146 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:48.142+0000 7f3daf0ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:48.298 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:30:48.299 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:30:48.349 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2026-02-24T08:30:46.773586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1562296864,"num_objects":23837,"num_object_clones":0,"num_object_copies":71511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23837,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":190773,"num_write_kb":1527254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161037,"ondisk_log_size":161037,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10153116,"kb_used_data":4545484,"kb_used_omap":110,"kb_used_meta":5607441,"kb_avail":2925859684,"statfs":{"total":3006477107200,"available":2996080316416,"internally_reserved":0,"allocated":4654575616,"data_stored":4651997440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113252,"internal_metadata":5742019996},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,17,21,35,45,63,32,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":391708672,"num_objects":5980,"num_object_clones":0,"num_object_copies":17940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47816,"num_write_kb":382528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001699"},"pg_stats":[{"pgid":"7.f","version":"98'11658","reported_seq":11689,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.159654+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:30:46.159654+0000","last_peered":"2026-02-24T08:30:46.159654+0000","last_clean":"2026-02-24T08:30:46.159654+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:30:46.159654+0000","last_undegraded":"2026-02-24T08:30:46.159654+0000","last_fullsized":"2026-02-24T08:30:46.159654+0000","mapping_epoch":88,"log_start":"91'1600","ondisk_log_start":"91'1600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.266863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95502336,"num_objects":1458,"num_object_clones":0,"num_object_copies":4374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11658,"num_write_kb":93264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'11990","reported_seq":12015,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.424234+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:30:46.424234+0000","last_peered":"2026-02-24T08:30:46.424234+0000","last_clean":"2026-02-24T08:30:46.424234+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:30:46.424234+0000","last_undegraded":"2026-02-24T08:30:46.424234+0000","last_fullsized":"2026-02-24T08:30:46.424234+0000","mapping_epoch":88,"log_start":"91'1900","ondisk_log_start":"91'1900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.957276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98222080,"num_objects":1499,"num_object_clones":0,"num_object_copies":4497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11990,"num_write_kb":95920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'12264","reported_seq":12294,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:45.973225+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:30:45.973225+0000","last_peered":"2026-02-24T08:30:45.973225+0000","last_clean":"2026-02-24T08:30:45.973225+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:30:45.973225+0000","last_undegraded":"2026-02-24T08:30:45.973225+0000","last_fullsized":"2026-02-24T08:30:45.973225+0000","mapping_epoch":88,"log_start":"91'2200","ondisk_log_start":"91'2200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.913078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100466688,"num_objects":1533,"num_object_clones":0,"num_object_copies":4599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12264,"num_write_kb":98112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'11691","reported_seq":11719,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:45.966112+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:30:45.966112+0000","last_peered":"2026-02-24T08:30:45.966112+0000","last_clean":"2026-02-24T08:30:45.966112+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:30:45.966112+0000","last_undegraded":"2026-02-24T08:30:45.966112+0000","last_fullsized":"2026-02-24T08:30:45.966112+0000","mapping_epoch":88,"log_start":"91'1600","ondisk_log_start":"91'1600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.009121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95772672,"num_objects":1462,"num_object_clones":0,"num_object_copies":4386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1462,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11691,"num_write_kb":93528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'12205","reported_seq":12233,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.415255+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:30:46.415255+0000","last_peered":"2026-02-24T08:30:46.415255+0000","last_clean":"2026-02-24T08:30:46.415255+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:30:46.415255+0000","last_undegraded":"2026-02-24T08:30:46.415255+0000","last_fullsized":"2026-02-24T08:30:46.415255+0000","mapping_epoch":88,"log_start":"91'2200","ondisk_log_start":"91'2200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.268781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99983360,"num_objects":1526,"num_object_clones":0,"num_object_copies":4578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12205,"num_write_kb":97640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'11848","reported_seq":11879,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.367090+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:30:46.367090+0000","last_peered":"2026-02-24T08:30:46.367090+0000","last_clean":"2026-02-24T08:30:46.367090+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:30:46.367090+0000","last_undegraded":"2026-02-24T08:30:46.367090+0000","last_fullsized":"2026-02-24T08:30:46.367090+0000","mapping_epoch":88,"log_start":"91'1800","ondisk_log_start":"91'1800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.805707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97058816,"num_objects":1481,"num_object_clones":0,"num_object_copies":4443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":94784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'11680","reported_seq":11711,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.145771+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:30:46.145771+0000","last_peered":"2026-02-24T08:30:46.145771+0000","last_clean":"2026-02-24T08:30:46.145771+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:30:46.145771+0000","last_undegraded":"2026-02-24T08:30:46.145771+0000","last_fullsized":"2026-02-24T08:30:46.145771+0000","mapping_epoch":88,"log_start":"91'1600","ondisk_log_start":"91'1600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.362625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95682560,"num_objects":1460,"num_object_clones":0,"num_object_copies":4380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1460,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11680,"num_write_kb":93440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'11828","reported_seq":11859,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.388835+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:30:46.388835+0000","last_peered":"2026-02-24T08:30:46.388835+0000","last_clean":"2026-02-24T08:30:46.388835+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:30:46.388835+0000","last_undegraded":"2026-02-24T08:30:46.388835+0000","last_fullsized":"2026-02-24T08:30:46.388835+0000","mapping_epoch":88,"log_start":"91'1800","ondisk_log_start":"91'1800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96894976,"num_objects":1479,"num_object_clones":0,"num_object_copies":4437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11828,"num_write_kb":94624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'11968","reported_seq":11999,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.045063+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:30:46.045063+0000","last_peered":"2026-02-24T08:30:46.045063+0000","last_clean":"2026-02-24T08:30:46.045063+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:30:46.045063+0000","last_undegraded":"2026-02-24T08:30:46.045063+0000","last_fullsized":"2026-02-24T08:30:46.045063+0000","mapping_epoch":88,"log_start":"91'1900","ondisk_log_start":"91'1900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:17.055002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98041856,"num_objects":1496,"num_object_clones":0,"num_object_copies":4488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11968,"num_write_kb":95744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'12152","reported_seq":12177,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.100908+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:30:46.100908+0000","last_peered":"2026-02-24T08:30:46.100908+0000","last_clean":"2026-02-24T08:30:46.100908+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:30:46.100908+0000","last_undegraded":"2026-02-24T08:30:46.100908+0000","last_fullsized":"2026-02-24T08:30:46.100908+0000","mapping_epoch":88,"log_start":"91'2100","ondisk_log_start":"91'2100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99549184,"num_objects":1519,"num_object_clones":0,"num_object_copies":4557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12152,"num_write_kb":97216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'12401","reported_seq":12422,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.150274+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:30:46.150274+0000","last_peered":"2026-02-24T08:30:46.150274+0000","last_clean":"2026-02-24T08:30:46.150274+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:30:46.150274+0000","last_undegraded":"2026-02-24T08:30:46.150274+0000","last_fullsized":"2026-02-24T08:30:46.150274+0000","mapping_epoch":88,"log_start":"91'2400","ondisk_log_start":"91'2400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:04.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101588992,"num_objects":1551,"num_object_clones":0,"num_object_copies":4653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12401,"num_write_kb":99208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'11849","reported_seq":11880,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.153888+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:30:46.153888+0000","last_peered":"2026-02-24T08:30:46.153888+0000","last_clean":"2026-02-24T08:30:46.153888+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:30:46.153888+0000","last_undegraded":"2026-02-24T08:30:46.153888+0000","last_fullsized":"2026-02-24T08:30:46.153888+0000","mapping_epoch":88,"log_start":"91'1800","ondisk_log_start":"91'1800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.792005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97067008,"num_objects":1482,"num_object_clones":0,"num_object_copies":4446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1482,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":94792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'12278","reported_seq":12306,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.146855+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:30:46.146855+0000","last_peered":"2026-02-24T08:30:46.146855+0000","last_clean":"2026-02-24T08:30:46.146855+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:30:46.146855+0000","last_undegraded":"2026-02-24T08:30:46.146855+0000","last_fullsized":"2026-02-24T08:30:46.146855+0000","mapping_epoch":88,"log_start":"91'2200","ondisk_log_start":"91'2200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100581376,"num_objects":1535,"num_object_clones":0,"num_object_copies":4605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12278,"num_write_kb":98224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'11864","reported_seq":11894,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.065815+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:30:46.065815+0000","last_peered":"2026-02-24T08:30:46.065815+0000","last_clean":"2026-02-24T08:30:46.065815+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:30:46.065815+0000","last_undegraded":"2026-02-24T08:30:46.065815+0000","last_fullsized":"2026-02-24T08:30:46.065815+0000","mapping_epoch":88,"log_start":"91'1800","ondisk_log_start":"91'1800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:34.044430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97189888,"num_objects":1483,"num_object_clones":0,"num_object_copies":4449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1483,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11864,"num_write_kb":94912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'11178","reported_seq":11208,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.054900+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:30:46.054900+0000","last_peered":"2026-02-24T08:30:46.054900+0000","last_clean":"2026-02-24T08:30:46.054900+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:30:46.054900+0000","last_undegraded":"2026-02-24T08:30:46.054900+0000","last_fullsized":"2026-02-24T08:30:46.054900+0000","mapping_epoch":88,"log_start":"91'1100","ondisk_log_start":"91'1100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91570176,"num_objects":1398,"num_object_clones":0,"num_object_copies":4194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11178,"num_write_kb":89424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'11784","reported_seq":11812,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:46.164614+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:30:46.164614+0000","last_peered":"2026-02-24T08:30:46.164614+0000","last_clean":"2026-02-24T08:30:46.164614+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:30:46.164614+0000","last_undegraded":"2026-02-24T08:30:46.164614+0000","last_fullsized":"2026-02-24T08:30:46.164614+0000","mapping_epoch":88,"log_start":"91'1700","ondisk_log_start":"91'1700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96534528,"num_objects":1473,"num_object_clones":0,"num_object_copies":4419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1473,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11784,"num_write_kb":94272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":256,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:32.083256+0000","last_change":"2026-02-24T08:30:22.276827+0000","last_active":"2026-02-24T08:30:32.083256+0000","last_peered":"2026-02-24T08:30:32.083256+0000","last_clean":"2026-02-24T08:30:32.083256+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:32.083256+0000","last_undegraded":"2026-02-24T08:30:32.083256+0000","last_fullsized":"2026-02-24T08:30:32.083256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:30:22.276795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:30:22.276795+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:23.675207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1561706496,"num_objects":23835,"num_object_clones":0,"num_object_copies":71505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23835,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190638,"num_write_kb":1525104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4686364672,"data_stored":4686364672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160938,"ondisk_log_size":160938,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247935,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2376792,"kb_used_data":1038212,"kb_used_omap":26,"kb_used_meta":1338533,"kb_avail":731626408,"statfs":{"total":751619276800,"available":749185441792,"internally_reserved":0,"allocated":1063129088,"data_stored":1062483656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27520,"internal_metadata":1370657920},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,0,0,8,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444161,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2328776,"kb_used_data":944436,"kb_used_omap":29,"kb_used_meta":1384290,"kb_avail":731674424,"statfs":{"total":751619276800,"available":749234610176,"internally_reserved":0,"allocated":967102464,"data_stored":966457032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30530,"internal_metadata":1417513150},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,5,8,18,21,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2705388,"kb_used_data":1226712,"kb_used_omap":26,"kb_used_meta":1478629,"kb_avail":731297812,"statfs":{"total":751619276800,"available":748848959488,"internally_reserved":0,"allocated":1256153088,"data_stored":1255511208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27272,"internal_metadata":1514116472},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,12,3,12,12,23,12,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705797,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2742160,"kb_used_data":1336124,"kb_used_omap":27,"kb_used_meta":1405988,"kb_avail":731261040,"statfs":{"total":751619276800,"available":748811304960,"internally_reserved":0,"allocated":1368190976,"data_stored":1367545544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1439732454},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,12,15,15,11],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1369055232,"data_stored":1369055232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1274044416,"data_stored":1274044416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":967860224,"data_stored":967860224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1075404800,"data_stored":1075404800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:30:48.352 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:30:48.352 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 46 2026-02-24T08:30:48.507 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:48.650 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:48.645+0000 7f76c4c38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:48.650 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:48.645+0000 7f76c4c38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:48.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 41 128 198252 198124 37.7467 23.6016 0.0842508 0.0264703 2026-02-24T08:30:48.811 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:30:48.850 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:48 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1422215464' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T08:30:48.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:30:49.083 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:49.237 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:49.357 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:49.354+0000 7f28de429640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:49.358 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:49.354+0000 7f28de429640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:49.374 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:49.375 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:49.393 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:49.393 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:49.410 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:49.410 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:49.427 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:49.428 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:49.689 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:30:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:30:49] "GET /metrics HTTP/1.1" 200 4200 "" "Prometheus/3.6.0" 2026-02-24T08:30:49.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 42 128 201386 201258 37.4309 24.4844 0.0218773 0.0266971 2026-02-24T08:30:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:30:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:30:49.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:30:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:49 trial105 ceph-mon[39442]: from='client.15349 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:30:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:49 trial105 ceph-mon[39442]: pgmap v385: 17 pgs: 17 active+clean; 1.5 GiB data, 9.7 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.54k op/s 2026-02-24T08:30:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2371883986' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:50.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 43 128 204610 204482 37.1461 25.1875 0.0201921 0.0269003 2026-02-24T08:30:51.476 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:51.635 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:51.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 44 128 207740 207612 36.8576 24.4531 0.0842376 0.027112 2026-02-24T08:30:51.774 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:51.771+0000 7f8e3e55e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:51.774 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:51.771+0000 7f8e3e55e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:51.793 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:51.794 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:51.812 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:51.812 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:51.828 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:51.829 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:51.844 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:51.844 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:51 trial105 ceph-mon[39442]: pgmap v386: 17 pgs: 17 active+clean; 1.5 GiB data, 9.7 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.54k op/s 2026-02-24T08:30:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3069558879' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:52.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 45 128 210922 210794 36.5909 24.8594 0.020186 0.0273132 2026-02-24T08:30:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:53 trial105 ceph-mon[39442]: pgmap v387: 17 pgs: 17 active+clean; 1.6 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.84k op/s 2026-02-24T08:30:53.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 46 128 214175 214047 36.3479 25.4141 0.0325966 0.027493 2026-02-24T08:30:53.852 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:30:53.853 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:30:53.853 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:30:53.853 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:53.895 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:54.010 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:54.053 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:54.146 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:54.142+0000 7f56a6d6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:54.146 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:54.143+0000 7f56a6d6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:54.180 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:54.176+0000 7fed03107640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:54.180 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:54.177+0000 7fed03107640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:54.197 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:54.197 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:54.215 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:54.215 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:54.231 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:54.231 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:54.247 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:54.247 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:54.316 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:30:54.317 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:30:54.364 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2026-02-24T08:30:52.774421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1689969184,"num_objects":25781,"num_object_clones":0,"num_object_copies":77343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25781,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":206358,"num_write_kb":1651934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161022,"ondisk_log_size":161022,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10559060,"kb_used_data":4915332,"kb_used_omap":110,"kb_used_meta":5643537,"kb_avail":2925453740,"statfs":{"total":3006477107200,"available":2995664629760,"internally_reserved":0,"allocated":5033299968,"data_stored":5030721792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113252,"internal_metadata":5778982300},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,3,10,15,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":377233408,"num_objects":5755,"num_object_clones":0,"num_object_copies":17265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46049,"num_write_kb":368392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001683"},"pg_stats":[{"pgid":"7.f","version":"98'12552","reported_seq":12583,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.130774+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:30:51.130774+0000","last_peered":"2026-02-24T08:30:51.130774+0000","last_clean":"2026-02-24T08:30:51.130774+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:30:51.130774+0000","last_undegraded":"2026-02-24T08:30:51.130774+0000","last_fullsized":"2026-02-24T08:30:51.130774+0000","mapping_epoch":88,"log_start":"92'2500","ondisk_log_start":"92'2500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.266863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102825984,"num_objects":1569,"num_object_clones":0,"num_object_copies":4707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12552,"num_write_kb":100416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'12815","reported_seq":12837,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.432567+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:30:51.432567+0000","last_peered":"2026-02-24T08:30:51.432567+0000","last_clean":"2026-02-24T08:30:51.432567+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:30:51.432567+0000","last_undegraded":"2026-02-24T08:30:51.432567+0000","last_fullsized":"2026-02-24T08:30:51.432567+0000","mapping_epoch":88,"log_start":"92'2800","ondisk_log_start":"92'2800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.957276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104980480,"num_objects":1602,"num_object_clones":0,"num_object_copies":4806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1602,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12815,"num_write_kb":102520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'13136","reported_seq":13166,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.073649+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:30:51.073649+0000","last_peered":"2026-02-24T08:30:51.073649+0000","last_clean":"2026-02-24T08:30:51.073649+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:30:51.073649+0000","last_undegraded":"2026-02-24T08:30:51.073649+0000","last_fullsized":"2026-02-24T08:30:51.073649+0000","mapping_epoch":88,"log_start":"92'3100","ondisk_log_start":"92'3100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.913078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107610112,"num_objects":1642,"num_object_clones":0,"num_object_copies":4926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1642,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13136,"num_write_kb":105088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'12696","reported_seq":12703,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.082008+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:30:51.082008+0000","last_peered":"2026-02-24T08:30:51.082008+0000","last_clean":"2026-02-24T08:30:51.082008+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:30:51.082008+0000","last_undegraded":"2026-02-24T08:30:51.082008+0000","last_fullsized":"2026-02-24T08:30:51.082008+0000","mapping_epoch":88,"log_start":"91'2600","ondisk_log_start":"91'2600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.009121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104005632,"num_objects":1587,"num_object_clones":0,"num_object_copies":4761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12696,"num_write_kb":101568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'13112","reported_seq":13141,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.428250+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:30:51.428250+0000","last_peered":"2026-02-24T08:30:51.428250+0000","last_clean":"2026-02-24T08:30:51.428250+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:30:51.428250+0000","last_undegraded":"2026-02-24T08:30:51.428250+0000","last_fullsized":"2026-02-24T08:30:51.428250+0000","mapping_epoch":88,"log_start":"92'3100","ondisk_log_start":"92'3100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.268781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107413504,"num_objects":1639,"num_object_clones":0,"num_object_copies":4917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1639,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13112,"num_write_kb":104896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'12872","reported_seq":12895,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.432174+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:30:51.432174+0000","last_peered":"2026-02-24T08:30:51.432174+0000","last_clean":"2026-02-24T08:30:51.432174+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:30:51.432174+0000","last_undegraded":"2026-02-24T08:30:51.432174+0000","last_fullsized":"2026-02-24T08:30:51.432174+0000","mapping_epoch":88,"log_start":"92'2800","ondisk_log_start":"92'2800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.805707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105447424,"num_objects":1609,"num_object_clones":0,"num_object_copies":4827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1609,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12872,"num_write_kb":102976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'12541","reported_seq":12572,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.168687+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:30:51.168687+0000","last_peered":"2026-02-24T08:30:51.168687+0000","last_clean":"2026-02-24T08:30:51.168687+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:30:51.168687+0000","last_undegraded":"2026-02-24T08:30:51.168687+0000","last_fullsized":"2026-02-24T08:30:51.168687+0000","mapping_epoch":88,"log_start":"91'2500","ondisk_log_start":"91'2500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.362625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102735872,"num_objects":1568,"num_object_clones":0,"num_object_copies":4704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1568,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12541,"num_write_kb":100328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'12824","reported_seq":12855,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.423108+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:30:51.423108+0000","last_peered":"2026-02-24T08:30:51.423108+0000","last_clean":"2026-02-24T08:30:51.423108+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:30:51.423108+0000","last_undegraded":"2026-02-24T08:30:51.423108+0000","last_fullsized":"2026-02-24T08:30:51.423108+0000","mapping_epoch":88,"log_start":"92'2800","ondisk_log_start":"92'2800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105054208,"num_objects":1603,"num_object_clones":0,"num_object_copies":4809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1603,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12824,"num_write_kb":102592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'12968","reported_seq":12999,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.089842+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:30:51.089842+0000","last_peered":"2026-02-24T08:30:51.089842+0000","last_clean":"2026-02-24T08:30:51.089842+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:30:51.089842+0000","last_undegraded":"2026-02-24T08:30:51.089842+0000","last_fullsized":"2026-02-24T08:30:51.089842+0000","mapping_epoch":88,"log_start":"92'2900","ondisk_log_start":"92'2900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:17.055002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106233856,"num_objects":1621,"num_object_clones":0,"num_object_copies":4863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1621,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12968,"num_write_kb":103744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'13192","reported_seq":13219,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.116295+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:30:51.116295+0000","last_peered":"2026-02-24T08:30:51.116295+0000","last_clean":"2026-02-24T08:30:51.116295+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:30:51.116295+0000","last_undegraded":"2026-02-24T08:30:51.116295+0000","last_fullsized":"2026-02-24T08:30:51.116295+0000","mapping_epoch":88,"log_start":"92'3100","ondisk_log_start":"92'3100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108068864,"num_objects":1649,"num_object_clones":0,"num_object_copies":4947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13192,"num_write_kb":105536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'13368","reported_seq":13395,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.182291+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:30:51.182291+0000","last_peered":"2026-02-24T08:30:51.182291+0000","last_clean":"2026-02-24T08:30:51.182291+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:30:51.182291+0000","last_undegraded":"2026-02-24T08:30:51.182291+0000","last_fullsized":"2026-02-24T08:30:51.182291+0000","mapping_epoch":88,"log_start":"92'3300","ondisk_log_start":"92'3300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:04.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109510656,"num_objects":1671,"num_object_clones":0,"num_object_copies":5013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13368,"num_write_kb":106944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'13046","reported_seq":13077,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.185819+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:30:51.185819+0000","last_peered":"2026-02-24T08:30:51.185819+0000","last_clean":"2026-02-24T08:30:51.185819+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:30:51.185819+0000","last_undegraded":"2026-02-24T08:30:51.185819+0000","last_fullsized":"2026-02-24T08:30:51.185819+0000","mapping_epoch":88,"log_start":"92'3000","ondisk_log_start":"92'3000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.792005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106872832,"num_objects":1631,"num_object_clones":0,"num_object_copies":4893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13046,"num_write_kb":104368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'13200","reported_seq":13231,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.123257+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:30:51.123257+0000","last_peered":"2026-02-24T08:30:51.123257+0000","last_clean":"2026-02-24T08:30:51.123257+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:30:51.123257+0000","last_undegraded":"2026-02-24T08:30:51.123257+0000","last_fullsized":"2026-02-24T08:30:51.123257+0000","mapping_epoch":88,"log_start":"92'3100","ondisk_log_start":"92'3100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108134400,"num_objects":1650,"num_object_clones":0,"num_object_copies":4950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1650,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13200,"num_write_kb":105600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'12784","reported_seq":12814,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.022813+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:30:51.022813+0000","last_peered":"2026-02-24T08:30:51.022813+0000","last_clean":"2026-02-24T08:30:51.022813+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:30:51.022813+0000","last_undegraded":"2026-02-24T08:30:51.022813+0000","last_fullsized":"2026-02-24T08:30:51.022813+0000","mapping_epoch":88,"log_start":"92'2700","ondisk_log_start":"92'2700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:34.044430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104726528,"num_objects":1598,"num_object_clones":0,"num_object_copies":4794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12784,"num_write_kb":102272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'12256","reported_seq":12281,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.082394+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:30:51.082394+0000","last_peered":"2026-02-24T08:30:51.082394+0000","last_clean":"2026-02-24T08:30:51.082394+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:30:51.082394+0000","last_undegraded":"2026-02-24T08:30:51.082394+0000","last_fullsized":"2026-02-24T08:30:51.082394+0000","mapping_epoch":88,"log_start":"91'2200","ondisk_log_start":"91'2200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100401152,"num_objects":1532,"num_object_clones":0,"num_object_copies":4596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12256,"num_write_kb":98048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'12861","reported_seq":12878,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:51.187890+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:30:51.187890+0000","last_peered":"2026-02-24T08:30:51.187890+0000","last_clean":"2026-02-24T08:30:51.187890+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:30:51.187890+0000","last_undegraded":"2026-02-24T08:30:51.187890+0000","last_fullsized":"2026-02-24T08:30:51.187890+0000","mapping_epoch":88,"log_start":"92'2800","ondisk_log_start":"92'2800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105357312,"num_objects":1608,"num_object_clones":0,"num_object_copies":4824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1608,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12861,"num_write_kb":102888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":256,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:32.083256+0000","last_change":"2026-02-24T08:30:22.276827+0000","last_active":"2026-02-24T08:30:32.083256+0000","last_peered":"2026-02-24T08:30:32.083256+0000","last_clean":"2026-02-24T08:30:32.083256+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:32.083256+0000","last_undegraded":"2026-02-24T08:30:32.083256+0000","last_fullsized":"2026-02-24T08:30:32.083256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:30:22.276795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:30:22.276795+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:23.675207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1689378816,"num_objects":25779,"num_object_clones":0,"num_object_copies":77337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206223,"num_write_kb":1649784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5067522048,"data_stored":5067522048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160923,"ondisk_log_size":160923,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247936,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2462392,"kb_used_data":1123812,"kb_used_omap":26,"kb_used_meta":1338533,"kb_avail":731540808,"statfs":{"total":751619276800,"available":749097787392,"internally_reserved":0,"allocated":1150783488,"data_stored":1150138056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27520,"internal_metadata":1370657920},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444162,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2423976,"kb_used_data":1021588,"kb_used_omap":29,"kb_used_meta":1402338,"kb_avail":731579224,"statfs":{"total":751619276800,"available":749137125376,"internally_reserved":0,"allocated":1046106112,"data_stored":1045460680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30530,"internal_metadata":1435994302},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,3,10,15,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2803796,"kb_used_data":1325120,"kb_used_omap":26,"kb_used_meta":1478629,"kb_avail":731199404,"statfs":{"total":751619276800,"available":748748189696,"internally_reserved":0,"allocated":1356922880,"data_stored":1356281000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27272,"internal_metadata":1514116472},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705798,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2868896,"kb_used_data":1444812,"kb_used_omap":27,"kb_used_meta":1424036,"kb_avail":731134304,"statfs":{"total":751619276800,"available":748681527296,"internally_reserved":0,"allocated":1479487488,"data_stored":1478842056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1458213606},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1479467008,"data_stored":1479467008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1375780864,"data_stored":1375780864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1048182784,"data_stored":1048182784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1164091392,"data_stored":1164091392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:30:54.366 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:30:54.367 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 211 2026-02-24T08:30:54.433 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3994759286' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:54.560 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:54.700 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:54.696+0000 7f86d7e11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:54.700 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:54.697+0000 7f86d7e11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:54.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 47 128 217124 216996 36.0648 23.0391 0.024972 0.0277065 2026-02-24T08:30:54.864 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:30:54.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:30:55.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:55 trial105 ceph-mon[39442]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:30:55.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:55 trial105 ceph-mon[39442]: pgmap v388: 17 pgs: 17 active+clean; 1.6 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.61k op/s 2026-02-24T08:30:55.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/892330694' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "211"} : dispatch 2026-02-24T08:30:55.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 48 128 220365 220237 35.8409 25.3203 0.0372698 0.0278861 2026-02-24T08:30:56.291 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:30:56.448 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:56.582 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:56.579+0000 7f931d1a7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:56.583 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:56.580+0000 7f931d1a7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:56.600 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:56.601 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:56.617 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:56.617 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:56.635 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:56.635 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:56.649 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:56.649 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:56.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 49 128 223343 223215 35.5842 23.2656 0.0194334 0.0280853 2026-02-24T08:30:56.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3890212991' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:30:57.704 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 50 128 226687 226559 35.395 26.125 0.0232811 0.0282358 2026-02-24T08:30:57.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:57 trial105 ceph-mon[39442]: pgmap v389: 17 pgs: 17 active+clean; 1.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 3.93k op/s 2026-02-24T08:30:58.697 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:30:58.703 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 51 128 229909 229781 35.1945 25.1719 0.0609921 0.0283962 2026-02-24T08:30:58.847 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:30:58.969 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:58.967+0000 7f6b5bb53640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:58.970 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:30:58.968+0000 7f6b5bb53640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:30:58.986 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:30:58.987 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:30:59.002 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:30:59.003 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:30:59.017 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:30:59.018 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:30:59.033 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:30:59.033 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:30:59.704 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 52 128 233113 232985 34.9991 25.0312 0.0330076 0.0285581 2026-02-24T08:30:59.829 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:30:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:30:59] "GET /metrics HTTP/1.1" 200 4225 "" "Prometheus/3.6.0" 2026-02-24T08:30:59.909 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:30:59.910 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:30:59.910 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T08:30:59.910 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:30:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:30:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:30:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:31:00.068 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:00.095 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:59 trial105 ceph-mon[39442]: pgmap v390: 17 pgs: 17 active+clean; 1.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.61k op/s 2026-02-24T08:31:00.095 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:31:00.095 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:30:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2710532584' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:00.195 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:00.193+0000 7f23a0ce8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:00.196 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:00.194+0000 7f23a0ce8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:00.356 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:31:00.357 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:31:00.409 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2026-02-24T08:30:58.775471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1819279904,"num_objects":27757,"num_object_clones":0,"num_object_copies":83271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27757,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":222143,"num_write_kb":1778214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160907,"ondisk_log_size":160907,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11028804,"kb_used_data":5292212,"kb_used_omap":110,"kb_used_meta":5736401,"kb_avail":2924983996,"statfs":{"total":3006477107200,"available":2995183611904,"internally_reserved":0,"allocated":5419225088,"data_stored":5416646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113252,"internal_metadata":5874075036},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[14,13,6,21,43,41,22,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256983040,"num_objects":3920,"num_object_clones":0,"num_object_copies":11760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31370,"num_write_kb":250960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001884"},"pg_stats":[{"pgid":"7.f","version":"98'13552","reported_seq":13583,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.206849+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:30:56.206849+0000","last_peered":"2026-02-24T08:30:56.206849+0000","last_clean":"2026-02-24T08:30:56.206849+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:30:56.206849+0000","last_undegraded":"2026-02-24T08:30:56.206849+0000","last_fullsized":"2026-02-24T08:30:56.206849+0000","mapping_epoch":88,"log_start":"92'3500","ondisk_log_start":"92'3500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.266863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111017984,"num_objects":1694,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1694,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13552,"num_write_kb":108416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'13892","reported_seq":13921,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.448143+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:30:56.448143+0000","last_peered":"2026-02-24T08:30:56.448143+0000","last_clean":"2026-02-24T08:30:56.448143+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:30:56.448143+0000","last_undegraded":"2026-02-24T08:30:56.448143+0000","last_fullsized":"2026-02-24T08:30:56.448143+0000","mapping_epoch":88,"log_start":"92'3800","ondisk_log_start":"92'3800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.957276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113803264,"num_objects":1737,"num_object_clones":0,"num_object_copies":5211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13892,"num_write_kb":111136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'14104","reported_seq":14134,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:55.963710+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:30:55.963710+0000","last_peered":"2026-02-24T08:30:55.963710+0000","last_clean":"2026-02-24T08:30:55.963710+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:30:55.963710+0000","last_undegraded":"2026-02-24T08:30:55.963710+0000","last_fullsized":"2026-02-24T08:30:55.963710+0000","mapping_epoch":88,"log_start":"92'4100","ondisk_log_start":"92'4100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.913078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115539968,"num_objects":1763,"num_object_clones":0,"num_object_copies":5289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14104,"num_write_kb":112832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'13626","reported_seq":13655,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.013077+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:30:56.013077+0000","last_peered":"2026-02-24T08:30:56.013077+0000","last_clean":"2026-02-24T08:30:56.013077+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:30:56.013077+0000","last_undegraded":"2026-02-24T08:30:56.013077+0000","last_fullsized":"2026-02-24T08:30:56.013077+0000","mapping_epoch":88,"log_start":"92'3600","ondisk_log_start":"92'3600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.009121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111624192,"num_objects":1704,"num_object_clones":0,"num_object_copies":5112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13626,"num_write_kb":109008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'14062","reported_seq":14092,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.462958+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:30:56.462958+0000","last_peered":"2026-02-24T08:30:56.462958+0000","last_clean":"2026-02-24T08:30:56.462958+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:30:56.462958+0000","last_undegraded":"2026-02-24T08:30:56.462958+0000","last_fullsized":"2026-02-24T08:30:56.462958+0000","mapping_epoch":88,"log_start":"92'4000","ondisk_log_start":"92'4000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.268781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115195904,"num_objects":1758,"num_object_clones":0,"num_object_copies":5274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1758,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14062,"num_write_kb":112496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'13945","reported_seq":13972,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.455805+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:30:56.455805+0000","last_peered":"2026-02-24T08:30:56.455805+0000","last_clean":"2026-02-24T08:30:56.455805+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:30:56.455805+0000","last_undegraded":"2026-02-24T08:30:56.455805+0000","last_fullsized":"2026-02-24T08:30:56.455805+0000","mapping_epoch":88,"log_start":"92'3900","ondisk_log_start":"92'3900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.805707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114237440,"num_objects":1744,"num_object_clones":0,"num_object_copies":5232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1744,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13945,"num_write_kb":111560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'13520","reported_seq":13551,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.198557+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:30:56.198557+0000","last_peered":"2026-02-24T08:30:56.198557+0000","last_clean":"2026-02-24T08:30:56.198557+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:30:56.198557+0000","last_undegraded":"2026-02-24T08:30:56.198557+0000","last_fullsized":"2026-02-24T08:30:56.198557+0000","mapping_epoch":88,"log_start":"92'3500","ondisk_log_start":"92'3500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.362625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110755840,"num_objects":1690,"num_object_clones":0,"num_object_copies":5070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1690,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13520,"num_write_kb":108160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'13776","reported_seq":13807,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.383863+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:30:56.383863+0000","last_peered":"2026-02-24T08:30:56.383863+0000","last_clean":"2026-02-24T08:30:56.383863+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:30:56.383863+0000","last_undegraded":"2026-02-24T08:30:56.383863+0000","last_fullsized":"2026-02-24T08:30:56.383863+0000","mapping_epoch":88,"log_start":"92'3700","ondisk_log_start":"92'3700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112852992,"num_objects":1722,"num_object_clones":0,"num_object_copies":5166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13776,"num_write_kb":110208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'13856","reported_seq":13887,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.078675+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:30:56.078675+0000","last_peered":"2026-02-24T08:30:56.078675+0000","last_clean":"2026-02-24T08:30:56.078675+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:30:56.078675+0000","last_undegraded":"2026-02-24T08:30:56.078675+0000","last_fullsized":"2026-02-24T08:30:56.078675+0000","mapping_epoch":88,"log_start":"92'3800","ondisk_log_start":"92'3800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:17.055002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113508352,"num_objects":1732,"num_object_clones":0,"num_object_copies":5196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13856,"num_write_kb":110848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'14160","reported_seq":14191,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.095939+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:30:56.095939+0000","last_peered":"2026-02-24T08:30:56.095939+0000","last_clean":"2026-02-24T08:30:56.095939+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:30:56.095939+0000","last_undegraded":"2026-02-24T08:30:56.095939+0000","last_fullsized":"2026-02-24T08:30:56.095939+0000","mapping_epoch":88,"log_start":"92'4100","ondisk_log_start":"92'4100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115998720,"num_objects":1770,"num_object_clones":0,"num_object_copies":5310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1770,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14160,"num_write_kb":113280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'14386","reported_seq":14396,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.204519+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:30:56.204519+0000","last_peered":"2026-02-24T08:30:56.204519+0000","last_clean":"2026-02-24T08:30:56.204519+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:30:56.204519+0000","last_undegraded":"2026-02-24T08:30:56.204519+0000","last_fullsized":"2026-02-24T08:30:56.204519+0000","mapping_epoch":88,"log_start":"93'4300","ondisk_log_start":"93'4300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:04.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117850112,"num_objects":1799,"num_object_clones":0,"num_object_copies":5397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1799,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14386,"num_write_kb":115088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'13960","reported_seq":13991,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.207203+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:30:56.207203+0000","last_peered":"2026-02-24T08:30:56.207203+0000","last_clean":"2026-02-24T08:30:56.207203+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:30:56.207203+0000","last_undegraded":"2026-02-24T08:30:56.207203+0000","last_fullsized":"2026-02-24T08:30:56.207203+0000","mapping_epoch":88,"log_start":"93'3900","ondisk_log_start":"93'3900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.792005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114360320,"num_objects":1745,"num_object_clones":0,"num_object_copies":5235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13960,"num_write_kb":111680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'14337","reported_seq":14367,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.204058+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:30:56.204058+0000","last_peered":"2026-02-24T08:30:56.204058+0000","last_clean":"2026-02-24T08:30:56.204058+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:30:56.204058+0000","last_undegraded":"2026-02-24T08:30:56.204058+0000","last_fullsized":"2026-02-24T08:30:56.204058+0000","mapping_epoch":88,"log_start":"93'4300","ondisk_log_start":"93'4300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117448704,"num_objects":1793,"num_object_clones":0,"num_object_copies":5379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1793,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14337,"num_write_kb":114696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'13752","reported_seq":13781,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.082857+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:30:56.082857+0000","last_peered":"2026-02-24T08:30:56.082857+0000","last_clean":"2026-02-24T08:30:56.082857+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:30:56.082857+0000","last_undegraded":"2026-02-24T08:30:56.082857+0000","last_fullsized":"2026-02-24T08:30:56.082857+0000","mapping_epoch":88,"log_start":"92'3700","ondisk_log_start":"92'3700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:34.044430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112656384,"num_objects":1719,"num_object_clones":0,"num_object_copies":5157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13752,"num_write_kb":110016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'13208","reported_seq":13233,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.076409+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:30:56.076409+0000","last_peered":"2026-02-24T08:30:56.076409+0000","last_clean":"2026-02-24T08:30:56.076409+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:30:56.076409+0000","last_undegraded":"2026-02-24T08:30:56.076409+0000","last_fullsized":"2026-02-24T08:30:56.076409+0000","mapping_epoch":88,"log_start":"92'3200","ondisk_log_start":"92'3200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108199936,"num_objects":1651,"num_object_clones":0,"num_object_copies":4953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1651,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13208,"num_write_kb":105664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'13872","reported_seq":13903,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:56.107899+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:30:56.107899+0000","last_peered":"2026-02-24T08:30:56.107899+0000","last_clean":"2026-02-24T08:30:56.107899+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:30:56.107899+0000","last_undegraded":"2026-02-24T08:30:56.107899+0000","last_fullsized":"2026-02-24T08:30:56.107899+0000","mapping_epoch":88,"log_start":"92'3800","ondisk_log_start":"92'3800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113639424,"num_objects":1734,"num_object_clones":0,"num_object_copies":5202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1734,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13872,"num_write_kb":110976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":256,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:32.083256+0000","last_change":"2026-02-24T08:30:22.276827+0000","last_active":"2026-02-24T08:30:32.083256+0000","last_peered":"2026-02-24T08:30:32.083256+0000","last_clean":"2026-02-24T08:30:32.083256+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:32.083256+0000","last_undegraded":"2026-02-24T08:30:32.083256+0000","last_fullsized":"2026-02-24T08:30:32.083256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:30:22.276795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:30:22.276795+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:23.675207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1818689536,"num_objects":27755,"num_object_clones":0,"num_object_copies":83265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222008,"num_write_kb":1776064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5452881920,"data_stored":5452881920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160808,"ondisk_log_size":160808,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247937,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2584096,"kb_used_data":1209420,"kb_used_omap":26,"kb_used_meta":1374629,"kb_avail":731419104,"statfs":{"total":751619276800,"available":748973162496,"internally_reserved":0,"allocated":1238446080,"data_stored":1237800648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27520,"internal_metadata":1407620224},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444163,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2502064,"kb_used_data":1099676,"kb_used_omap":29,"kb_used_meta":1402338,"kb_avail":731501136,"statfs":{"total":751619276800,"available":749057163264,"internally_reserved":0,"allocated":1126068224,"data_stored":1125422792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30530,"internal_metadata":1435994302},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2947500,"kb_used_data":1430104,"kb_used_omap":26,"kb_used_meta":1517349,"kb_avail":731055700,"statfs":{"total":751619276800,"available":748601036800,"internally_reserved":0,"allocated":1464426496,"data_stored":1463784616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27272,"internal_metadata":1553765752},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,6,2,12,21,35,8],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705799,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2995144,"kb_used_data":1553012,"kb_used_omap":27,"kb_used_meta":1442084,"kb_avail":731008056,"statfs":{"total":751619276800,"available":748552249344,"internally_reserved":0,"allocated":1590284288,"data_stored":1589638856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1476694758},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,6,3,8,22,6,14,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1592426496,"data_stored":1592426496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1481285632,"data_stored":1481285632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1126572032,"data_stored":1126572032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1252597760,"data_stored":1252597760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:31:00.411 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:31:00.411 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 56 2026-02-24T08:31:00.562 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:00.697 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:00.694+0000 7f673fa52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:00.701 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:00.698+0000 7f673fa52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:00.704 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 53 127 236298 236171 34.8081 24.8906 0.0315551 0.0287079 2026-02-24T08:31:00.861 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:31:00.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:31:01.080 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:01.226 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:01.377 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:01.375+0000 7f02c1c17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:01.378 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:01.375+0000 7f02c1c17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:01.397 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:01.397 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:01.413 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:01.414 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:01.428 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:01.428 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:01.444 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:01.444 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:01.704 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 54 127 239410 239283 34.6137 24.3125 0.0179602 0.0288744 2026-02-24T08:31:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:01 trial105 ceph-mon[39442]: from='client.15367 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:31:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:01 trial105 ceph-mon[39442]: pgmap v391: 17 pgs: 17 active+clean; 1.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.61k op/s 2026-02-24T08:31:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1437779963' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T08:31:02.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/63060871' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:02.704 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 55 128 242767 242639 34.461 26.2188 0.0287988 0.0290013 2026-02-24T08:31:03.497 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:03.650 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:03.704 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 56 128 246073 245945 34.3068 25.8281 0.0327852 0.0291319 2026-02-24T08:31:03.806 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:03.803+0000 7f14c8d06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:03.806 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:03.804+0000 7f14c8d06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:03.826 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:03.826 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:03.840 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:03.840 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:03.856 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:03.856 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:03.870 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:03.870 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:04.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:03 trial105 ceph-mon[39442]: pgmap v392: 17 pgs: 17 active+clean; 1.8 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 3.94k op/s 2026-02-24T08:31:04.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4148222208' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:04.705 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 57 128 249355 249227 34.1548 25.6406 0.0294791 0.0292466 2026-02-24T08:31:05.705 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 58 128 252581 252453 34.0004 25.2031 0.0310456 0.0293961 2026-02-24T08:31:05.904 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:31:05.904 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:31:05.904 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T08:31:05.905 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:31:05.919 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:06.064 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:06.089 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:05 trial105 ceph-mon[39442]: pgmap v393: 17 pgs: 17 active+clean; 1.8 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.64k op/s 2026-02-24T08:31:06.104 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:06.189 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:06.185+0000 7f95056b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:06.190 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:06.186+0000 7f95056b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:06.225 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:06.221+0000 7f3acc47c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:06.226 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:06.223+0000 7f3acc47c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:06.291 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:06.291 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:06.305 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:06.306 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:06.321 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:06.321 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:06.336 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:06.337 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:06.338 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:31:06.339 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:31:06.393 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2026-02-24T08:31:04.776460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1949827616,"num_objects":29747,"num_object_clones":0,"num_object_copies":89241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29747,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":238079,"num_write_kb":1905702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160843,"ondisk_log_size":160843,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11192252,"kb_used_data":5673708,"kb_used_omap":110,"kb_used_meta":5518353,"kb_avail":2924820548,"statfs":{"total":3006477107200,"available":2995016241152,"internally_reserved":0,"allocated":5809876992,"data_stored":5807298816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113252,"internal_metadata":5650793884},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,4,1,1,5,13,13,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":259858432,"num_objects":3966,"num_object_clones":0,"num_object_copies":11898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3966,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31721,"num_write_kb":253768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002038"},"pg_stats":[{"pgid":"7.f","version":"98'14520","reported_seq":14551,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.200236+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:31:01.200236+0000","last_peered":"2026-02-24T08:31:01.200236+0000","last_clean":"2026-02-24T08:31:01.200236+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:31:01.200236+0000","last_undegraded":"2026-02-24T08:31:01.200236+0000","last_fullsized":"2026-02-24T08:31:01.200236+0000","mapping_epoch":88,"log_start":"93'4500","ondisk_log_start":"93'4500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.266863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118947840,"num_objects":1815,"num_object_clones":0,"num_object_copies":5445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14520,"num_write_kb":116160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'14848","reported_seq":14879,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.428412+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:31:01.428412+0000","last_peered":"2026-02-24T08:31:01.428412+0000","last_clean":"2026-02-24T08:31:01.428412+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:31:01.428412+0000","last_undegraded":"2026-02-24T08:31:01.428412+0000","last_fullsized":"2026-02-24T08:31:01.428412+0000","mapping_epoch":88,"log_start":"93'4800","ondisk_log_start":"93'4800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.957276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":1856,"num_object_clones":0,"num_object_copies":5568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1856,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14848,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'15021","reported_seq":15039,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.103262+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:31:01.103262+0000","last_peered":"2026-02-24T08:31:01.103262+0000","last_clean":"2026-02-24T08:31:01.103262+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:31:01.103262+0000","last_undegraded":"2026-02-24T08:31:01.103262+0000","last_fullsized":"2026-02-24T08:31:01.103262+0000","mapping_epoch":88,"log_start":"94'5000","ondisk_log_start":"94'5000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.913078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123052032,"num_objects":1878,"num_object_clones":0,"num_object_copies":5634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1878,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15021,"num_write_kb":120168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'14712","reported_seq":14742,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.087583+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:31:01.087583+0000","last_peered":"2026-02-24T08:31:01.087583+0000","last_clean":"2026-02-24T08:31:01.087583+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:31:01.087583+0000","last_undegraded":"2026-02-24T08:31:01.087583+0000","last_fullsized":"2026-02-24T08:31:01.087583+0000","mapping_epoch":88,"log_start":"93'4700","ondisk_log_start":"93'4700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.009121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120520704,"num_objects":1839,"num_object_clones":0,"num_object_copies":5517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1839,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14712,"num_write_kb":117696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'15072","reported_seq":15103,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.478005+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:31:01.478005+0000","last_peered":"2026-02-24T08:31:01.478005+0000","last_clean":"2026-02-24T08:31:01.478005+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:31:01.478005+0000","last_undegraded":"2026-02-24T08:31:01.478005+0000","last_fullsized":"2026-02-24T08:31:01.478005+0000","mapping_epoch":88,"log_start":"93'5000","ondisk_log_start":"93'5000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.268781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123469824,"num_objects":1884,"num_object_clones":0,"num_object_copies":5652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1884,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15072,"num_write_kb":120576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'15094","reported_seq":15122,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.480375+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:31:01.480375+0000","last_peered":"2026-02-24T08:31:01.480375+0000","last_clean":"2026-02-24T08:31:01.480375+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:31:01.480375+0000","last_undegraded":"2026-02-24T08:31:01.480375+0000","last_fullsized":"2026-02-24T08:31:01.480375+0000","mapping_epoch":88,"log_start":"94'5000","ondisk_log_start":"94'5000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.805707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123650048,"num_objects":1887,"num_object_clones":0,"num_object_copies":5661,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1887,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15094,"num_write_kb":120752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'14558","reported_seq":14587,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.221523+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:31:01.221523+0000","last_peered":"2026-02-24T08:31:01.221523+0000","last_clean":"2026-02-24T08:31:01.221523+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:31:01.221523+0000","last_undegraded":"2026-02-24T08:31:01.221523+0000","last_fullsized":"2026-02-24T08:31:01.221523+0000","mapping_epoch":88,"log_start":"93'4500","ondisk_log_start":"93'4500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.362625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119259136,"num_objects":1820,"num_object_clones":0,"num_object_copies":5460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14558,"num_write_kb":116464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'14728","reported_seq":14759,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.470443+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:31:01.470443+0000","last_peered":"2026-02-24T08:31:01.470443+0000","last_clean":"2026-02-24T08:31:01.470443+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:31:01.470443+0000","last_undegraded":"2026-02-24T08:31:01.470443+0000","last_fullsized":"2026-02-24T08:31:01.470443+0000","mapping_epoch":88,"log_start":"93'4700","ondisk_log_start":"93'4700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120651776,"num_objects":1841,"num_object_clones":0,"num_object_copies":5523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1841,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14728,"num_write_kb":117824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'14824","reported_seq":14855,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:00.953396+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:31:00.953396+0000","last_peered":"2026-02-24T08:31:00.953396+0000","last_clean":"2026-02-24T08:31:00.953396+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:31:00.953396+0000","last_undegraded":"2026-02-24T08:31:00.953396+0000","last_fullsized":"2026-02-24T08:31:00.953396+0000","mapping_epoch":88,"log_start":"93'4800","ondisk_log_start":"93'4800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:17.055002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121438208,"num_objects":1853,"num_object_clones":0,"num_object_copies":5559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1853,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14824,"num_write_kb":118592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'15229","reported_seq":15241,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.122093+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:31:01.122093+0000","last_peered":"2026-02-24T08:31:01.122093+0000","last_clean":"2026-02-24T08:31:01.122093+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:31:01.122093+0000","last_undegraded":"2026-02-24T08:31:01.122093+0000","last_fullsized":"2026-02-24T08:31:01.122093+0000","mapping_epoch":88,"log_start":"93'5200","ondisk_log_start":"93'5200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124755968,"num_objects":1904,"num_object_clones":0,"num_object_copies":5712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15229,"num_write_kb":121832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'15368","reported_seq":15399,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.116409+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:31:01.116409+0000","last_peered":"2026-02-24T08:31:01.116409+0000","last_clean":"2026-02-24T08:31:01.116409+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:31:01.116409+0000","last_undegraded":"2026-02-24T08:31:01.116409+0000","last_fullsized":"2026-02-24T08:31:01.116409+0000","mapping_epoch":88,"log_start":"94'5300","ondisk_log_start":"94'5300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:04.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125894656,"num_objects":1921,"num_object_clones":0,"num_object_copies":5763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1921,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15368,"num_write_kb":122944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'14864","reported_seq":14895,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.223071+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:31:01.223071+0000","last_peered":"2026-02-24T08:31:01.223071+0000","last_clean":"2026-02-24T08:31:01.223071+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:31:01.223071+0000","last_undegraded":"2026-02-24T08:31:01.223071+0000","last_fullsized":"2026-02-24T08:31:01.223071+0000","mapping_epoch":88,"log_start":"94'4800","ondisk_log_start":"94'4800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.792005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121765888,"num_objects":1858,"num_object_clones":0,"num_object_copies":5574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14864,"num_write_kb":118912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'15272","reported_seq":15303,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.202101+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:31:01.202101+0000","last_peered":"2026-02-24T08:31:01.202101+0000","last_clean":"2026-02-24T08:31:01.202101+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:31:01.202101+0000","last_undegraded":"2026-02-24T08:31:01.202101+0000","last_fullsized":"2026-02-24T08:31:01.202101+0000","mapping_epoch":88,"log_start":"94'5200","ondisk_log_start":"94'5200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125108224,"num_objects":1909,"num_object_clones":0,"num_object_copies":5727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15272,"num_write_kb":122176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'14826","reported_seq":14854,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.107805+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:31:01.107805+0000","last_peered":"2026-02-24T08:31:01.107805+0000","last_clean":"2026-02-24T08:31:01.107805+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:31:01.107805+0000","last_undegraded":"2026-02-24T08:31:01.107805+0000","last_fullsized":"2026-02-24T08:31:01.107805+0000","mapping_epoch":88,"log_start":"93'4800","ondisk_log_start":"93'4800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:34.044430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121454592,"num_objects":1854,"num_object_clones":0,"num_object_copies":5562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14826,"num_write_kb":118608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'14152","reported_seq":14176,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.100150+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:31:01.100150+0000","last_peered":"2026-02-24T08:31:01.100150+0000","last_clean":"2026-02-24T08:31:01.100150+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:31:01.100150+0000","last_undegraded":"2026-02-24T08:31:01.100150+0000","last_fullsized":"2026-02-24T08:31:01.100150+0000","mapping_epoch":88,"log_start":"93'4100","ondisk_log_start":"93'4100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115933184,"num_objects":1769,"num_object_clones":0,"num_object_copies":5307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14152,"num_write_kb":113216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'14856","reported_seq":14887,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:01.214179+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:31:01.214179+0000","last_peered":"2026-02-24T08:31:01.214179+0000","last_clean":"2026-02-24T08:31:01.214179+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:31:01.214179+0000","last_undegraded":"2026-02-24T08:31:01.214179+0000","last_fullsized":"2026-02-24T08:31:01.214179+0000","mapping_epoch":88,"log_start":"93'4800","ondisk_log_start":"93'4800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121700352,"num_objects":1857,"num_object_clones":0,"num_object_copies":5571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14856,"num_write_kb":118848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":256,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:32.083256+0000","last_change":"2026-02-24T08:30:22.276827+0000","last_active":"2026-02-24T08:30:32.083256+0000","last_peered":"2026-02-24T08:30:32.083256+0000","last_clean":"2026-02-24T08:30:32.083256+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:32.083256+0000","last_undegraded":"2026-02-24T08:30:32.083256+0000","last_fullsized":"2026-02-24T08:30:32.083256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:30:22.276795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:30:22.276795+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:23.675207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1949237248,"num_objects":29745,"num_object_clones":0,"num_object_copies":89235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29745,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237944,"num_write_kb":1903552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5847416832,"data_stored":5847416832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160744,"ondisk_log_size":160744,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247938,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2707792,"kb_used_data":1297724,"kb_used_omap":26,"kb_used_meta":1410021,"kb_avail":731295408,"statfs":{"total":751619276800,"available":748846497792,"internally_reserved":0,"allocated":1328869376,"data_stored":1328223944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27520,"internal_metadata":1443861632},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,4,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444164,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2598352,"kb_used_data":1177916,"kb_used_omap":29,"kb_used_meta":1420386,"kb_avail":731404848,"statfs":{"total":751619276800,"available":748958564352,"internally_reserved":0,"allocated":1206185984,"data_stored":1205540552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30530,"internal_metadata":1454475454},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,0,0,8,13,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2761420,"kb_used_data":1533560,"kb_used_omap":26,"kb_used_meta":1227813,"kb_avail":731241780,"statfs":{"total":751619276800,"available":748791582720,"internally_reserved":0,"allocated":1570365440,"data_stored":1569723560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27272,"internal_metadata":1257280888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705800,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3124688,"kb_used_data":1664508,"kb_used_omap":27,"kb_used_meta":1460132,"kb_avail":730878512,"statfs":{"total":751619276800,"available":748419596288,"internally_reserved":0,"allocated":1704456192,"data_stored":1703810760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1495175910},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1707655168,"data_stored":1707655168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1588248576,"data_stored":1588248576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1209131008,"data_stored":1209131008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1342382080,"data_stored":1342382080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:31:06.395 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:31:06.395 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 66 2026-02-24T08:31:06.584 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:06.705 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 59 128 255470 255342 33.8067 22.5703 0.0583489 0.0295654 2026-02-24T08:31:06.721 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:06.718+0000 7f5813e13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:06.721 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:06.718+0000 7f5813e13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:06.879 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:31:06.880 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:06 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3253885418' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:06.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:31:07.705 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:31:07.703596+0000 min lat: 0.000722661 max lat: 0.265624 avg lat: 0.0297008 2026-02-24T08:31:07.705 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:31:07.705 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 60 128 258586 258458 33.6489 24.3438 0.0091954 0.0297008 2026-02-24T08:31:08.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:07 trial105 ceph-mon[39442]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:31:08.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:07 trial105 ceph-mon[39442]: pgmap v394: 17 pgs: 17 active+clean; 1.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 4.00k op/s 2026-02-24T08:31:08.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2873921808' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T08:31:08.389 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:08.535 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:08.672 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:08.670+0000 7f6ed00ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:08.673 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:08.671+0000 7f6ed00ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:08.704 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:08.705 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:08.705 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 61 127 261694 261567 33.4951 24.2891 0.0177492 0.0298412 2026-02-24T08:31:08.722 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:08.722 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:08.741 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:08.742 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:08.763 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:08.763 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:08 trial105 ceph-mon[39442]: 7.4 scrub starts 2026-02-24T08:31:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:08 trial105 ceph-mon[39442]: 7.4 scrub ok 2026-02-24T08:31:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:08 trial105 ceph-mon[39442]: 7.d scrub starts 2026-02-24T08:31:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:08 trial105 ceph-mon[39442]: 7.d scrub ok 2026-02-24T08:31:08.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3726410825' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:09.706 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 62 128 264997 264869 33.371 25.7969 0.0458735 0.0299538 2026-02-24T08:31:09.837 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:31:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:31:09] "GET /metrics HTTP/1.1" 200 4225 "" "Prometheus/3.6.0" 2026-02-24T08:31:09.843 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:31:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:31:09.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:31:10.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:09 trial105 ceph-mon[39442]: pgmap v395: 17 pgs: 17 active+clean; 1.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.68k op/s 2026-02-24T08:31:10.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:09 trial105 ceph-mon[39442]: 7.8 scrub starts 2026-02-24T08:31:10.706 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 63 128 268321 268193 33.2534 25.9688 0.0620996 0.0300593 2026-02-24T08:31:10.812 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:10.969 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:11.089 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:11.086+0000 7f7abda11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:11.089 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:11.087+0000 7f7abda11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:11.089 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:10 trial105 ceph-mon[39442]: 7.e scrub starts 2026-02-24T08:31:11.089 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:10 trial105 ceph-mon[39442]: 7.8 scrub ok 2026-02-24T08:31:11.108 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:11.108 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:11.125 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:11.125 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:11.140 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:11.140 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:11.157 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:11.157 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:11.705 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 64 128 271327 271199 33.1008 23.4844 0.0327536 0.0301913 2026-02-24T08:31:11.924 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:31:11.925 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:31:11.925 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:31:11.925 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:31:12.083 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:12.110 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:11 trial105 ceph-mon[39442]: pgmap v396: 17 pgs: 17 active+clean; 1.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.68k op/s 2026-02-24T08:31:12.110 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:11 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/248549584' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:12.217 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:12.214+0000 7fcc11fd2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:12.218 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:12.215+0000 7fcc11fd2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:12.375 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:31:12.375 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:31:12.425 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":396,"stamp":"2026-02-24T08:31:10.777334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2082980384,"num_objects":31778,"num_object_clones":0,"num_object_copies":95334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31778,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":254333,"num_write_kb":2035734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160897,"ondisk_log_size":160897,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11706652,"kb_used_data":6081292,"kb_used_omap":110,"kb_used_meta":5625169,"kb_avail":2924306148,"statfs":{"total":3006477107200,"available":2994489495552,"internally_reserved":0,"allocated":6227243008,"data_stored":6224664832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113252,"internal_metadata":5760173468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,15,24,72,32,56,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":263700480,"num_objects":4021,"num_object_clones":0,"num_object_copies":12063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4021,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32190,"num_write_kb":257520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001863"},"pg_stats":[{"pgid":"7.f","version":"98'15589","reported_seq":15612,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.266746+0000","last_change":"2026-02-24T08:30:05.106087+0000","last_active":"2026-02-24T08:31:06.266746+0000","last_peered":"2026-02-24T08:31:06.266746+0000","last_clean":"2026-02-24T08:31:06.266746+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:31:06.266746+0000","last_undegraded":"2026-02-24T08:31:06.266746+0000","last_fullsized":"2026-02-24T08:31:06.266746+0000","mapping_epoch":88,"log_start":"94'5500","ondisk_log_start":"94'5500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.266863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127705088,"num_objects":1949,"num_object_clones":0,"num_object_copies":5847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1949,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15589,"num_write_kb":124712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'15920","reported_seq":15951,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.419971+0000","last_change":"2026-02-24T08:30:05.105034+0000","last_active":"2026-02-24T08:31:06.419971+0000","last_peered":"2026-02-24T08:31:06.419971+0000","last_clean":"2026-02-24T08:31:06.419971+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:31:06.419971+0000","last_undegraded":"2026-02-24T08:31:06.419971+0000","last_fullsized":"2026-02-24T08:31:06.419971+0000","mapping_epoch":88,"log_start":"94'5900","ondisk_log_start":"94'5900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.957276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130416640,"num_objects":1990,"num_object_clones":0,"num_object_copies":5970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1990,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15920,"num_write_kb":127360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'16064","reported_seq":16094,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.069043+0000","last_change":"2026-02-24T08:30:05.105506+0000","last_active":"2026-02-24T08:31:06.069043+0000","last_peered":"2026-02-24T08:31:06.069043+0000","last_clean":"2026-02-24T08:31:06.069043+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:31:06.069043+0000","last_undegraded":"2026-02-24T08:31:06.069043+0000","last_fullsized":"2026-02-24T08:31:06.069043+0000","mapping_epoch":88,"log_start":"94'6000","ondisk_log_start":"94'6000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:06.913078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131596288,"num_objects":2008,"num_object_clones":0,"num_object_copies":6024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16064,"num_write_kb":128512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'15656","reported_seq":15665,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.112157+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:31:06.112157+0000","last_peered":"2026-02-24T08:31:06.112157+0000","last_clean":"2026-02-24T08:31:06.112157+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:31:06.112157+0000","last_undegraded":"2026-02-24T08:31:06.112157+0000","last_fullsized":"2026-02-24T08:31:06.112157+0000","mapping_epoch":88,"log_start":"94'5600","ondisk_log_start":"94'5600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.009121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128253952,"num_objects":1957,"num_object_clones":0,"num_object_copies":5871,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1957,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15656,"num_write_kb":125248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'16112","reported_seq":16142,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.510573+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:31:06.510573+0000","last_peered":"2026-02-24T08:31:06.510573+0000","last_clean":"2026-02-24T08:31:06.510573+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:31:06.510573+0000","last_undegraded":"2026-02-24T08:31:06.510573+0000","last_fullsized":"2026-02-24T08:31:06.510573+0000","mapping_epoch":88,"log_start":"94'6100","ondisk_log_start":"94'6100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.268781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131989504,"num_objects":2014,"num_object_clones":0,"num_object_copies":6042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2014,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16112,"num_write_kb":128896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'16112","reported_seq":16143,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.435768+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:31:06.435768+0000","last_peered":"2026-02-24T08:31:06.435768+0000","last_clean":"2026-02-24T08:31:06.435768+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:31:06.435768+0000","last_undegraded":"2026-02-24T08:31:06.435768+0000","last_fullsized":"2026-02-24T08:31:06.435768+0000","mapping_epoch":88,"log_start":"94'6100","ondisk_log_start":"94'6100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.805707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131989504,"num_objects":2014,"num_object_clones":0,"num_object_copies":6042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2014,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16112,"num_write_kb":128896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'15384","reported_seq":15415,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.209945+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:31:06.209945+0000","last_peered":"2026-02-24T08:31:06.209945+0000","last_clean":"2026-02-24T08:31:06.209945+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:31:06.209945+0000","last_undegraded":"2026-02-24T08:31:06.209945+0000","last_fullsized":"2026-02-24T08:31:06.209945+0000","mapping_epoch":88,"log_start":"94'5300","ondisk_log_start":"94'5300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.362625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126025728,"num_objects":1923,"num_object_clones":0,"num_object_copies":5769,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15384,"num_write_kb":123072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'15840","reported_seq":15871,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.469056+0000","last_change":"2026-02-24T08:30:05.104873+0000","last_active":"2026-02-24T08:31:06.469056+0000","last_peered":"2026-02-24T08:31:06.469056+0000","last_clean":"2026-02-24T08:31:06.469056+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:31:06.469056+0000","last_undegraded":"2026-02-24T08:31:06.469056+0000","last_fullsized":"2026-02-24T08:31:06.469056+0000","mapping_epoch":88,"log_start":"94'5800","ondisk_log_start":"94'5800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:08.498511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129761280,"num_objects":1980,"num_object_clones":0,"num_object_copies":5940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15840,"num_write_kb":126720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'15888","reported_seq":15917,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.128964+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:31:06.128964+0000","last_peered":"2026-02-24T08:31:06.128964+0000","last_clean":"2026-02-24T08:31:06.128964+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:31:06.128964+0000","last_undegraded":"2026-02-24T08:31:06.128964+0000","last_fullsized":"2026-02-24T08:31:06.128964+0000","mapping_epoch":88,"log_start":"94'5800","ondisk_log_start":"94'5800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:17.055002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130154496,"num_objects":1986,"num_object_clones":0,"num_object_copies":5958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1986,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15888,"num_write_kb":127104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'16232","reported_seq":16263,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:05.984700+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:31:05.984700+0000","last_peered":"2026-02-24T08:31:05.984700+0000","last_clean":"2026-02-24T08:31:05.984700+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:31:05.984700+0000","last_undegraded":"2026-02-24T08:31:05.984700+0000","last_fullsized":"2026-02-24T08:31:05.984700+0000","mapping_epoch":88,"log_start":"94'6200","ondisk_log_start":"94'6200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132972544,"num_objects":2029,"num_object_clones":0,"num_object_copies":6087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2029,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16232,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'16416","reported_seq":16447,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.227618+0000","last_change":"2026-02-24T08:30:05.106077+0000","last_active":"2026-02-24T08:31:06.227618+0000","last_peered":"2026-02-24T08:31:06.227618+0000","last_clean":"2026-02-24T08:31:06.227618+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:31:06.227618+0000","last_undegraded":"2026-02-24T08:31:06.227618+0000","last_fullsized":"2026-02-24T08:31:06.227618+0000","mapping_epoch":88,"log_start":"94'6400","ondisk_log_start":"94'6400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134479872,"num_objects":2052,"num_object_clones":0,"num_object_copies":6156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2052,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16416,"num_write_kb":131328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'15957","reported_seq":15986,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.245115+0000","last_change":"2026-02-24T08:30:05.104481+0000","last_active":"2026-02-24T08:31:06.245115+0000","last_peered":"2026-02-24T08:31:06.245115+0000","last_clean":"2026-02-24T08:31:06.245115+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:31:06.245115+0000","last_undegraded":"2026-02-24T08:31:06.245115+0000","last_fullsized":"2026-02-24T08:31:06.245115+0000","mapping_epoch":88,"log_start":"94'5900","ondisk_log_start":"94'5900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:11.792005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130719744,"num_objects":1995,"num_object_clones":0,"num_object_copies":5985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15957,"num_write_kb":127656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'16096","reported_seq":16127,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.147915+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:31:06.147915+0000","last_peered":"2026-02-24T08:31:06.147915+0000","last_clean":"2026-02-24T08:31:06.147915+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:31:06.147915+0000","last_undegraded":"2026-02-24T08:31:06.147915+0000","last_fullsized":"2026-02-24T08:31:06.147915+0000","mapping_epoch":88,"log_start":"94'6000","ondisk_log_start":"94'6000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131858432,"num_objects":2012,"num_object_clones":0,"num_object_copies":6036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2012,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16096,"num_write_kb":128768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'15856","reported_seq":15886,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.112485+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:31:06.112485+0000","last_peered":"2026-02-24T08:31:06.112485+0000","last_clean":"2026-02-24T08:31:06.112485+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:31:06.112485+0000","last_undegraded":"2026-02-24T08:31:06.112485+0000","last_fullsized":"2026-02-24T08:31:06.112485+0000","mapping_epoch":88,"log_start":"94'5800","ondisk_log_start":"94'5800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:34.044430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129892352,"num_objects":1982,"num_object_clones":0,"num_object_copies":5946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1982,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15856,"num_write_kb":126848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'15232","reported_seq":15262,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.098003+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:31:06.098003+0000","last_peered":"2026-02-24T08:31:06.098003+0000","last_clean":"2026-02-24T08:31:06.098003+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:31:06.098003+0000","last_undegraded":"2026-02-24T08:31:06.098003+0000","last_fullsized":"2026-02-24T08:31:06.098003+0000","mapping_epoch":88,"log_start":"94'5200","ondisk_log_start":"94'5200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124780544,"num_objects":1904,"num_object_clones":0,"num_object_copies":5712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1904,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15232,"num_write_kb":121856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'15844","reported_seq":15873,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:06.261857+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:31:06.261857+0000","last_peered":"2026-02-24T08:31:06.261857+0000","last_clean":"2026-02-24T08:31:06.261857+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:31:06.261857+0000","last_undegraded":"2026-02-24T08:31:06.261857+0000","last_fullsized":"2026-02-24T08:31:06.261857+0000","mapping_epoch":88,"log_start":"94'5800","ondisk_log_start":"94'5800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129794048,"num_objects":1981,"num_object_clones":0,"num_object_copies":5943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15844,"num_write_kb":126752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":256,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:32.083256+0000","last_change":"2026-02-24T08:30:22.276827+0000","last_active":"2026-02-24T08:30:32.083256+0000","last_peered":"2026-02-24T08:30:32.083256+0000","last_clean":"2026-02-24T08:30:32.083256+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:32.083256+0000","last_undegraded":"2026-02-24T08:30:32.083256+0000","last_fullsized":"2026-02-24T08:30:32.083256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:30:22.276795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:30:22.276795+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:23.675207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":2082390016,"num_objects":31776,"num_object_clones":0,"num_object_copies":95328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31776,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254198,"num_write_kb":2033584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6247768064,"data_stored":6247768064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160798,"ondisk_log_size":160798,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247939,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2811664,"kb_used_data":1385020,"kb_used_omap":26,"kb_used_meta":1426597,"kb_avail":731191536,"statfs":{"total":751619276800,"available":748740132864,"internally_reserved":0,"allocated":1418260480,"data_stored":1417615048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27520,"internal_metadata":1460835456},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444165,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2699192,"kb_used_data":1260708,"kb_used_omap":29,"kb_used_meta":1438434,"kb_avail":731304008,"statfs":{"total":751619276800,"available":748855304192,"internally_reserved":0,"allocated":1290964992,"data_stored":1290319560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30530,"internal_metadata":1472956606},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,3,20,4,15],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2919164,"kb_used_data":1655208,"kb_used_omap":26,"kb_used_meta":1263909,"kb_avail":731084036,"statfs":{"total":751619276800,"available":748630052864,"internally_reserved":0,"allocated":1694932992,"data_stored":1694291112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27272,"internal_metadata":1294243192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,6,5,28,18,32,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705801,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3276632,"kb_used_data":1780356,"kb_used_omap":27,"kb_used_meta":1496228,"kb_avail":730726568,"statfs":{"total":751619276800,"available":748264005632,"internally_reserved":0,"allocated":1823084544,"data_stored":1822439112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1532138214},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,9,16,24,10,9],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1824555008,"data_stored":1824555008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1695571968,"data_stored":1695571968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1293410304,"data_stored":1293410304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1434230784,"data_stored":1434230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:31:12.426 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:31:12.426 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 221 2026-02-24T08:31:12.576 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:12.706 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 65 128 274294 274166 32.948 23.1797 0.0298323 0.0303362 2026-02-24T08:31:12.710 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:12.706+0000 7f88d207e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:12.710 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:12.706+0000 7f88d207e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:12.876 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:12 trial105 ceph-mon[39442]: 7.f scrub starts 2026-02-24T08:31:12.876 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:12 trial105 ceph-mon[39442]: 7.e scrub ok 2026-02-24T08:31:12.876 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:31:12.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:31:13.206 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:13.362 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:13.492 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:13.489+0000 7f91cf023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:13.492 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:13.489+0000 7f91cf023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:13.510 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:13.510 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:13.524 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:13.525 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:13.539 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:13.540 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:13.552 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:13.552 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:13.706 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 66 128 277390 277262 32.8153 24.1875 0.0631241 0.0304617 2026-02-24T08:31:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:13 trial105 ceph-mon[39442]: 7.f scrub ok 2026-02-24T08:31:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:13 trial105 ceph-mon[39442]: from='client.15385 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:31:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:13 trial105 ceph-mon[39442]: pgmap v397: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 4.00k op/s 2026-02-24T08:31:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3274821606' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "221"} : dispatch 2026-02-24T08:31:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3175046095' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:14.706 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 67 128 280620 280492 32.7021 25.2344 0.0192463 0.0305608 2026-02-24T08:31:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:31:15.607 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:15.706 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 68 127 283740 283613 32.5796 24.3828 0.042285 0.030681 2026-02-24T08:31:15.761 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:15.896 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:15.893+0000 7f4e85193640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:15.896 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:15 trial105 ceph-mon[39442]: 7.3 scrub starts 2026-02-24T08:31:15.896 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:15 trial105 ceph-mon[39442]: 7.3 scrub ok 2026-02-24T08:31:15.896 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:15 trial105 ceph-mon[39442]: pgmap v398: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.1 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.68k op/s 2026-02-24T08:31:15.897 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:15.893+0000 7f4e85193640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:15.915 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:15.915 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:15.931 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:15.931 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:15.947 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:15.947 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:15.964 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:15.964 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:16.706 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 69 128 286922 286794 32.4676 24.8516 0.127075 0.0307827 2026-02-24T08:31:17.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/493321441' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:17.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 70 128 290056 289928 32.3535 24.4844 0.12934 0.0308915 2026-02-24T08:31:17.920 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:31:17.920 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:31:17.921 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T08:31:17.921 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:31:18.013 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:18.071 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:17 trial105 ceph-mon[39442]: pgmap v399: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 3.96k op/s 2026-02-24T08:31:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:17 trial105 ceph-mon[39442]: 7.7 scrub starts 2026-02-24T08:31:18.271 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:18.428 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:18.425+0000 7fedd9281640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:18.428 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:18.425+0000 7fedd9281640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:18.481 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:18.479+0000 7f2b37653640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:18.482 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:18.480+0000 7f2b37653640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:18.508 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:18.508 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:18.522 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:18.522 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:18.536 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:18.536 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:18.554 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:18.555 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:18.582 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:31:18.583 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:31:18.633 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2026-02-24T08:31:16.778172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2339660320,"num_objects":35697,"num_object_clones":0,"num_object_copies":107091,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35697,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":285666,"num_write_kb":2286398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161030,"ondisk_log_size":161030,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12657364,"kb_used_data":6849092,"kb_used_omap":110,"kb_used_meta":5808081,"kb_avail":2923355436,"statfs":{"total":3006477107200,"available":2993515966464,"internally_reserved":0,"allocated":7013470208,"data_stored":7010892032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113252,"internal_metadata":5947475356},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,7,4,14,18,27,12],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":389832704,"num_objects":5950,"num_object_clones":0,"num_object_copies":17850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47587,"num_write_kb":380696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001712"},"pg_stats":[{"pgid":"7.f","version":"98'17575","reported_seq":17629,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.339141+0000","last_change":"2026-02-24T08:31:12.018343+0000","last_active":"2026-02-24T08:31:16.339141+0000","last_peered":"2026-02-24T08:31:16.339141+0000","last_clean":"2026-02-24T08:31:16.339141+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:31:16.339141+0000","last_undegraded":"2026-02-24T08:31:16.339141+0000","last_fullsized":"2026-02-24T08:31:16.339141+0000","mapping_epoch":88,"log_start":"95'7500","ondisk_log_start":"95'7500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16736","last_scrub_stamp":"2026-02-24T08:31:12.018218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.018218+0000","objects_scrubbed":2085,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:26.792730+0000","scrub_duration":690,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143974400,"num_objects":2197,"num_object_clones":0,"num_object_copies":6591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17575,"num_write_kb":140600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'17973","reported_seq":18034,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.555150+0000","last_change":"2026-02-24T08:31:12.376434+0000","last_active":"2026-02-24T08:31:16.555150+0000","last_peered":"2026-02-24T08:31:16.555150+0000","last_clean":"2026-02-24T08:31:16.555150+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:31:16.555150+0000","last_undegraded":"2026-02-24T08:31:16.555150+0000","last_fullsized":"2026-02-24T08:31:16.555150+0000","mapping_epoch":88,"log_start":"95'7900","ondisk_log_start":"95'7900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17112","last_scrub_stamp":"2026-02-24T08:31:12.376327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.376327+0000","objects_scrubbed":2122,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.530316+0000","scrub_duration":1930,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147234816,"num_objects":2247,"num_object_clones":0,"num_object_copies":6741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2247,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17973,"num_write_kb":143784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'18184","reported_seq":18228,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.134083+0000","last_change":"2026-02-24T08:31:08.542725+0000","last_active":"2026-02-24T08:31:16.134083+0000","last_peered":"2026-02-24T08:31:16.134083+0000","last_clean":"2026-02-24T08:31:16.134083+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:31:16.134083+0000","last_undegraded":"2026-02-24T08:31:16.134083+0000","last_fullsized":"2026-02-24T08:31:16.134083+0000","mapping_epoch":88,"log_start":"95'8100","ondisk_log_start":"95'8100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16584","last_scrub_stamp":"2026-02-24T08:31:08.542685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:08.542685+0000","objects_scrubbed":2064,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.166619+0000","scrub_duration":597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148963328,"num_objects":2273,"num_object_clones":0,"num_object_copies":6819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18184,"num_write_kb":145472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'17734","reported_seq":17759,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.129507+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:31:16.129507+0000","last_peered":"2026-02-24T08:31:16.129507+0000","last_clean":"2026-02-24T08:31:16.129507+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:31:16.129507+0000","last_undegraded":"2026-02-24T08:31:16.129507+0000","last_fullsized":"2026-02-24T08:31:16.129507+0000","mapping_epoch":88,"log_start":"95'7700","ondisk_log_start":"95'7700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.009121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145276928,"num_objects":2217,"num_object_clones":0,"num_object_copies":6651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17734,"num_write_kb":141872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'18010","reported_seq":18036,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.554658+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:31:16.554658+0000","last_peered":"2026-02-24T08:31:16.554658+0000","last_clean":"2026-02-24T08:31:16.554658+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:31:16.554658+0000","last_undegraded":"2026-02-24T08:31:16.554658+0000","last_fullsized":"2026-02-24T08:31:16.554658+0000","mapping_epoch":88,"log_start":"95'8000","ondisk_log_start":"95'8000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.268781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147537920,"num_objects":2252,"num_object_clones":0,"num_object_copies":6756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18010,"num_write_kb":144080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'17879","reported_seq":17909,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.554646+0000","last_change":"2026-02-24T08:30:05.104830+0000","last_active":"2026-02-24T08:31:16.554646+0000","last_peered":"2026-02-24T08:31:16.554646+0000","last_clean":"2026-02-24T08:31:16.554646+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:31:16.554646+0000","last_undegraded":"2026-02-24T08:31:16.554646+0000","last_fullsized":"2026-02-24T08:31:16.554646+0000","mapping_epoch":88,"log_start":"95'7800","ondisk_log_start":"95'7800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:21.805707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146464768,"num_objects":2235,"num_object_clones":0,"num_object_copies":6705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2235,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17879,"num_write_kb":143032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'17264","reported_seq":17292,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.330428+0000","last_change":"2026-02-24T08:30:05.105861+0000","last_active":"2026-02-24T08:31:16.330428+0000","last_peered":"2026-02-24T08:31:16.330428+0000","last_clean":"2026-02-24T08:31:16.330428+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:31:16.330428+0000","last_undegraded":"2026-02-24T08:31:16.330428+0000","last_fullsized":"2026-02-24T08:31:16.330428+0000","mapping_epoch":88,"log_start":"94'7200","ondisk_log_start":"94'7200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:22.362625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141426688,"num_objects":2158,"num_object_clones":0,"num_object_copies":6474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17264,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'17840","reported_seq":17900,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.506702+0000","last_change":"2026-02-24T08:31:10.550564+0000","last_active":"2026-02-24T08:31:16.506702+0000","last_peered":"2026-02-24T08:31:16.506702+0000","last_clean":"2026-02-24T08:31:16.506702+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:31:16.506702+0000","last_undegraded":"2026-02-24T08:31:16.506702+0000","last_fullsized":"2026-02-24T08:31:16.506702+0000","mapping_epoch":88,"log_start":"95'7800","ondisk_log_start":"95'7800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16688","last_scrub_stamp":"2026-02-24T08:31:10.550527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:10.550527+0000","objects_scrubbed":2070,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:24.679802+0000","scrub_duration":1098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146145280,"num_objects":2230,"num_object_clones":0,"num_object_copies":6690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2230,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17840,"num_write_kb":142720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'17914","reported_seq":17943,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.127323+0000","last_change":"2026-02-24T08:30:05.105324+0000","last_active":"2026-02-24T08:31:16.127323+0000","last_peered":"2026-02-24T08:31:16.127323+0000","last_clean":"2026-02-24T08:31:16.127323+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:31:16.127323+0000","last_undegraded":"2026-02-24T08:31:16.127323+0000","last_fullsized":"2026-02-24T08:31:16.127323+0000","mapping_epoch":88,"log_start":"95'7900","ondisk_log_start":"95'7900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:17.055002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146751488,"num_objects":2240,"num_object_clones":0,"num_object_copies":6720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17914,"num_write_kb":143312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'18196","reported_seq":18219,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.148903+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:31:16.148903+0000","last_peered":"2026-02-24T08:31:16.148903+0000","last_clean":"2026-02-24T08:31:16.148903+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:31:16.148903+0000","last_undegraded":"2026-02-24T08:31:16.148903+0000","last_fullsized":"2026-02-24T08:31:16.148903+0000","mapping_epoch":88,"log_start":"95'8100","ondisk_log_start":"95'8100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149061632,"num_objects":2275,"num_object_clones":0,"num_object_copies":6825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2275,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18196,"num_write_kb":145568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'18496","reported_seq":18556,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.273922+0000","last_change":"2026-02-24T08:31:07.849199+0000","last_active":"2026-02-24T08:31:16.273922+0000","last_peered":"2026-02-24T08:31:16.273922+0000","last_clean":"2026-02-24T08:31:16.273922+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:31:16.273922+0000","last_undegraded":"2026-02-24T08:31:16.273922+0000","last_fullsized":"2026-02-24T08:31:16.273922+0000","mapping_epoch":88,"log_start":"95'8400","ondisk_log_start":"95'8400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16720","last_scrub_stamp":"2026-02-24T08:31:07.849158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:07.849158+0000","objects_scrubbed":2083,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.810202+0000","scrub_duration":740,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151519232,"num_objects":2312,"num_object_clones":0,"num_object_copies":6936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18496,"num_write_kb":147968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'17864","reported_seq":17924,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.332862+0000","last_change":"2026-02-24T08:31:14.599343+0000","last_active":"2026-02-24T08:31:16.332862+0000","last_peered":"2026-02-24T08:31:16.332862+0000","last_clean":"2026-02-24T08:31:16.332862+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:31:16.332862+0000","last_undegraded":"2026-02-24T08:31:16.332862+0000","last_fullsized":"2026-02-24T08:31:16.332862+0000","mapping_epoch":88,"log_start":"95'7800","ondisk_log_start":"95'7800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17528","last_scrub_stamp":"2026-02-24T08:31:14.599269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:14.599269+0000","objects_scrubbed":2190,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:19.940351+0000","scrub_duration":261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146341888,"num_objects":2233,"num_object_clones":0,"num_object_copies":6699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17864,"num_write_kb":142912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'18036","reported_seq":18067,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.323259+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:31:16.323259+0000","last_peered":"2026-02-24T08:31:16.323259+0000","last_clean":"2026-02-24T08:31:16.323259+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:31:16.323259+0000","last_undegraded":"2026-02-24T08:31:16.323259+0000","last_fullsized":"2026-02-24T08:31:16.323259+0000","mapping_epoch":88,"log_start":"95'8000","ondisk_log_start":"95'8000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147750912,"num_objects":2255,"num_object_clones":0,"num_object_copies":6765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2255,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18036,"num_write_kb":144288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'17776","reported_seq":17806,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.123552+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:31:16.123552+0000","last_peered":"2026-02-24T08:31:16.123552+0000","last_clean":"2026-02-24T08:31:16.123552+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:31:16.123552+0000","last_undegraded":"2026-02-24T08:31:16.123552+0000","last_fullsized":"2026-02-24T08:31:16.123552+0000","mapping_epoch":88,"log_start":"95'7700","ondisk_log_start":"95'7700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:34.044430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145620992,"num_objects":2222,"num_object_clones":0,"num_object_copies":6666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17776,"num_write_kb":142208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'16902","reported_seq":16928,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.123909+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:31:16.123909+0000","last_peered":"2026-02-24T08:31:16.123909+0000","last_clean":"2026-02-24T08:31:16.123909+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:31:16.123909+0000","last_undegraded":"2026-02-24T08:31:16.123909+0000","last_fullsized":"2026-02-24T08:31:16.123909+0000","mapping_epoch":88,"log_start":"95'6900","ondisk_log_start":"95'6900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138461184,"num_objects":2113,"num_object_clones":0,"num_object_copies":6339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16902,"num_write_kb":135216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'17888","reported_seq":17919,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:16.323158+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:31:16.323158+0000","last_peered":"2026-02-24T08:31:16.323158+0000","last_clean":"2026-02-24T08:31:16.323158+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:31:16.323158+0000","last_undegraded":"2026-02-24T08:31:16.323158+0000","last_fullsized":"2026-02-24T08:31:16.323158+0000","mapping_epoch":88,"log_start":"95'7800","ondisk_log_start":"95'7800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146538496,"num_objects":2236,"num_object_clones":0,"num_object_copies":6708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2236,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17888,"num_write_kb":143104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":256,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:30:32.083256+0000","last_change":"2026-02-24T08:30:22.276827+0000","last_active":"2026-02-24T08:30:32.083256+0000","last_peered":"2026-02-24T08:30:32.083256+0000","last_clean":"2026-02-24T08:30:32.083256+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:30:32.083256+0000","last_undegraded":"2026-02-24T08:30:32.083256+0000","last_fullsized":"2026-02-24T08:30:32.083256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:30:22.276795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:30:22.276795+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:23.675207+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":2339069952,"num_objects":35695,"num_object_clones":0,"num_object_copies":107085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35695,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":285531,"num_write_kb":2284248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7018192896,"data_stored":7018192896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160931,"ondisk_log_size":160931,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247941,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3039848,"kb_used_data":1577108,"kb_used_omap":26,"kb_used_meta":1462693,"kb_avail":730963352,"statfs":{"total":751619276800,"available":748506472448,"internally_reserved":0,"allocated":1614958592,"data_stored":1614313160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27520,"internal_metadata":1497797760},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444167,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2889824,"kb_used_data":1415244,"kb_used_omap":29,"kb_used_meta":1474530,"kb_avail":731113376,"statfs":{"total":751619276800,"available":748660097024,"internally_reserved":0,"allocated":1449209856,"data_stored":1448564424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30530,"internal_metadata":1509918910},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,1,2,0,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3179972,"kb_used_data":1859440,"kb_used_omap":26,"kb_used_meta":1320485,"kb_avail":730823228,"statfs":{"total":751619276800,"available":748362985472,"internally_reserved":0,"allocated":1904066560,"data_stored":1903424680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27272,"internal_metadata":1352177016},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705803,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3547720,"kb_used_data":1997300,"kb_used_omap":27,"kb_used_meta":1550372,"kb_avail":730455480,"statfs":{"total":751619276800,"available":747986411520,"internally_reserved":0,"allocated":2045235200,"data_stored":2044589768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1587581670},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,5,3,12,18,18,12],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8667,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2048794624,"data_stored":2048794624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1905426432,"data_stored":1905426432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1449902080,"data_stored":1449902080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1614069760,"data_stored":1614069760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:31:18.635 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:31:18.635 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 76 2026-02-24T08:31:18.706 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 71 128 292763 292635 32.1957 21.1484 0.0589449 0.0310441 2026-02-24T08:31:18.827 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:19.103 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:18 trial105 ceph-mon[39442]: 7.7 scrub ok 2026-02-24T08:31:19.104 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/777467515' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:19.344 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:19.286+0000 7f77af3df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:19.344 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:19.286+0000 7f77af3df640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:19.448 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:31:19.706 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 72 128 295322 295194 32.0262 19.9922 0.0446046 0.0312055 2026-02-24T08:31:19.729 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:31:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:31:19] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-24T08:31:19.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:31:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:31:19.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:31:20.110 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:19 trial105 ceph-mon[39442]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:31:20.111 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:19 trial105 ceph-mon[39442]: pgmap v400: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.61k op/s 2026-02-24T08:31:20.111 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:19 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2938671742' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "76"} : dispatch 2026-02-24T08:31:20.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:31:20.606 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:20.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 73 128 297961 297833 31.8699 20.6172 0.0426014 0.0313542 2026-02-24T08:31:20.749 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:20.892 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:20.889+0000 7f9e2a9ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:20.892 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:20.889+0000 7f9e2a9ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:20.915 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:20.915 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:20.937 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:20.937 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:20.953 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:20.953 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:20.967 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:20.967 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:21.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 74 128 301218 301090 31.7831 25.4453 0.0234662 0.0314517 2026-02-24T08:31:22.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:21 trial105 ceph-mon[39442]: pgmap v401: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.61k op/s 2026-02-24T08:31:22.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2306009619' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:22.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:21 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:31:22.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:21 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:31:22.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 75 128 304422 304294 31.693 25.0312 0.00782784 0.031541 2026-02-24T08:31:23.021 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:23.176 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:22 trial105 ceph-mon[39442]: 7.a scrub starts 2026-02-24T08:31:23.306 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:23.303+0000 7f1de3304640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:23.307 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:23.304+0000 7f1de3304640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:23.333 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:23.333 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:23.346 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:23.346 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:23.362 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:23.362 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:23.377 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:23.377 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:23.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 76 128 307283 307155 31.5701 22.3516 0.0620532 0.0316495 2026-02-24T08:31:24.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:23 trial105 ceph-mon[39442]: pgmap v402: 17 pgs: 17 active+clean; 2.3 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.81k op/s 2026-02-24T08:31:24.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1764652684' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:24.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 77 128 310437 310309 31.4801 24.6406 0.0112285 0.0317553 2026-02-24T08:31:25.136 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:31:25.136 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:31:25.136 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:31:25.137 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:31:25.165 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:24 trial105 ceph-mon[39442]: 7.a scrub ok 2026-02-24T08:31:25.288 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:25.422 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:25.424 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:25.418+0000 7f5c8cbc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:25.424 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:25.419+0000 7f5c8cbc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:25.453 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:31:25.454 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:31:25.494 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:31:25.495 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:31:25.495 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:31:25.575 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:25.680 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:25.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 78 128 313452 313324 31.3784 23.5547 0.285421 0.0318486 2026-02-24T08:31:25.715 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:25.712+0000 7f26e83b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:25.720 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:25.715+0000 7f26e83b1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:25.745 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:25.745 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:25.760 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:25.762 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:25.775 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:25.775 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:25.790 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:25.791 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:25.802 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:25.798+0000 7fed9999a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:25.803 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:25.799+0000 7fed9999a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:25.827 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:31:25.827 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:31:25.828 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:31:25.865 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:31:25.865 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:31:25.866 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:31:26.055 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:26.085 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:25 trial105 ceph-mon[39442]: pgmap v403: 17 pgs: 17 active+clean; 2.3 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 19 MiB/s wr, 2.49k op/s 2026-02-24T08:31:26.085 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:25 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:31:26.086 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:25 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:31:26.086 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1795147133' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:26.179 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:26.175+0000 7f6fbbfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:26.179 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:26.176+0000 7f6fbbfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:31:26.201 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:31:26.241 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:31:26.241 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:31:26.242 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:31:26.388 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:26.524 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:26.520+0000 7f6d3d55c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:26.527 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:26.523+0000 7f6d3d55c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:26.556 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:31:26.556 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:31:26.556 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:31:26.556 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:31:26.556 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:31:26.556 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:31:26.556 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:31:26.556 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:31:26.557 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:31:26.557 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:31:26.557 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:31:26.557 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:31:26.594 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:31:26.594 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:31:26.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 79 128 316355 316227 31.2683 22.6797 0.0403279 0.0319702 2026-02-24T08:31:27.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:31:27.706140+0000 min lat: 0.000722661 max lat: 0.307734 avg lat: 0.0320671 2026-02-24T08:31:27.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:31:27.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 80 128 319339 319211 31.1689 23.3125 0.0139542 0.0320671 2026-02-24T08:31:27.837 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:27.991 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:28.136 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:28.132+0000 7ff92b4fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:28.137 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:28.132+0000 7ff92b4fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:28.137 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:27 trial105 ceph-mon[39442]: 7.9 scrub starts 2026-02-24T08:31:28.137 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:27 trial105 ceph-mon[39442]: pgmap v404: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.77k op/s 2026-02-24T08:31:28.153 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:28.153 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:28.167 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:28.168 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:28.185 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:28.185 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:28.199 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:28.199 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:28.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 81 128 322438 322310 31.0829 24.2109 0.0217693 0.0321591 2026-02-24T08:31:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:28 trial105 ceph-mon[39442]: 7.9 scrub ok 2026-02-24T08:31:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2720660162' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:29.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 82 128 325599 325471 31.005 24.6953 0.0308252 0.0322342 2026-02-24T08:31:29.866 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:31:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:31:29] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-24T08:31:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:31:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:31:29.552Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:31:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:29 trial105 ceph-mon[39442]: pgmap v405: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 19 MiB/s wr, 2.48k op/s 2026-02-24T08:31:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:31:30.246 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:30.406 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:30.543 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:30.538+0000 7f6ecdcfa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:30.543 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:30.539+0000 7f6ecdcfa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:30.562 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:30.562 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:30.579 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:30.579 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:30.602 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:30.602 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:30.617 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:30.617 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:30.707 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 83 128 328608 328480 30.9147 23.5078 0.0107933 0.0323354 2026-02-24T08:31:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:30 trial105 ceph-mon[39442]: 7.0 scrub starts 2026-02-24T08:31:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:30 trial105 ceph-mon[39442]: 7.5 scrub starts 2026-02-24T08:31:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2653446447' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:31.595 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:31:31.595 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:31:31.596 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:31:31.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 84 128 331796 331668 30.8431 24.9062 0.10788 0.0324086 2026-02-24T08:31:31.753 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:31.870 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:31 trial105 ceph-mon[39442]: pgmap v406: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 19 MiB/s wr, 2.48k op/s 2026-02-24T08:31:31.870 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:31 trial105 ceph-mon[39442]: 7.5 scrub ok 2026-02-24T08:31:31.871 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:31 trial105 ceph-mon[39442]: 7.0 scrub ok 2026-02-24T08:31:31.871 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:31 trial105 ceph-mon[39442]: 7.b scrub starts 2026-02-24T08:31:32.098 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:32.059+0000 7fc06fecc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:32.098 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:32.059+0000 7fc06fecc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:32.220 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:31:32.220 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:31:32.270 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2026-02-24T08:31:30.780119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2583577120,"num_objects":39418,"num_object_clones":0,"num_object_copies":118254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39418,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":315441,"num_write_kb":2524598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160805,"ondisk_log_size":160805,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13439916,"kb_used_data":7536348,"kb_used_omap":111,"kb_used_meta":5903376,"kb_avail":2922572884,"statfs":{"total":3006477107200,"available":2992714633216,"internally_reserved":0,"allocated":7717220352,"data_stored":7714642176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113904,"internal_metadata":6045057808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,11,17,15,50,24,38],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":243916800,"num_objects":3721,"num_object_clones":0,"num_object_copies":11163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29775,"num_write_kb":238200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001645"},"pg_stats":[{"pgid":"7.f","version":"98'19336","reported_seq":19395,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.336014+0000","last_change":"2026-02-24T08:31:12.018343+0000","last_active":"2026-02-24T08:31:26.336014+0000","last_peered":"2026-02-24T08:31:26.336014+0000","last_clean":"2026-02-24T08:31:26.336014+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:31:26.336014+0000","last_undegraded":"2026-02-24T08:31:26.336014+0000","last_fullsized":"2026-02-24T08:31:26.336014+0000","mapping_epoch":88,"log_start":"98'9300","ondisk_log_start":"98'9300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16736","last_scrub_stamp":"2026-02-24T08:31:12.018218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.018218+0000","objects_scrubbed":2085,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:26.792730+0000","scrub_duration":690,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158400512,"num_objects":2417,"num_object_clones":0,"num_object_copies":7251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19336,"num_write_kb":154688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'20034","reported_seq":20094,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.584127+0000","last_change":"2026-02-24T08:31:12.376434+0000","last_active":"2026-02-24T08:31:26.584127+0000","last_peered":"2026-02-24T08:31:26.584127+0000","last_clean":"2026-02-24T08:31:26.584127+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:31:26.584127+0000","last_undegraded":"2026-02-24T08:31:26.584127+0000","last_fullsized":"2026-02-24T08:31:26.584127+0000","mapping_epoch":88,"log_start":"98'10000","ondisk_log_start":"98'10000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17112","last_scrub_stamp":"2026-02-24T08:31:12.376327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.376327+0000","objects_scrubbed":2122,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.530316+0000","scrub_duration":1930,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164118528,"num_objects":2505,"num_object_clones":0,"num_object_copies":7515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20034,"num_write_kb":160272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'19976","reported_seq":20033,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.148309+0000","last_change":"2026-02-24T08:31:08.542725+0000","last_active":"2026-02-24T08:31:26.148309+0000","last_peered":"2026-02-24T08:31:26.148309+0000","last_clean":"2026-02-24T08:31:26.148309+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:31:26.148309+0000","last_undegraded":"2026-02-24T08:31:26.148309+0000","last_fullsized":"2026-02-24T08:31:26.148309+0000","mapping_epoch":88,"log_start":"98'9900","ondisk_log_start":"98'9900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16584","last_scrub_stamp":"2026-02-24T08:31:08.542685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:08.542685+0000","objects_scrubbed":2064,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.166619+0000","scrub_duration":597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163643392,"num_objects":2497,"num_object_clones":0,"num_object_copies":7491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19976,"num_write_kb":159808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'19656","reported_seq":19686,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.153035+0000","last_change":"2026-02-24T08:30:05.099836+0000","last_active":"2026-02-24T08:31:26.153035+0000","last_peered":"2026-02-24T08:31:26.153035+0000","last_clean":"2026-02-24T08:31:26.153035+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:31:26.153035+0000","last_undegraded":"2026-02-24T08:31:26.153035+0000","last_fullsized":"2026-02-24T08:31:26.153035+0000","mapping_epoch":88,"log_start":"98'9600","ondisk_log_start":"98'9600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.009121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161021952,"num_objects":2457,"num_object_clones":0,"num_object_copies":7371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19656,"num_write_kb":157248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'19952","reported_seq":19979,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.606167+0000","last_change":"2026-02-24T08:30:05.104821+0000","last_active":"2026-02-24T08:31:26.606167+0000","last_peered":"2026-02-24T08:31:26.606167+0000","last_clean":"2026-02-24T08:31:26.606167+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:31:26.606167+0000","last_undegraded":"2026-02-24T08:31:26.606167+0000","last_fullsized":"2026-02-24T08:31:26.606167+0000","mapping_epoch":88,"log_start":"98'9900","ondisk_log_start":"98'9900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:31.268781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163446784,"num_objects":2494,"num_object_clones":0,"num_object_copies":7482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2494,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19952,"num_write_kb":159616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'19824","reported_seq":19887,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.584409+0000","last_change":"2026-02-24T08:31:23.845032+0000","last_active":"2026-02-24T08:31:26.584409+0000","last_peered":"2026-02-24T08:31:26.584409+0000","last_clean":"2026-02-24T08:31:26.584409+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:31:26.584409+0000","last_undegraded":"2026-02-24T08:31:26.584409+0000","last_fullsized":"2026-02-24T08:31:26.584409+0000","mapping_epoch":88,"log_start":"98'9800","ondisk_log_start":"98'9800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19376","last_scrub_stamp":"2026-02-24T08:31:23.844956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:23.844956+0000","objects_scrubbed":2409,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.616520+0000","scrub_duration":1344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162398208,"num_objects":2478,"num_object_clones":0,"num_object_copies":7434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2478,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19824,"num_write_kb":158592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'19330","reported_seq":19360,"reported_epoch":98,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:31:26.367341+0000","last_change":"2026-02-24T08:31:26.326834+0000","last_active":"2026-02-24T08:31:26.367341+0000","last_peered":"2026-02-24T08:31:26.367341+0000","last_clean":"2026-02-24T08:31:26.367341+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:31:26.367341+0000","last_undegraded":"2026-02-24T08:31:26.367341+0000","last_fullsized":"2026-02-24T08:31:26.367341+0000","mapping_epoch":88,"log_start":"98'9300","ondisk_log_start":"98'9300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic deep scrub scheduled @ 2026-02-28T13:18:04.076740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158351360,"num_objects":2417,"num_object_clones":0,"num_object_copies":7251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2417,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19330,"num_write_kb":154640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'19656","reported_seq":19716,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.606859+0000","last_change":"2026-02-24T08:31:10.550564+0000","last_active":"2026-02-24T08:31:26.606859+0000","last_peered":"2026-02-24T08:31:26.606859+0000","last_clean":"2026-02-24T08:31:26.606859+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:31:26.606859+0000","last_undegraded":"2026-02-24T08:31:26.606859+0000","last_fullsized":"2026-02-24T08:31:26.606859+0000","mapping_epoch":88,"log_start":"98'9600","ondisk_log_start":"98'9600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16688","last_scrub_stamp":"2026-02-24T08:31:10.550527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:10.550527+0000","objects_scrubbed":2070,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:24.679802+0000","scrub_duration":1098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161021952,"num_objects":2457,"num_object_clones":0,"num_object_copies":7371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19656,"num_write_kb":157248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'19720","reported_seq":19782,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.082307+0000","last_change":"2026-02-24T08:31:17.857673+0000","last_active":"2026-02-24T08:31:26.082307+0000","last_peered":"2026-02-24T08:31:26.082307+0000","last_clean":"2026-02-24T08:31:26.082307+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:31:26.082307+0000","last_undegraded":"2026-02-24T08:31:26.082307+0000","last_fullsized":"2026-02-24T08:31:26.082307+0000","mapping_epoch":88,"log_start":"98'9700","ondisk_log_start":"98'9700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'18216","last_scrub_stamp":"2026-02-24T08:31:17.857641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:17.857641+0000","objects_scrubbed":2271,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:41.911289+0000","scrub_duration":712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161546240,"num_objects":2465,"num_object_clones":0,"num_object_copies":7395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19720,"num_write_kb":157760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'19832","reported_seq":19835,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.177709+0000","last_change":"2026-02-24T08:30:05.105167+0000","last_active":"2026-02-24T08:31:26.177709+0000","last_peered":"2026-02-24T08:31:26.177709+0000","last_clean":"2026-02-24T08:31:26.177709+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:31:26.177709+0000","last_undegraded":"2026-02-24T08:31:26.177709+0000","last_fullsized":"2026-02-24T08:31:26.177709+0000","mapping_epoch":88,"log_start":"98'9800","ondisk_log_start":"98'9800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162463744,"num_objects":2479,"num_object_clones":0,"num_object_copies":7437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2479,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19832,"num_write_kb":158656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'20216","reported_seq":20276,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.343030+0000","last_change":"2026-02-24T08:31:07.849199+0000","last_active":"2026-02-24T08:31:26.343030+0000","last_peered":"2026-02-24T08:31:26.343030+0000","last_clean":"2026-02-24T08:31:26.343030+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:31:26.343030+0000","last_undegraded":"2026-02-24T08:31:26.343030+0000","last_fullsized":"2026-02-24T08:31:26.343030+0000","mapping_epoch":88,"log_start":"98'10200","ondisk_log_start":"98'10200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16720","last_scrub_stamp":"2026-02-24T08:31:07.849158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:07.849158+0000","objects_scrubbed":2083,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.810202+0000","scrub_duration":740,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165609472,"num_objects":2527,"num_object_clones":0,"num_object_copies":7581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20216,"num_write_kb":161728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'19736","reported_seq":19796,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.309019+0000","last_change":"2026-02-24T08:31:14.599343+0000","last_active":"2026-02-24T08:31:26.309019+0000","last_peered":"2026-02-24T08:31:26.309019+0000","last_clean":"2026-02-24T08:31:26.309019+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:31:26.309019+0000","last_undegraded":"2026-02-24T08:31:26.309019+0000","last_fullsized":"2026-02-24T08:31:26.309019+0000","mapping_epoch":88,"log_start":"98'9700","ondisk_log_start":"98'9700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17528","last_scrub_stamp":"2026-02-24T08:31:14.599269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:14.599269+0000","objects_scrubbed":2190,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:19.940351+0000","scrub_duration":261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161677312,"num_objects":2467,"num_object_clones":0,"num_object_copies":7401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2467,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19736,"num_write_kb":157888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'19721","reported_seq":19752,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.388490+0000","last_change":"2026-02-24T08:30:05.104207+0000","last_active":"2026-02-24T08:31:26.388490+0000","last_peered":"2026-02-24T08:31:26.388490+0000","last_clean":"2026-02-24T08:31:26.388490+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:31:26.388490+0000","last_undegraded":"2026-02-24T08:31:26.388490+0000","last_fullsized":"2026-02-24T08:31:26.388490+0000","mapping_epoch":88,"log_start":"98'9700","ondisk_log_start":"98'9700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161554432,"num_objects":2466,"num_object_clones":0,"num_object_copies":7398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2466,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19721,"num_write_kb":157768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'19864","reported_seq":19892,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.151922+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:31:26.151922+0000","last_peered":"2026-02-24T08:31:26.151922+0000","last_clean":"2026-02-24T08:31:26.151922+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:31:26.151922+0000","last_undegraded":"2026-02-24T08:31:26.151922+0000","last_fullsized":"2026-02-24T08:31:26.151922+0000","mapping_epoch":88,"log_start":"98'9800","ondisk_log_start":"98'9800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:34.044430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162725888,"num_objects":2483,"num_object_clones":0,"num_object_copies":7449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2483,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19864,"num_write_kb":158912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'18584","reported_seq":18614,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.136118+0000","last_change":"2026-02-24T08:30:05.099619+0000","last_active":"2026-02-24T08:31:26.136118+0000","last_peered":"2026-02-24T08:31:26.136118+0000","last_clean":"2026-02-24T08:31:26.136118+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:31:26.136118+0000","last_undegraded":"2026-02-24T08:31:26.136118+0000","last_fullsized":"2026-02-24T08:31:26.136118+0000","mapping_epoch":88,"log_start":"96'8500","ondisk_log_start":"96'8500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:29.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152240128,"num_objects":2323,"num_object_clones":0,"num_object_copies":6969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18584,"num_write_kb":148672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'19869","reported_seq":19898,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:26.391609+0000","last_change":"2026-02-24T08:30:05.105896+0000","last_active":"2026-02-24T08:31:26.391609+0000","last_peered":"2026-02-24T08:31:26.391609+0000","last_clean":"2026-02-24T08:31:26.391609+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:31:26.391609+0000","last_undegraded":"2026-02-24T08:31:26.391609+0000","last_fullsized":"2026-02-24T08:31:26.391609+0000","mapping_epoch":88,"log_start":"98'9800","ondisk_log_start":"98'9800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:31:28.632371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162766848,"num_objects":2484,"num_object_clones":0,"num_object_copies":7452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19869,"num_write_kb":158952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":264,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:25.187933+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:31:25.187933+0000","last_peered":"2026-02-24T08:31:25.187933+0000","last_clean":"2026-02-24T08:31:25.187933+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:31:25.187933+0000","last_undegraded":"2026-02-24T08:31:25.187933+0000","last_fullsized":"2026-02-24T08:31:25.187933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":2582986752,"num_objects":39416,"num_object_clones":0,"num_object_copies":118248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39416,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315306,"num_write_kb":2522448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7747739648,"data_stored":7747739648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160706,"ondisk_log_size":160706,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247943,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3203784,"kb_used_data":1722996,"kb_used_omap":26,"kb_used_meta":1480741,"kb_avail":730799416,"statfs":{"total":751619276800,"available":748338601984,"internally_reserved":0,"allocated":1764347904,"data_stored":1763702472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27520,"internal_metadata":1516278912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,5],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3047072,"kb_used_data":1554444,"kb_used_omap":29,"kb_used_meta":1492578,"kb_avail":730956128,"statfs":{"total":751619276800,"available":748499075072,"internally_reserved":0,"allocated":1591750656,"data_stored":1591105224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30530,"internal_metadata":1528400062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,1,14,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3411988,"kb_used_data":2050304,"kb_used_omap":27,"kb_used_meta":1361636,"kb_avail":730591212,"statfs":{"total":751619276800,"available":748125401088,"internally_reserved":0,"allocated":2099511296,"data_stored":2098869416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27924,"internal_metadata":1394316012},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,5,7,15,8,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705805,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3777072,"kb_used_data":2208604,"kb_used_omap":27,"kb_used_meta":1568420,"kb_avail":730226128,"statfs":{"total":751619276800,"available":747751555072,"internally_reserved":0,"allocated":2261610496,"data_stored":2260965064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1606062822},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,6,5,7,21,14,34],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2261237760,"data_stored":2261237760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2100854784,"data_stored":2100854784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1605656576,"data_stored":1605656576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1779990528,"data_stored":1779990528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:31:32.668 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:32.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 85 128 334546 334418 30.733 21.4844 0.0371825 0.0325226 2026-02-24T08:31:32.826 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:32.960 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:32.954+0000 7f09cd3f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:32.960 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:32.955+0000 7f09cd3f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:32.974 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:32.974 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:32.987 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:32.987 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:33.002 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:33.002 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:33.017 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:33.017 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:33 trial105 ceph-mon[39442]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:31:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:33 trial105 ceph-mon[39442]: 7.2 scrub starts 2026-02-24T08:31:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:33 trial105 ceph-mon[39442]: 7.b scrub ok 2026-02-24T08:31:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:33 trial105 ceph-mon[39442]: pgmap v407: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.76k op/s 2026-02-24T08:31:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/55984698' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:33.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 86 128 337627 337499 30.6555 24.0703 0.0334668 0.032606 2026-02-24T08:31:34.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:34 trial105 ceph-mon[39442]: 7.6 scrub starts 2026-02-24T08:31:34.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:34 trial105 ceph-mon[39442]: 7.2 scrub ok 2026-02-24T08:31:34.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 87 128 340829 340701 30.5907 25.0156 0.0501801 0.0326742 2026-02-24T08:31:35.064 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:35.220 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:35.347 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:35.343+0000 7fb668b68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:35.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:35.344+0000 7fb668b68640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:35.348 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:35 trial105 ceph-mon[39442]: pgmap v408: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.56k op/s 2026-02-24T08:31:35.366 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:35.367 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:35.384 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:35.384 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:35.397 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:35.397 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:35.416 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:35.416 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:35.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 88 128 343840 343712 30.5103 23.5234 0.0196518 0.0327636 2026-02-24T08:31:36.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:36 trial105 ceph-mon[39442]: 7.c scrub starts 2026-02-24T08:31:36.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:36 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:31:36.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:36 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:31:36.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:36 trial105 ceph-mon[39442]: 7.6 scrub ok 2026-02-24T08:31:36.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:36 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4277654841' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:36.440 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:36 trial105 ceph-mon[39442]: 7.c scrub ok 2026-02-24T08:31:36.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 89 128 347090 346962 30.4528 25.3906 0.0232631 0.0328252 2026-02-24T08:31:37.272 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:31:37.272 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:31:37.273 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_5 2026-02-24T08:31:37.273 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:31:37.415 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:37.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:37 trial105 ceph-mon[39442]: pgmap v409: 17 pgs: 17 active+clean; 2.6 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.83k op/s 2026-02-24T08:31:37.469 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:37.683 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:37.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 90 94 349965 349871 30.3669 22.7266 0.0232171 0.0329163 2026-02-24T08:31:37.820 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:37.817+0000 7f5720265640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:37.820 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:37.817+0000 7f5720265640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:37.879 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:37.876+0000 7f13b33e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:37.879 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:37.876+0000 7f13b33e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:37.891 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:37.892 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:37.903 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:37.903 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:37.913 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:37.914 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:37.924 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:37.924 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:37.934 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:31:37.935 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:31:37.969 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2026-02-24T08:31:36.780925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2834358816,"num_objects":43246,"num_object_clones":0,"num_object_copies":129738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43246,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":346054,"num_write_kb":2769502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160918,"ondisk_log_size":160918,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":14368428,"kb_used_data":8284380,"kb_used_omap":111,"kb_used_meta":6083856,"kb_avail":2921644372,"statfs":{"total":3006477107200,"available":2991763836928,"internally_reserved":0,"allocated":8483205120,"data_stored":8480626944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":114638,"internal_metadata":6229868594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,5,19,12,11,29,31],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":376979456,"num_objects":5752,"num_object_clones":0,"num_object_copies":17256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5752,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46018,"num_write_kb":368144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001613"},"pg_stats":[{"pgid":"7.f","version":"98'21104","reported_seq":21163,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.440675+0000","last_change":"2026-02-24T08:31:12.018343+0000","last_active":"2026-02-24T08:31:36.440675+0000","last_peered":"2026-02-24T08:31:36.440675+0000","last_clean":"2026-02-24T08:31:36.440675+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:31:36.440675+0000","last_undegraded":"2026-02-24T08:31:36.440675+0000","last_fullsized":"2026-02-24T08:31:36.440675+0000","mapping_epoch":88,"log_start":"98'11100","ondisk_log_start":"98'11100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16736","last_scrub_stamp":"2026-02-24T08:31:12.018218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.018218+0000","objects_scrubbed":2085,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:26.792730+0000","scrub_duration":690,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172883968,"num_objects":2638,"num_object_clones":0,"num_object_copies":7914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21104,"num_write_kb":168832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'21804","reported_seq":21865,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.653089+0000","last_change":"2026-02-24T08:31:12.376434+0000","last_active":"2026-02-24T08:31:36.653089+0000","last_peered":"2026-02-24T08:31:36.653089+0000","last_clean":"2026-02-24T08:31:36.653089+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:31:36.653089+0000","last_undegraded":"2026-02-24T08:31:36.653089+0000","last_fullsized":"2026-02-24T08:31:36.653089+0000","mapping_epoch":88,"log_start":"98'11800","ondisk_log_start":"98'11800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17112","last_scrub_stamp":"2026-02-24T08:31:12.376327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.376327+0000","objects_scrubbed":2122,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.530316+0000","scrub_duration":1930,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178618368,"num_objects":2726,"num_object_clones":0,"num_object_copies":8178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2726,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21804,"num_write_kb":174432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'21912","reported_seq":21971,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.167693+0000","last_change":"2026-02-24T08:31:08.542725+0000","last_active":"2026-02-24T08:31:36.167693+0000","last_peered":"2026-02-24T08:31:36.167693+0000","last_clean":"2026-02-24T08:31:36.167693+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:31:36.167693+0000","last_undegraded":"2026-02-24T08:31:36.167693+0000","last_fullsized":"2026-02-24T08:31:36.167693+0000","mapping_epoch":88,"log_start":"98'11900","ondisk_log_start":"98'11900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16584","last_scrub_stamp":"2026-02-24T08:31:08.542685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:08.542685+0000","objects_scrubbed":2064,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.166619+0000","scrub_duration":597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179503104,"num_objects":2739,"num_object_clones":0,"num_object_copies":8217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2739,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21912,"num_write_kb":175296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'21832","reported_seq":21896,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.168273+0000","last_change":"2026-02-24T08:31:35.426677+0000","last_active":"2026-02-24T08:31:36.168273+0000","last_peered":"2026-02-24T08:31:36.168273+0000","last_clean":"2026-02-24T08:31:36.168273+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:31:36.168273+0000","last_undegraded":"2026-02-24T08:31:36.168273+0000","last_fullsized":"2026-02-24T08:31:36.168273+0000","mapping_epoch":88,"log_start":"98'11800","ondisk_log_start":"98'11800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21648","last_scrub_stamp":"2026-02-24T08:31:35.426557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:35.426557+0000","objects_scrubbed":2698,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:52.772059+0000","scrub_duration":409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178847744,"num_objects":2729,"num_object_clones":0,"num_object_copies":8187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21832,"num_write_kb":174656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'21684","reported_seq":21747,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.655388+0000","last_change":"2026-02-24T08:31:32.599606+0000","last_active":"2026-02-24T08:31:36.655388+0000","last_peered":"2026-02-24T08:31:36.655388+0000","last_clean":"2026-02-24T08:31:36.655388+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:31:36.655388+0000","last_undegraded":"2026-02-24T08:31:36.655388+0000","last_fullsized":"2026-02-24T08:31:36.655388+0000","mapping_epoch":88,"log_start":"98'11600","ondisk_log_start":"98'11600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'20960","last_scrub_stamp":"2026-02-24T08:31:32.599569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:32.599569+0000","objects_scrubbed":2609,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:54.333587+0000","scrub_duration":1121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177635328,"num_objects":2711,"num_object_clones":0,"num_object_copies":8133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2711,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21684,"num_write_kb":173472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'21763","reported_seq":21826,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.643445+0000","last_change":"2026-02-24T08:31:23.845032+0000","last_active":"2026-02-24T08:31:36.643445+0000","last_peered":"2026-02-24T08:31:36.643445+0000","last_clean":"2026-02-24T08:31:36.643445+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:31:36.643445+0000","last_undegraded":"2026-02-24T08:31:36.643445+0000","last_fullsized":"2026-02-24T08:31:36.643445+0000","mapping_epoch":88,"log_start":"98'11700","ondisk_log_start":"98'11700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19376","last_scrub_stamp":"2026-02-24T08:31:23.844956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:23.844956+0000","objects_scrubbed":2409,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.616520+0000","scrub_duration":1344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178282496,"num_objects":2721,"num_object_clones":0,"num_object_copies":8163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2721,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21763,"num_write_kb":174104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'21048","reported_seq":21111,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.353368+0000","last_change":"2026-02-24T08:31:27.745797+0000","last_active":"2026-02-24T08:31:36.353368+0000","last_peered":"2026-02-24T08:31:36.353368+0000","last_clean":"2026-02-24T08:31:36.353368+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:31:36.353368+0000","last_undegraded":"2026-02-24T08:31:36.353368+0000","last_fullsized":"2026-02-24T08:31:36.353368+0000","mapping_epoch":88,"log_start":"98'11000","ondisk_log_start":"98'11000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19632","last_scrub_stamp":"2026-02-24T08:31:27.745632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:27.745632+0000","objects_scrubbed":2441,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:45.342297+0000","scrub_duration":1279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172425216,"num_objects":2631,"num_object_clones":0,"num_object_copies":7893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21048,"num_write_kb":168384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'21632","reported_seq":21692,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.601428+0000","last_change":"2026-02-24T08:31:10.550564+0000","last_active":"2026-02-24T08:31:36.601428+0000","last_peered":"2026-02-24T08:31:36.601428+0000","last_clean":"2026-02-24T08:31:36.601428+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:31:36.601428+0000","last_undegraded":"2026-02-24T08:31:36.601428+0000","last_fullsized":"2026-02-24T08:31:36.601428+0000","mapping_epoch":88,"log_start":"98'11600","ondisk_log_start":"98'11600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16688","last_scrub_stamp":"2026-02-24T08:31:10.550527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:10.550527+0000","objects_scrubbed":2070,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:24.679802+0000","scrub_duration":1098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177209344,"num_objects":2704,"num_object_clones":0,"num_object_copies":8112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21632,"num_write_kb":173056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'21587","reported_seq":21647,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.166474+0000","last_change":"2026-02-24T08:31:17.857673+0000","last_active":"2026-02-24T08:31:36.166474+0000","last_peered":"2026-02-24T08:31:36.166474+0000","last_clean":"2026-02-24T08:31:36.166474+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:31:36.166474+0000","last_undegraded":"2026-02-24T08:31:36.166474+0000","last_fullsized":"2026-02-24T08:31:36.166474+0000","mapping_epoch":88,"log_start":"98'11500","ondisk_log_start":"98'11500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'18216","last_scrub_stamp":"2026-02-24T08:31:17.857641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:17.857641+0000","objects_scrubbed":2271,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:41.911289+0000","scrub_duration":712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176840704,"num_objects":2699,"num_object_clones":0,"num_object_copies":8097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2699,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21587,"num_write_kb":172696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'21680","reported_seq":21745,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.188824+0000","last_change":"2026-02-24T08:31:30.975445+0000","last_active":"2026-02-24T08:31:36.188824+0000","last_peered":"2026-02-24T08:31:36.188824+0000","last_clean":"2026-02-24T08:31:36.188824+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:31:36.188824+0000","last_undegraded":"2026-02-24T08:31:36.188824+0000","last_fullsized":"2026-02-24T08:31:36.188824+0000","mapping_epoch":88,"log_start":"98'11600","ondisk_log_start":"98'11600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'20704","last_scrub_stamp":"2026-02-24T08:31:30.975401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:30.975401+0000","objects_scrubbed":2581,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:53.210779+0000","scrub_duration":788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177602560,"num_objects":2710,"num_object_clones":0,"num_object_copies":8130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21680,"num_write_kb":173440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'22287","reported_seq":22346,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.438211+0000","last_change":"2026-02-24T08:31:07.849199+0000","last_active":"2026-02-24T08:31:36.438211+0000","last_peered":"2026-02-24T08:31:36.438211+0000","last_clean":"2026-02-24T08:31:36.438211+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:31:36.438211+0000","last_undegraded":"2026-02-24T08:31:36.438211+0000","last_fullsized":"2026-02-24T08:31:36.438211+0000","mapping_epoch":88,"log_start":"98'12200","ondisk_log_start":"98'12200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16720","last_scrub_stamp":"2026-02-24T08:31:07.849158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:07.849158+0000","objects_scrubbed":2083,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.810202+0000","scrub_duration":740,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182575104,"num_objects":2786,"num_object_clones":0,"num_object_copies":8358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22287,"num_write_kb":178296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'21660","reported_seq":21720,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.425245+0000","last_change":"2026-02-24T08:31:14.599343+0000","last_active":"2026-02-24T08:31:36.425245+0000","last_peered":"2026-02-24T08:31:36.425245+0000","last_clean":"2026-02-24T08:31:36.425245+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:31:36.425245+0000","last_undegraded":"2026-02-24T08:31:36.425245+0000","last_fullsized":"2026-02-24T08:31:36.425245+0000","mapping_epoch":88,"log_start":"98'11600","ondisk_log_start":"98'11600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17528","last_scrub_stamp":"2026-02-24T08:31:14.599269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:14.599269+0000","objects_scrubbed":2190,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:19.940351+0000","scrub_duration":261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177438720,"num_objects":2708,"num_object_clones":0,"num_object_copies":8124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2708,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21660,"num_write_kb":173280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'21625","reported_seq":21690,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.371715+0000","last_change":"2026-02-24T08:31:33.751973+0000","last_active":"2026-02-24T08:31:36.371715+0000","last_peered":"2026-02-24T08:31:36.371715+0000","last_clean":"2026-02-24T08:31:36.371715+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:31:36.371715+0000","last_undegraded":"2026-02-24T08:31:36.371715+0000","last_fullsized":"2026-02-24T08:31:36.371715+0000","mapping_epoch":88,"log_start":"98'11600","ondisk_log_start":"98'11600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21152","last_scrub_stamp":"2026-02-24T08:31:33.751877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:33.751877+0000","objects_scrubbed":2638,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:52.958858+0000","scrub_duration":1405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177152000,"num_objects":2704,"num_object_clones":0,"num_object_copies":8112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2704,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21625,"num_write_kb":173000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'21853","reported_seq":21879,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.096516+0000","last_change":"2026-02-24T08:30:05.105475+0000","last_active":"2026-02-24T08:31:36.096516+0000","last_peered":"2026-02-24T08:31:36.096516+0000","last_clean":"2026-02-24T08:31:36.096516+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:31:36.096516+0000","last_undegraded":"2026-02-24T08:31:36.096516+0000","last_fullsized":"2026-02-24T08:31:36.096516+0000","mapping_epoch":88,"log_start":"98'11800","ondisk_log_start":"98'11800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179019776,"num_objects":2732,"num_object_clones":0,"num_object_copies":8196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2732,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21853,"num_write_kb":174824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'20480","reported_seq":20538,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.171536+0000","last_change":"2026-02-24T08:31:31.120661+0000","last_active":"2026-02-24T08:31:36.171536+0000","last_peered":"2026-02-24T08:31:36.171536+0000","last_clean":"2026-02-24T08:31:36.171536+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:31:36.171536+0000","last_undegraded":"2026-02-24T08:31:36.171536+0000","last_fullsized":"2026-02-24T08:31:36.171536+0000","mapping_epoch":88,"log_start":"98'10400","ondisk_log_start":"98'10400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19520","last_scrub_stamp":"2026-02-24T08:31:31.120505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:31.120505+0000","objects_scrubbed":2423,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.435352+0000","scrub_duration":1006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":2560,"num_object_clones":0,"num_object_copies":7680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20480,"num_write_kb":163840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'21968","reported_seq":22034,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:36.385083+0000","last_change":"2026-02-24T08:31:35.327061+0000","last_active":"2026-02-24T08:31:36.385083+0000","last_peered":"2026-02-24T08:31:36.385083+0000","last_clean":"2026-02-24T08:31:36.385083+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:31:36.385083+0000","last_undegraded":"2026-02-24T08:31:36.385083+0000","last_fullsized":"2026-02-24T08:31:36.385083+0000","mapping_epoch":88,"log_start":"98'11900","ondisk_log_start":"98'11900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21720","last_scrub_stamp":"2026-02-24T08:31:35.326990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:35.326990+0000","objects_scrubbed":2686,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:54.972705+0000","scrub_duration":2016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179961856,"num_objects":2746,"num_object_clones":0,"num_object_copies":8238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21968,"num_write_kb":175744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":264,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:25.187933+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:31:25.187933+0000","last_peered":"2026-02-24T08:31:25.187933+0000","last_clean":"2026-02-24T08:31:25.187933+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:31:25.187933+0000","last_undegraded":"2026-02-24T08:31:25.187933+0000","last_fullsized":"2026-02-24T08:31:25.187933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":2833768448,"num_objects":43244,"num_object_clones":0,"num_object_copies":129732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345919,"num_write_kb":2767352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8502157312,"data_stored":8502157312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160819,"ondisk_log_size":160819,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247945,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3410584,"kb_used_data":1893700,"kb_used_omap":26,"kb_used_meta":1516837,"kb_avail":730592616,"statfs":{"total":751619276800,"available":748126838784,"internally_reserved":0,"allocated":1939148800,"data_stored":1938503368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27602,"internal_metadata":1553241134},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,11,8,0,8,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444171,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3285392,"kb_used_data":1720572,"kb_used_omap":30,"kb_used_meta":1564769,"kb_avail":730717808,"statfs":{"total":751619276800,"available":748255035392,"internally_reserved":0,"allocated":1761865728,"data_stored":1761220296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":1602324018},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,1,1,7,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574989,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3647588,"kb_used_data":2249808,"kb_used_omap":27,"kb_used_meta":1397732,"kb_avail":730355612,"statfs":{"total":751619276800,"available":747884146688,"internally_reserved":0,"allocated":2303803392,"data_stored":2303161512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27924,"internal_metadata":1431278316},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705807,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":4024864,"kb_used_data":2420300,"kb_used_omap":27,"kb_used_meta":1604516,"kb_avail":729978336,"statfs":{"total":751619276800,"available":747497816064,"internally_reserved":0,"allocated":2478387200,"data_stored":2477741768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1643025126},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,7,3,4,13,24],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2479677440,"data_stored":2479677440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2305622016,"data_stored":2305622016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1762254848,"data_stored":1762254848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1954603008,"data_stored":1954603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:31:37.971 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:31:37.972 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_5 pg_num 86 2026-02-24T08:31:38.123 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:38.229 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:38.227+0000 7f06c3755640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:38.229 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:38.227+0000 7f06c3755640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:38.341 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:31:38.341 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:38 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1837141499' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:38.342 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:38 trial105 ceph-mon[39442]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:31:38.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:31:38.708 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total time run: 90.0503 2026-02-24T08:31:38.709 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total writes made: 349965 2026-02-24T08:31:38.709 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Write size: 8192 2026-02-24T08:31:38.709 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object size: 65536 2026-02-24T08:31:38.709 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Bandwidth (MB/sec): 30.3619 2026-02-24T08:31:38.709 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Bandwidth: 13.504 2026-02-24T08:31:38.709 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max bandwidth (MB/sec): 78.7109 2026-02-24T08:31:38.709 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min bandwidth (MB/sec): 19.8281 2026-02-24T08:31:38.710 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average IOPS: 3886 2026-02-24T08:31:38.710 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev IOPS: 1728.51 2026-02-24T08:31:38.710 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max IOPS: 10075 2026-02-24T08:31:38.710 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min IOPS: 2538 2026-02-24T08:31:38.710 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average Latency(s): 0.0329232 2026-02-24T08:31:38.710 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Latency(s): 0.0266435 2026-02-24T08:31:38.710 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max latency(s): 0.307734 2026-02-24T08:31:38.710 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min latency(s): 0.000722661 2026-02-24T08:31:38.716 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:31:39.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:39 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2579527333' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_5", "var": "pg_num", "val": "86"} : dispatch 2026-02-24T08:31:39.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:39 trial105 ceph-mon[39442]: pgmap v410: 17 pgs: 17 active+clean; 2.6 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.55k op/s 2026-02-24T08:31:39.841 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:31:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:31:39.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:31:39.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:31:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:31:39] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-24T08:31:39.963 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:40.123 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:40.247 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:31:40.247 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:31:40.247 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:31:40.247 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:31:40.247 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:31:40.273 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:40.270+0000 7f422c074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:40.282 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:40.278+0000 7f422c074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:40.307 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:40.307 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:40.323 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:40.323 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:40.344 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:40.344 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:40.361 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:40.361 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:41.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:41 trial105 ceph-mon[39442]: 7.1 scrub starts 2026-02-24T08:31:41.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:41 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/25835579' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:41.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:41 trial105 ceph-mon[39442]: pgmap v411: 17 pgs: 17 active+clean; 2.6 GiB data, 14 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.55k op/s 2026-02-24T08:31:42.630 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:42.786 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:42.919 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:42.914+0000 7f62127ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:42.919 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:42.914+0000 7f62127ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:42.937 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:42.937 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:42.953 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:42.954 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:42.970 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:42.970 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:42.984 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:42.984 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:43.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:43 trial105 ceph-mon[39442]: pgmap v412: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.2 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 23 MiB/s wr, 3.57k op/s 2026-02-24T08:31:43.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/93674386' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:43.375 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:31:43.375 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:31:43.376 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:31:43.376 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:31:43.526 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:43.680 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:43.677+0000 7fc9780ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:43.684 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:43.682+0000 7fc9780ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:43.838 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:31:43.838 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:31:43.924 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2026-02-24T08:31:42.781795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2328207928,"num_objects":35520,"num_object_clones":0,"num_object_copies":106560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35520,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":358330,"num_write_kb":2801871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161094,"ondisk_log_size":161094,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13153664,"kb_used_data":7015280,"kb_used_omap":111,"kb_used_meta":6138000,"kb_avail":2922859136,"statfs":{"total":3006477107200,"available":2993007755264,"internally_reserved":0,"allocated":7183646720,"data_stored":7181056328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":114638,"internal_metadata":6285312050},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[17,7,2,9,15,15,15,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-255369192,"num_objects":-3898,"num_object_clones":0,"num_object_copies":-11694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3898,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":42889,"num_write_kb":277273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001676"},"pg_stats":[{"pgid":"7.f","version":"98'21792","reported_seq":21850,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.451806+0000","last_change":"2026-02-24T08:31:12.018343+0000","last_active":"2026-02-24T08:31:41.451806+0000","last_peered":"2026-02-24T08:31:41.451806+0000","last_clean":"2026-02-24T08:31:41.451806+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:31:41.451806+0000","last_undegraded":"2026-02-24T08:31:41.451806+0000","last_fullsized":"2026-02-24T08:31:41.451806+0000","mapping_epoch":88,"log_start":"98'11700","ondisk_log_start":"98'11700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16736","last_scrub_stamp":"2026-02-24T08:31:12.018218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.018218+0000","objects_scrubbed":2085,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:26.792730+0000","scrub_duration":690,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142540800,"num_objects":2175,"num_object_clones":0,"num_object_copies":6525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2175,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21792,"num_write_kb":170432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'22596","reported_seq":22657,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.700965+0000","last_change":"2026-02-24T08:31:12.376434+0000","last_active":"2026-02-24T08:31:41.700965+0000","last_peered":"2026-02-24T08:31:41.700965+0000","last_clean":"2026-02-24T08:31:41.700965+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:31:41.700965+0000","last_undegraded":"2026-02-24T08:31:41.700965+0000","last_fullsized":"2026-02-24T08:31:41.700965+0000","mapping_epoch":88,"log_start":"98'12500","ondisk_log_start":"98'12500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17112","last_scrub_stamp":"2026-02-24T08:31:12.376327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.376327+0000","objects_scrubbed":2122,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.530316+0000","scrub_duration":1930,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141754368,"num_objects":2163,"num_object_clones":0,"num_object_copies":6489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2163,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22596,"num_write_kb":176064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'22685","reported_seq":22739,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.174011+0000","last_change":"2026-02-24T08:31:08.542725+0000","last_active":"2026-02-24T08:31:41.174011+0000","last_peered":"2026-02-24T08:31:41.174011+0000","last_clean":"2026-02-24T08:31:41.174011+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:31:41.174011+0000","last_undegraded":"2026-02-24T08:31:41.174011+0000","last_fullsized":"2026-02-24T08:31:41.174011+0000","mapping_epoch":88,"log_start":"98'12600","ondisk_log_start":"98'12600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16584","last_scrub_stamp":"2026-02-24T08:31:08.542685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:08.542685+0000","objects_scrubbed":2064,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.166619+0000","scrub_duration":597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150732824,"num_objects":2301,"num_object_clones":0,"num_object_copies":6903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2301,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":22685,"num_write_kb":177665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'22599","reported_seq":22644,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.167663+0000","last_change":"2026-02-24T08:31:35.426677+0000","last_active":"2026-02-24T08:31:41.167663+0000","last_peered":"2026-02-24T08:31:41.167663+0000","last_clean":"2026-02-24T08:31:41.167663+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:31:41.167663+0000","last_undegraded":"2026-02-24T08:31:41.167663+0000","last_fullsized":"2026-02-24T08:31:41.167663+0000","mapping_epoch":88,"log_start":"98'12500","ondisk_log_start":"98'12500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21648","last_scrub_stamp":"2026-02-24T08:31:35.426557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:35.426557+0000","objects_scrubbed":2698,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:52.772059+0000","scrub_duration":409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":2304,"num_object_clones":0,"num_object_copies":6912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2304,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22599,"num_write_kb":177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'22416","reported_seq":22479,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.692787+0000","last_change":"2026-02-24T08:31:32.599606+0000","last_active":"2026-02-24T08:31:41.692787+0000","last_peered":"2026-02-24T08:31:41.692787+0000","last_clean":"2026-02-24T08:31:41.692787+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:31:41.692787+0000","last_undegraded":"2026-02-24T08:31:41.692787+0000","last_fullsized":"2026-02-24T08:31:41.692787+0000","mapping_epoch":88,"log_start":"98'12400","ondisk_log_start":"98'12400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'20960","last_scrub_stamp":"2026-02-24T08:31:32.599569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:32.599569+0000","objects_scrubbed":2609,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:54.333587+0000","scrub_duration":1121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139984896,"num_objects":2136,"num_object_clones":0,"num_object_copies":6408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22416,"num_write_kb":174592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'22499","reported_seq":22560,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.692908+0000","last_change":"2026-02-24T08:31:23.845032+0000","last_active":"2026-02-24T08:31:41.692908+0000","last_peered":"2026-02-24T08:31:41.692908+0000","last_clean":"2026-02-24T08:31:41.692908+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:31:41.692908+0000","last_undegraded":"2026-02-24T08:31:41.692908+0000","last_fullsized":"2026-02-24T08:31:41.692908+0000","mapping_epoch":88,"log_start":"98'12400","ondisk_log_start":"98'12400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19376","last_scrub_stamp":"2026-02-24T08:31:23.844956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:23.844956+0000","objects_scrubbed":2409,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.616520+0000","scrub_duration":1344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142802944,"num_objects":2179,"num_object_clones":0,"num_object_copies":6537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2179,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22499,"num_write_kb":175488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'21810","reported_seq":21871,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.475362+0000","last_change":"2026-02-24T08:31:27.745797+0000","last_active":"2026-02-24T08:31:41.475362+0000","last_peered":"2026-02-24T08:31:41.475362+0000","last_clean":"2026-02-24T08:31:41.475362+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:31:41.475362+0000","last_undegraded":"2026-02-24T08:31:41.475362+0000","last_fullsized":"2026-02-24T08:31:41.475362+0000","mapping_epoch":88,"log_start":"98'11800","ondisk_log_start":"98'11800","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19632","last_scrub_stamp":"2026-02-24T08:31:27.745632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:27.745632+0000","objects_scrubbed":2441,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:45.342297+0000","scrub_duration":1279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140771328,"num_objects":2148,"num_object_clones":0,"num_object_copies":6444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21810,"num_write_kb":170368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'22396","reported_seq":22455,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.675821+0000","last_change":"2026-02-24T08:31:10.550564+0000","last_active":"2026-02-24T08:31:41.675821+0000","last_peered":"2026-02-24T08:31:41.675821+0000","last_clean":"2026-02-24T08:31:41.675821+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:31:41.675821+0000","last_undegraded":"2026-02-24T08:31:41.675821+0000","last_fullsized":"2026-02-24T08:31:41.675821+0000","mapping_epoch":88,"log_start":"98'12300","ondisk_log_start":"98'12300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16688","last_scrub_stamp":"2026-02-24T08:31:10.550527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:10.550527+0000","objects_scrubbed":2070,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:24.679802+0000","scrub_duration":1098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142475264,"num_objects":2174,"num_object_clones":0,"num_object_copies":6522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22396,"num_write_kb":174720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'22358","reported_seq":22420,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.196523+0000","last_change":"2026-02-24T08:31:17.857673+0000","last_active":"2026-02-24T08:31:41.196523+0000","last_peered":"2026-02-24T08:31:41.196523+0000","last_clean":"2026-02-24T08:31:41.196523+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:31:41.196523+0000","last_undegraded":"2026-02-24T08:31:41.196523+0000","last_fullsized":"2026-02-24T08:31:41.196523+0000","mapping_epoch":88,"log_start":"98'12300","ondisk_log_start":"98'12300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'18216","last_scrub_stamp":"2026-02-24T08:31:17.857641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:17.857641+0000","objects_scrubbed":2271,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:41.911289+0000","scrub_duration":712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148504576,"num_objects":2266,"num_object_clones":0,"num_object_copies":6798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22358,"num_write_kb":175104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'22459","reported_seq":22517,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.196853+0000","last_change":"2026-02-24T08:31:30.975445+0000","last_active":"2026-02-24T08:31:41.196853+0000","last_peered":"2026-02-24T08:31:41.196853+0000","last_clean":"2026-02-24T08:31:41.196853+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:31:41.196853+0000","last_undegraded":"2026-02-24T08:31:41.196853+0000","last_fullsized":"2026-02-24T08:31:41.196853+0000","mapping_epoch":88,"log_start":"98'12400","ondisk_log_start":"98'12400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'20704","last_scrub_stamp":"2026-02-24T08:31:30.975401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:30.975401+0000","objects_scrubbed":2581,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:53.210779+0000","scrub_duration":788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145424384,"num_objects":2219,"num_object_clones":0,"num_object_copies":6657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22459,"num_write_kb":175488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'23158","reported_seq":23214,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.464817+0000","last_change":"2026-02-24T08:31:07.849199+0000","last_active":"2026-02-24T08:31:41.464817+0000","last_peered":"2026-02-24T08:31:41.464817+0000","last_clean":"2026-02-24T08:31:41.464817+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:31:41.464817+0000","last_undegraded":"2026-02-24T08:31:41.464817+0000","last_fullsized":"2026-02-24T08:31:41.464817+0000","mapping_epoch":88,"log_start":"98'13100","ondisk_log_start":"98'13100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16720","last_scrub_stamp":"2026-02-24T08:31:07.849158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:07.849158+0000","objects_scrubbed":2083,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.810202+0000","scrub_duration":740,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149159936,"num_objects":2276,"num_object_clones":0,"num_object_copies":6828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2276,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23158,"num_write_kb":180864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'22435","reported_seq":22495,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.457694+0000","last_change":"2026-02-24T08:31:14.599343+0000","last_active":"2026-02-24T08:31:41.457694+0000","last_peered":"2026-02-24T08:31:41.457694+0000","last_clean":"2026-02-24T08:31:41.457694+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:31:41.457694+0000","last_undegraded":"2026-02-24T08:31:41.457694+0000","last_fullsized":"2026-02-24T08:31:41.457694+0000","mapping_epoch":88,"log_start":"98'12400","ondisk_log_start":"98'12400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17528","last_scrub_stamp":"2026-02-24T08:31:14.599269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:14.599269+0000","objects_scrubbed":2190,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:19.940351+0000","scrub_duration":261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149946368,"num_objects":2288,"num_object_clones":0,"num_object_copies":6864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22435,"num_write_kb":175808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'22428","reported_seq":22493,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.471492+0000","last_change":"2026-02-24T08:31:33.751973+0000","last_active":"2026-02-24T08:31:41.471492+0000","last_peered":"2026-02-24T08:31:41.471492+0000","last_clean":"2026-02-24T08:31:41.471492+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:31:41.471492+0000","last_undegraded":"2026-02-24T08:31:41.471492+0000","last_fullsized":"2026-02-24T08:31:41.471492+0000","mapping_epoch":88,"log_start":"98'12400","ondisk_log_start":"98'12400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21152","last_scrub_stamp":"2026-02-24T08:31:33.751877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:33.751877+0000","objects_scrubbed":2638,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:52.958858+0000","scrub_duration":1405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142737408,"num_objects":2178,"num_object_clones":0,"num_object_copies":6534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22428,"num_write_kb":174976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'22668","reported_seq":22707,"reported_epoch":98,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:31:41.168389+0000","last_change":"2026-02-24T08:31:40.023852+0000","last_active":"2026-02-24T08:31:41.168389+0000","last_peered":"2026-02-24T08:31:41.168389+0000","last_clean":"2026-02-24T08:31:41.168389+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:31:41.168389+0000","last_undegraded":"2026-02-24T08:31:41.168389+0000","last_fullsized":"2026-02-24T08:31:41.168389+0000","mapping_epoch":88,"log_start":"98'12600","ondisk_log_start":"98'12600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:30:04.076740+0000","objects_scrubbed":1149,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151560192,"num_objects":2313,"num_object_clones":0,"num_object_copies":6939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22668,"num_write_kb":177640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'21209","reported_seq":21269,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.177883+0000","last_change":"2026-02-24T08:31:31.120661+0000","last_active":"2026-02-24T08:31:41.177883+0000","last_peered":"2026-02-24T08:31:41.177883+0000","last_clean":"2026-02-24T08:31:41.177883+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:31:41.177883+0000","last_undegraded":"2026-02-24T08:31:41.177883+0000","last_fullsized":"2026-02-24T08:31:41.177883+0000","mapping_epoch":88,"log_start":"98'11200","ondisk_log_start":"98'11200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19520","last_scrub_stamp":"2026-02-24T08:31:31.120505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:31.120505+0000","objects_scrubbed":2423,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.435352+0000","scrub_duration":1006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140640256,"num_objects":2146,"num_object_clones":0,"num_object_copies":6438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21209,"num_write_kb":166080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'22687","reported_seq":22753,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:41.466341+0000","last_change":"2026-02-24T08:31:35.327061+0000","last_active":"2026-02-24T08:31:41.466341+0000","last_peered":"2026-02-24T08:31:41.466341+0000","last_clean":"2026-02-24T08:31:41.466341+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:31:41.466341+0000","last_undegraded":"2026-02-24T08:31:41.466341+0000","last_fullsized":"2026-02-24T08:31:41.466341+0000","mapping_epoch":88,"log_start":"98'12600","ondisk_log_start":"98'12600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21720","last_scrub_stamp":"2026-02-24T08:31:35.326990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:35.326990+0000","objects_scrubbed":2686,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:54.972705+0000","scrub_duration":2016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147587072,"num_objects":2252,"num_object_clones":0,"num_object_copies":6756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22687,"num_write_kb":177344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":264,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:25.187933+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:31:25.187933+0000","last_peered":"2026-02-24T08:31:25.187933+0000","last_clean":"2026-02-24T08:31:25.187933+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:31:25.187933+0000","last_undegraded":"2026-02-24T08:31:25.187933+0000","last_fullsized":"2026-02-24T08:31:25.187933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":2327617560,"num_objects":35518,"num_object_clones":0,"num_object_copies":106554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35518,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":358195,"num_write_kb":2799721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6989287424,"data_stored":6989275208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160995,"ondisk_log_size":160995,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247946,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3239400,"kb_used_data":1722516,"kb_used_omap":26,"kb_used_meta":1516837,"kb_avail":730763800,"statfs":{"total":751619276800,"available":748302131200,"internally_reserved":0,"allocated":1763856384,"data_stored":1763210952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27602,"internal_metadata":1553241134},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,3,1,3,4,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444172,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3031468,"kb_used_data":1466584,"kb_used_omap":30,"kb_used_meta":1564769,"kb_avail":730971732,"statfs":{"total":751619276800,"available":748515053568,"internally_reserved":0,"allocated":1501782016,"data_stored":1501132512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":1602324018},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3243584,"kb_used_data":1827628,"kb_used_omap":27,"kb_used_meta":1415780,"kb_avail":730759616,"statfs":{"total":751619276800,"available":748297846784,"internally_reserved":0,"allocated":1871491072,"data_stored":1870845120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27924,"internal_metadata":1449759468},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,1,6,11,13,15,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705808,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3639212,"kb_used_data":1998552,"kb_used_omap":27,"kb_used_meta":1640612,"kb_avail":730363988,"statfs":{"total":751619276800,"available":747892723712,"internally_reserved":0,"allocated":2046517248,"data_stored":2045867744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1679987430},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2025238528,"data_stored":2025234456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1837109248,"data_stored":1837105176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1484697600,"data_stored":1484693528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1642242048,"data_stored":1642242048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:31:43.926 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:31:43.927 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 231 2026-02-24T08:31:44.077 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:44.152 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:44 trial105 ceph-mon[39442]: 7.1 scrub ok 2026-02-24T08:31:44.152 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:44 trial105 ceph-mon[39442]: from='client.15433 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:31:44.152 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:31:44.217 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:44.214+0000 7f150de09640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:44.220 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:44.216+0000 7f150de09640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:44.378 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:31:44.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:31:45.035 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:45.187 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:45.331 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:45.327+0000 7ff81c737640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:45.331 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:45.327+0000 7ff81c737640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:45.334 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3200569013' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "231"} : dispatch 2026-02-24T08:31:45.335 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:45 trial105 ceph-mon[39442]: pgmap v413: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.2 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 13 MiB/s wr, 2.29k op/s 2026-02-24T08:31:45.352 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:45.352 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:45.371 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:45.372 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:45.387 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:45.387 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:45.403 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:45.403 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:46.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1833138144' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:47.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:47 trial105 ceph-mon[39442]: pgmap v414: 17 pgs: 17 active+clean; 1.2 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 13 MiB/s wr, 3.56k op/s 2026-02-24T08:31:47.457 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:47.610 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:47.752 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:47.749+0000 7f123c36a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:47.753 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:47.750+0000 7f123c36a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:47.776 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:47.776 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:47.796 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:47.796 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:47.814 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:47.814 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:47.827 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:47.828 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:48.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:48 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3167308846' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:48.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:48 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:31:48.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:48 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:31:49.429 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:31:49.429 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:31:49.429 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:31:49.430 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:31:49.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:49 trial105 ceph-mon[39442]: pgmap v415: 17 pgs: 17 active+clean; 1.2 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 2.6 MiB/s wr, 2.29k op/s 2026-02-24T08:31:49.587 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:49.706 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:31:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:31:49] "GET /metrics HTTP/1.1" 200 4229 "" "Prometheus/3.6.0" 2026-02-24T08:31:49.721 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:49.716+0000 7f98fe76b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:49.721 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:49.717+0000 7f98fe76b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:49.883 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:49.890 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:31:49.890 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:31:49.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:31:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:31:49.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:31:49.956 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2026-02-24T08:31:48.782691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1334420024,"num_objects":20356,"num_object_clones":0,"num_object_copies":61068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20356,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":373494,"num_write_kb":2801871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160858,"ondisk_log_size":160858,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10351104,"kb_used_data":4140720,"kb_used_omap":111,"kb_used_meta":6210192,"kb_avail":2925661696,"statfs":{"total":3006477107200,"available":2995877576704,"internally_reserved":0,"allocated":4240097280,"data_stored":4237506888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":114638,"internal_metadata":6359236658},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,10,16,14,30,42,35,21,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1499938792,"num_objects":-22890,"num_object_clones":0,"num_object_copies":-68670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22890,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27440,"num_write_kb":32369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001766"},"pg_stats":[{"pgid":"7.f","version":"98'22744","reported_seq":22801,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.480229+0000","last_change":"2026-02-24T08:31:12.018343+0000","last_active":"2026-02-24T08:31:46.480229+0000","last_peered":"2026-02-24T08:31:46.480229+0000","last_clean":"2026-02-24T08:31:46.480229+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:31:46.480229+0000","last_undegraded":"2026-02-24T08:31:46.480229+0000","last_fullsized":"2026-02-24T08:31:46.480229+0000","mapping_epoch":88,"log_start":"98'12700","ondisk_log_start":"98'12700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16736","last_scrub_stamp":"2026-02-24T08:31:12.018218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.018218+0000","objects_scrubbed":2085,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:26.792730+0000","scrub_duration":690,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80150528,"num_objects":1223,"num_object_clones":0,"num_object_copies":3669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1223,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22744,"num_write_kb":170432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'23533","reported_seq":23582,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.747516+0000","last_change":"2026-02-24T08:31:12.376434+0000","last_active":"2026-02-24T08:31:46.747516+0000","last_peered":"2026-02-24T08:31:46.747516+0000","last_clean":"2026-02-24T08:31:46.747516+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:31:46.747516+0000","last_undegraded":"2026-02-24T08:31:46.747516+0000","last_fullsized":"2026-02-24T08:31:46.747516+0000","mapping_epoch":88,"log_start":"98'13500","ondisk_log_start":"98'13500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17112","last_scrub_stamp":"2026-02-24T08:31:12.376327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.376327+0000","objects_scrubbed":2122,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.530316+0000","scrub_duration":1930,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80347136,"num_objects":1226,"num_object_clones":0,"num_object_copies":3678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23533,"num_write_kb":176064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'23666","reported_seq":23725,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.190696+0000","last_change":"2026-02-24T08:31:08.542725+0000","last_active":"2026-02-24T08:31:46.190696+0000","last_peered":"2026-02-24T08:31:46.190696+0000","last_clean":"2026-02-24T08:31:46.190696+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:31:46.190696+0000","last_undegraded":"2026-02-24T08:31:46.190696+0000","last_fullsized":"2026-02-24T08:31:46.190696+0000","mapping_epoch":88,"log_start":"98'13600","ondisk_log_start":"98'13600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16584","last_scrub_stamp":"2026-02-24T08:31:08.542685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:08.542685+0000","objects_scrubbed":2064,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.166619+0000","scrub_duration":597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86442008,"num_objects":1320,"num_object_clones":0,"num_object_copies":3960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1320,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23666,"num_write_kb":177665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'23535","reported_seq":23586,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.182925+0000","last_change":"2026-02-24T08:31:35.426677+0000","last_active":"2026-02-24T08:31:46.182925+0000","last_peered":"2026-02-24T08:31:46.182925+0000","last_clean":"2026-02-24T08:31:46.182925+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:31:46.182925+0000","last_undegraded":"2026-02-24T08:31:46.182925+0000","last_fullsized":"2026-02-24T08:31:46.182925+0000","mapping_epoch":88,"log_start":"98'13500","ondisk_log_start":"98'13500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21648","last_scrub_stamp":"2026-02-24T08:31:35.426557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:35.426557+0000","objects_scrubbed":2698,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:52.772059+0000","scrub_duration":409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89653248,"num_objects":1368,"num_object_clones":0,"num_object_copies":4104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23535,"num_write_kb":177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'23378","reported_seq":23441,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.740377+0000","last_change":"2026-02-24T08:31:32.599606+0000","last_active":"2026-02-24T08:31:46.740377+0000","last_peered":"2026-02-24T08:31:46.740377+0000","last_clean":"2026-02-24T08:31:46.740377+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:31:46.740377+0000","last_undegraded":"2026-02-24T08:31:46.740377+0000","last_fullsized":"2026-02-24T08:31:46.740377+0000","mapping_epoch":88,"log_start":"98'13300","ondisk_log_start":"98'13300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'20960","last_scrub_stamp":"2026-02-24T08:31:32.599569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:32.599569+0000","objects_scrubbed":2609,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:54.333587+0000","scrub_duration":1121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76939264,"num_objects":1174,"num_object_clones":0,"num_object_copies":3522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23378,"num_write_kb":174592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'23432","reported_seq":23494,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.726120+0000","last_change":"2026-02-24T08:31:23.845032+0000","last_active":"2026-02-24T08:31:46.726120+0000","last_peered":"2026-02-24T08:31:46.726120+0000","last_clean":"2026-02-24T08:31:46.726120+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:31:46.726120+0000","last_undegraded":"2026-02-24T08:31:46.726120+0000","last_fullsized":"2026-02-24T08:31:46.726120+0000","mapping_epoch":88,"log_start":"98'13400","ondisk_log_start":"98'13400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19376","last_scrub_stamp":"2026-02-24T08:31:23.844956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:23.844956+0000","objects_scrubbed":2409,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.616520+0000","scrub_duration":1344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81657856,"num_objects":1246,"num_object_clones":0,"num_object_copies":3738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1246,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23432,"num_write_kb":175488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'22737","reported_seq":22799,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.487245+0000","last_change":"2026-02-24T08:31:27.745797+0000","last_active":"2026-02-24T08:31:46.487245+0000","last_peered":"2026-02-24T08:31:46.487245+0000","last_clean":"2026-02-24T08:31:46.487245+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:31:46.487245+0000","last_undegraded":"2026-02-24T08:31:46.487245+0000","last_fullsized":"2026-02-24T08:31:46.487245+0000","mapping_epoch":88,"log_start":"98'12700","ondisk_log_start":"98'12700","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19632","last_scrub_stamp":"2026-02-24T08:31:27.745632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:27.745632+0000","objects_scrubbed":2441,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:45.342297+0000","scrub_duration":1279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80019456,"num_objects":1221,"num_object_clones":0,"num_object_copies":3663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1221,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22737,"num_write_kb":170368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'23341","reported_seq":23398,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.736880+0000","last_change":"2026-02-24T08:31:10.550564+0000","last_active":"2026-02-24T08:31:46.736880+0000","last_peered":"2026-02-24T08:31:46.736880+0000","last_clean":"2026-02-24T08:31:46.736880+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:31:46.736880+0000","last_undegraded":"2026-02-24T08:31:46.736880+0000","last_fullsized":"2026-02-24T08:31:46.736880+0000","mapping_epoch":88,"log_start":"98'13300","ondisk_log_start":"98'13300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16688","last_scrub_stamp":"2026-02-24T08:31:10.550527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:10.550527+0000","objects_scrubbed":2070,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:24.679802+0000","scrub_duration":1098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80543744,"num_objects":1229,"num_object_clones":0,"num_object_copies":3687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23341,"num_write_kb":174720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'23316","reported_seq":23373,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.194812+0000","last_change":"2026-02-24T08:31:17.857673+0000","last_active":"2026-02-24T08:31:46.194812+0000","last_peered":"2026-02-24T08:31:46.194812+0000","last_clean":"2026-02-24T08:31:46.194812+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:31:46.194812+0000","last_undegraded":"2026-02-24T08:31:46.194812+0000","last_fullsized":"2026-02-24T08:31:46.194812+0000","mapping_epoch":88,"log_start":"98'13300","ondisk_log_start":"98'13300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'18216","last_scrub_stamp":"2026-02-24T08:31:17.857641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:17.857641+0000","objects_scrubbed":2271,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:41.911289+0000","scrub_duration":712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85721088,"num_objects":1308,"num_object_clones":0,"num_object_copies":3924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1308,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23316,"num_write_kb":175104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'23381","reported_seq":23446,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.197600+0000","last_change":"2026-02-24T08:31:30.975445+0000","last_active":"2026-02-24T08:31:46.197600+0000","last_peered":"2026-02-24T08:31:46.197600+0000","last_clean":"2026-02-24T08:31:46.197600+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:31:46.197600+0000","last_undegraded":"2026-02-24T08:31:46.197600+0000","last_fullsized":"2026-02-24T08:31:46.197600+0000","mapping_epoch":88,"log_start":"98'13300","ondisk_log_start":"98'13300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'20704","last_scrub_stamp":"2026-02-24T08:31:30.975401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:30.975401+0000","objects_scrubbed":2581,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:53.210779+0000","scrub_duration":788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85000192,"num_objects":1297,"num_object_clones":0,"num_object_copies":3891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23381,"num_write_kb":175488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'24137","reported_seq":24186,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.497717+0000","last_change":"2026-02-24T08:31:07.849199+0000","last_active":"2026-02-24T08:31:46.497717+0000","last_peered":"2026-02-24T08:31:46.497717+0000","last_clean":"2026-02-24T08:31:46.497717+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:31:46.497717+0000","last_undegraded":"2026-02-24T08:31:46.497717+0000","last_fullsized":"2026-02-24T08:31:46.497717+0000","mapping_epoch":88,"log_start":"98'14100","ondisk_log_start":"98'14100","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16720","last_scrub_stamp":"2026-02-24T08:31:07.849158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:07.849158+0000","objects_scrubbed":2083,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.810202+0000","scrub_duration":740,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85000192,"num_objects":1297,"num_object_clones":0,"num_object_copies":3891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1297,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24137,"num_write_kb":180864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'23443","reported_seq":23503,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.481950+0000","last_change":"2026-02-24T08:31:14.599343+0000","last_active":"2026-02-24T08:31:46.481950+0000","last_peered":"2026-02-24T08:31:46.481950+0000","last_clean":"2026-02-24T08:31:46.481950+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:31:46.481950+0000","last_undegraded":"2026-02-24T08:31:46.481950+0000","last_fullsized":"2026-02-24T08:31:46.481950+0000","mapping_epoch":88,"log_start":"98'13400","ondisk_log_start":"98'13400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17528","last_scrub_stamp":"2026-02-24T08:31:14.599269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:14.599269+0000","objects_scrubbed":2190,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:19.940351+0000","scrub_duration":261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":1280,"num_object_clones":0,"num_object_copies":3840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1280,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23443,"num_write_kb":175808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'23388","reported_seq":23450,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.494792+0000","last_change":"2026-02-24T08:31:33.751973+0000","last_active":"2026-02-24T08:31:46.494792+0000","last_peered":"2026-02-24T08:31:46.494792+0000","last_clean":"2026-02-24T08:31:46.494792+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:31:46.494792+0000","last_undegraded":"2026-02-24T08:31:46.494792+0000","last_fullsized":"2026-02-24T08:31:46.494792+0000","mapping_epoch":88,"log_start":"98'13300","ondisk_log_start":"98'13300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21152","last_scrub_stamp":"2026-02-24T08:31:33.751877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:33.751877+0000","objects_scrubbed":2638,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:52.958858+0000","scrub_duration":1405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79822848,"num_objects":1218,"num_object_clones":0,"num_object_copies":3654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1218,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23388,"num_write_kb":174976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'23614","reported_seq":23678,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.177844+0000","last_change":"2026-02-24T08:31:43.678268+0000","last_active":"2026-02-24T08:31:46.177844+0000","last_peered":"2026-02-24T08:31:46.177844+0000","last_clean":"2026-02-24T08:31:46.177844+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:31:46.177844+0000","last_undegraded":"2026-02-24T08:31:46.177844+0000","last_fullsized":"2026-02-24T08:31:46.177844+0000","mapping_epoch":88,"log_start":"98'13600","ondisk_log_start":"98'13600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'23156","last_scrub_stamp":"2026-02-24T08:31:43.678116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:43.678116+0000","objects_scrubbed":2175,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:02.057493+0000","scrub_duration":3655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89563136,"num_objects":1367,"num_object_clones":0,"num_object_copies":4101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23614,"num_write_kb":177640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'22099","reported_seq":22161,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.177327+0000","last_change":"2026-02-24T08:31:31.120661+0000","last_active":"2026-02-24T08:31:46.177327+0000","last_peered":"2026-02-24T08:31:46.177327+0000","last_clean":"2026-02-24T08:31:46.177327+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:31:46.177327+0000","last_undegraded":"2026-02-24T08:31:46.177327+0000","last_fullsized":"2026-02-24T08:31:46.177327+0000","mapping_epoch":88,"log_start":"98'12000","ondisk_log_start":"98'12000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19520","last_scrub_stamp":"2026-02-24T08:31:31.120505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:31.120505+0000","objects_scrubbed":2423,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.435352+0000","scrub_duration":1006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82313216,"num_objects":1256,"num_object_clones":0,"num_object_copies":3768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1256,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22099,"num_write_kb":166080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'23615","reported_seq":23681,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:46.467413+0000","last_change":"2026-02-24T08:31:35.327061+0000","last_active":"2026-02-24T08:31:46.467413+0000","last_peered":"2026-02-24T08:31:46.467413+0000","last_clean":"2026-02-24T08:31:46.467413+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:31:46.467413+0000","last_undegraded":"2026-02-24T08:31:46.467413+0000","last_fullsized":"2026-02-24T08:31:46.467413+0000","mapping_epoch":88,"log_start":"98'13600","ondisk_log_start":"98'13600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21720","last_scrub_stamp":"2026-02-24T08:31:35.326990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:35.326990+0000","objects_scrubbed":2686,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:54.972705+0000","scrub_duration":2016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86769664,"num_objects":1324,"num_object_clones":0,"num_object_copies":3972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1324,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23615,"num_write_kb":177344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":264,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:25.187933+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:31:25.187933+0000","last_peered":"2026-02-24T08:31:25.187933+0000","last_clean":"2026-02-24T08:31:25.187933+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:31:25.187933+0000","last_undegraded":"2026-02-24T08:31:25.187933+0000","last_fullsized":"2026-02-24T08:31:25.187933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":1333829656,"num_objects":20354,"num_object_clones":0,"num_object_copies":61062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20354,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":373359,"num_write_kb":2799721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4013690880,"data_stored":4013678664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160759,"ondisk_log_size":160759,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247947,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2619496,"kb_used_data":1066516,"kb_used_omap":26,"kb_used_meta":1552933,"kb_avail":731383704,"statfs":{"total":751619276800,"available":748936912896,"internally_reserved":0,"allocated":1092112384,"data_stored":1091466952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27602,"internal_metadata":1590203438},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,3,4,0,4,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444173,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2473772,"kb_used_data":872856,"kb_used_omap":30,"kb_used_meta":1600865,"kb_avail":731529428,"statfs":{"total":751619276800,"available":749086134272,"internally_reserved":0,"allocated":893804544,"data_stored":893155040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":1639286322},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2473216,"kb_used_data":1057388,"kb_used_omap":27,"kb_used_meta":1415780,"kb_avail":731529984,"statfs":{"total":751619276800,"available":749086703616,"internally_reserved":0,"allocated":1082765312,"data_stored":1082119360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27924,"internal_metadata":1449759468},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,3,6,21,13,10,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705809,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2784620,"kb_used_data":1143960,"kb_used_omap":27,"kb_used_meta":1640612,"kb_avail":731218580,"statfs":{"total":751619276800,"available":748767825920,"internally_reserved":0,"allocated":1171415040,"data_stored":1170765536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27930,"internal_metadata":1679987430},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,5,10,4,9,25,24,12,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1154723840,"data_stored":1154719768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1031933952,"data_stored":1031929880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":865251328,"data_stored":865247256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":961781760,"data_stored":961781760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:31:49.958 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:31:49.959 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 241 2026-02-24T08:31:50.042 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:50.146 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:50.199 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:50.195+0000 7f4a954d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:50.205 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:50.202+0000 7f4a954d6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:50.223 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:50.223 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:50.244 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:50.244 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:50.265 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:50.265 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:50.280 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:50.280 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:50.281 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:50 trial105 ceph-mon[39442]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:31:50.306 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:50.303+0000 7f0ecbe1b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:50.308 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:50.304+0000 7f0ecbe1b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:50.475 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:31:50.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:31:51.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2055634796' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:51.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1403389568' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "241"} : dispatch 2026-02-24T08:31:51.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:51 trial105 ceph-mon[39442]: pgmap v416: 17 pgs: 17 active+clean; 1.2 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 2.6 MiB/s wr, 2.29k op/s 2026-02-24T08:31:52.351 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:52.508 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:52.654 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:52.648+0000 7fac9df19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:52.654 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:52.649+0000 7fac9df19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:52.674 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:52.674 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:52.691 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:52.692 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:52.713 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:52.713 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:52.726 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:52.726 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:53.282 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Removed 43746 objects 2026-02-24T08:31:53.282 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Clean up completed and total clean up time :14.5661 2026-02-24T08:31:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:53 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/73656610' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:53 trial105 ceph-mon[39442]: pgmap v417: 17 pgs: 17 active+clean; 333 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 2.6 MiB/s wr, 3.54k op/s 2026-02-24T08:31:54.782 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:54.899 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:54.997 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:54.994+0000 7fe264546640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:54.997 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:54.994+0000 7fe264546640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:55.009 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:55.009 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:55.019 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:55.019 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:55.030 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:55.031 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:55.042 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:55.043 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:55.520 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:31:55.521 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:31:55.521 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:31:55.521 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:31:55.637 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:55.734 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:55.731+0000 7f795b8ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:55.734 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:55.731+0000 7f795b8ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:55.842 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:31:55.843 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:31:55.877 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":418,"stamp":"2026-02-24T08:31:54.783495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":348824120,"num_objects":5317,"num_object_clones":0,"num_object_copies":15951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5317,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":388533,"num_write_kb":2801871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160897,"ondisk_log_size":160897,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7647616,"kb_used_data":1400752,"kb_used_omap":112,"kb_used_meta":6246543,"kb_avail":2928365184,"statfs":{"total":3006477107200,"available":2998645948416,"internally_reserved":0,"allocated":1434370048,"data_stored":1431779656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115290,"internal_metadata":6396460454},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[15,8,15,30,25,21,43,29,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1979383808,"num_objects":-30203,"num_object_clones":0,"num_object_copies":-90609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001699"},"pg_stats":[{"pgid":"7.f","version":"98'23673","reported_seq":23731,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.541381+0000","last_change":"2026-02-24T08:31:12.018343+0000","last_active":"2026-02-24T08:31:51.541381+0000","last_peered":"2026-02-24T08:31:51.541381+0000","last_clean":"2026-02-24T08:31:51.541381+0000","last_became_active":"2026-02-24T08:30:05.105848+0000","last_became_peered":"2026-02-24T08:30:05.105848+0000","last_unstale":"2026-02-24T08:31:51.541381+0000","last_undegraded":"2026-02-24T08:31:51.541381+0000","last_fullsized":"2026-02-24T08:31:51.541381+0000","mapping_epoch":88,"log_start":"98'13600","ondisk_log_start":"98'13600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16736","last_scrub_stamp":"2026-02-24T08:31:12.018218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.018218+0000","objects_scrubbed":2085,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:26.792730+0000","scrub_duration":690,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267584,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":294,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23673,"num_write_kb":170432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"98'24508","reported_seq":24562,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.773713+0000","last_change":"2026-02-24T08:31:12.376434+0000","last_active":"2026-02-24T08:31:51.773713+0000","last_peered":"2026-02-24T08:31:51.773713+0000","last_clean":"2026-02-24T08:31:51.773713+0000","last_became_active":"2026-02-24T08:30:05.104665+0000","last_became_peered":"2026-02-24T08:30:05.104665+0000","last_unstale":"2026-02-24T08:31:51.773713+0000","last_undegraded":"2026-02-24T08:31:51.773713+0000","last_fullsized":"2026-02-24T08:31:51.773713+0000","mapping_epoch":88,"log_start":"98'14500","ondisk_log_start":"98'14500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17112","last_scrub_stamp":"2026-02-24T08:31:12.376327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:12.376327+0000","objects_scrubbed":2122,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.530316+0000","scrub_duration":1930,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24508,"num_write_kb":176064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"98'24605","reported_seq":24661,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.193559+0000","last_change":"2026-02-24T08:31:08.542725+0000","last_active":"2026-02-24T08:31:51.193559+0000","last_peered":"2026-02-24T08:31:51.193559+0000","last_clean":"2026-02-24T08:31:51.193559+0000","last_became_active":"2026-02-24T08:30:05.105278+0000","last_became_peered":"2026-02-24T08:30:05.105278+0000","last_unstale":"2026-02-24T08:31:51.193559+0000","last_undegraded":"2026-02-24T08:31:51.193559+0000","last_fullsized":"2026-02-24T08:31:51.193559+0000","mapping_epoch":88,"log_start":"98'14600","ondisk_log_start":"98'14600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16584","last_scrub_stamp":"2026-02-24T08:31:08.542685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:08.542685+0000","objects_scrubbed":2064,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.166619+0000","scrub_duration":597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903704,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":381,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24605,"num_write_kb":177665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"98'24483","reported_seq":24534,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.201081+0000","last_change":"2026-02-24T08:31:35.426677+0000","last_active":"2026-02-24T08:31:51.201081+0000","last_peered":"2026-02-24T08:31:51.201081+0000","last_clean":"2026-02-24T08:31:51.201081+0000","last_became_active":"2026-02-24T08:30:05.099668+0000","last_became_peered":"2026-02-24T08:30:05.099668+0000","last_unstale":"2026-02-24T08:31:51.201081+0000","last_undegraded":"2026-02-24T08:31:51.201081+0000","last_fullsized":"2026-02-24T08:31:51.201081+0000","mapping_epoch":88,"log_start":"98'14400","ondisk_log_start":"98'14400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21648","last_scrub_stamp":"2026-02-24T08:31:35.426557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:35.426557+0000","objects_scrubbed":2698,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:52.772059+0000","scrub_duration":409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27525120,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24483,"num_write_kb":177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"98'24312","reported_seq":24378,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.760565+0000","last_change":"2026-02-24T08:31:32.599606+0000","last_active":"2026-02-24T08:31:51.760565+0000","last_peered":"2026-02-24T08:31:51.760565+0000","last_clean":"2026-02-24T08:31:51.760565+0000","last_became_active":"2026-02-24T08:30:05.104258+0000","last_became_peered":"2026-02-24T08:30:05.104258+0000","last_unstale":"2026-02-24T08:31:51.760565+0000","last_undegraded":"2026-02-24T08:31:51.760565+0000","last_fullsized":"2026-02-24T08:31:51.760565+0000","mapping_epoch":88,"log_start":"98'14300","ondisk_log_start":"98'14300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'20960","last_scrub_stamp":"2026-02-24T08:31:32.599569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:32.599569+0000","objects_scrubbed":2609,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:54.333587+0000","scrub_duration":1121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24312,"num_write_kb":174592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"98'24410","reported_seq":24472,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.771977+0000","last_change":"2026-02-24T08:31:23.845032+0000","last_active":"2026-02-24T08:31:51.771977+0000","last_peered":"2026-02-24T08:31:51.771977+0000","last_clean":"2026-02-24T08:31:51.771977+0000","last_became_active":"2026-02-24T08:30:05.104078+0000","last_became_peered":"2026-02-24T08:30:05.104078+0000","last_unstale":"2026-02-24T08:31:51.771977+0000","last_undegraded":"2026-02-24T08:31:51.771977+0000","last_fullsized":"2026-02-24T08:31:51.771977+0000","mapping_epoch":88,"log_start":"98'14400","ondisk_log_start":"98'14400","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19376","last_scrub_stamp":"2026-02-24T08:31:23.844956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:23.844956+0000","objects_scrubbed":2409,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.616520+0000","scrub_duration":1344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24410,"num_write_kb":175488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"98'23642","reported_seq":23705,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.516750+0000","last_change":"2026-02-24T08:31:27.745797+0000","last_active":"2026-02-24T08:31:51.516750+0000","last_peered":"2026-02-24T08:31:51.516750+0000","last_clean":"2026-02-24T08:31:51.516750+0000","last_became_active":"2026-02-24T08:30:05.105359+0000","last_became_peered":"2026-02-24T08:30:05.105359+0000","last_unstale":"2026-02-24T08:31:51.516750+0000","last_undegraded":"2026-02-24T08:31:51.516750+0000","last_fullsized":"2026-02-24T08:31:51.516750+0000","mapping_epoch":88,"log_start":"98'13600","ondisk_log_start":"98'13600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19632","last_scrub_stamp":"2026-02-24T08:31:27.745632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:27.745632+0000","objects_scrubbed":2441,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:45.342297+0000","scrub_duration":1279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23642,"num_write_kb":170368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"98'24282","reported_seq":24342,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.760773+0000","last_change":"2026-02-24T08:31:10.550564+0000","last_active":"2026-02-24T08:31:51.760773+0000","last_peered":"2026-02-24T08:31:51.760773+0000","last_clean":"2026-02-24T08:31:51.760773+0000","last_became_active":"2026-02-24T08:30:05.104272+0000","last_became_peered":"2026-02-24T08:30:05.104272+0000","last_unstale":"2026-02-24T08:31:51.760773+0000","last_undegraded":"2026-02-24T08:31:51.760773+0000","last_fullsized":"2026-02-24T08:31:51.760773+0000","mapping_epoch":88,"log_start":"98'14200","ondisk_log_start":"98'14200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16688","last_scrub_stamp":"2026-02-24T08:31:10.550527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:10.550527+0000","objects_scrubbed":2070,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:24.679802+0000","scrub_duration":1098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24282,"num_write_kb":174720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"98'24266","reported_seq":24327,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.203448+0000","last_change":"2026-02-24T08:31:17.857673+0000","last_active":"2026-02-24T08:31:51.203448+0000","last_peered":"2026-02-24T08:31:51.203448+0000","last_clean":"2026-02-24T08:31:51.203448+0000","last_became_active":"2026-02-24T08:30:05.105082+0000","last_became_peered":"2026-02-24T08:30:05.105082+0000","last_unstale":"2026-02-24T08:31:51.203448+0000","last_undegraded":"2026-02-24T08:31:51.203448+0000","last_fullsized":"2026-02-24T08:31:51.203448+0000","mapping_epoch":88,"log_start":"98'14200","ondisk_log_start":"98'14200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'18216","last_scrub_stamp":"2026-02-24T08:31:17.857641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:17.857641+0000","objects_scrubbed":2271,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:41.911289+0000","scrub_duration":712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24266,"num_write_kb":175104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"98'24318","reported_seq":24377,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.197306+0000","last_change":"2026-02-24T08:31:30.975445+0000","last_active":"2026-02-24T08:31:51.197306+0000","last_peered":"2026-02-24T08:31:51.197306+0000","last_clean":"2026-02-24T08:31:51.197306+0000","last_became_active":"2026-02-24T08:30:05.104906+0000","last_became_peered":"2026-02-24T08:30:05.104906+0000","last_unstale":"2026-02-24T08:31:51.197306+0000","last_undegraded":"2026-02-24T08:31:51.197306+0000","last_fullsized":"2026-02-24T08:31:51.197306+0000","mapping_epoch":88,"log_start":"98'14300","ondisk_log_start":"98'14300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'20704","last_scrub_stamp":"2026-02-24T08:31:30.975401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:30.975401+0000","objects_scrubbed":2581,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:53.210779+0000","scrub_duration":788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24318,"num_write_kb":175488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"98'25089","reported_seq":25147,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.543043+0000","last_change":"2026-02-24T08:31:07.849199+0000","last_active":"2026-02-24T08:31:51.543043+0000","last_peered":"2026-02-24T08:31:51.543043+0000","last_clean":"2026-02-24T08:31:51.543043+0000","last_became_active":"2026-02-24T08:30:05.105759+0000","last_became_peered":"2026-02-24T08:30:05.105759+0000","last_unstale":"2026-02-24T08:31:51.543043+0000","last_undegraded":"2026-02-24T08:31:51.543043+0000","last_fullsized":"2026-02-24T08:31:51.543043+0000","mapping_epoch":88,"log_start":"98'15000","ondisk_log_start":"98'15000","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'16720","last_scrub_stamp":"2026-02-24T08:31:07.849158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:07.849158+0000","objects_scrubbed":2083,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:32.810202+0000","scrub_duration":740,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22609920,"num_objects":345,"num_object_clones":0,"num_object_copies":1035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25089,"num_write_kb":180864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"98'24376","reported_seq":24435,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.525740+0000","last_change":"2026-02-24T08:31:14.599343+0000","last_active":"2026-02-24T08:31:51.525740+0000","last_peered":"2026-02-24T08:31:51.525740+0000","last_clean":"2026-02-24T08:31:51.525740+0000","last_became_active":"2026-02-24T08:30:05.104026+0000","last_became_peered":"2026-02-24T08:30:05.104026+0000","last_unstale":"2026-02-24T08:31:51.525740+0000","last_undegraded":"2026-02-24T08:31:51.525740+0000","last_fullsized":"2026-02-24T08:31:51.525740+0000","mapping_epoch":88,"log_start":"98'14300","ondisk_log_start":"98'14300","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'17528","last_scrub_stamp":"2026-02-24T08:31:14.599269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:14.599269+0000","objects_scrubbed":2190,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:19.940351+0000","scrub_duration":261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":347,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24376,"num_write_kb":175808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"98'24279","reported_seq":24343,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.512021+0000","last_change":"2026-02-24T08:31:33.751973+0000","last_active":"2026-02-24T08:31:51.512021+0000","last_peered":"2026-02-24T08:31:51.512021+0000","last_clean":"2026-02-24T08:31:51.512021+0000","last_became_active":"2026-02-24T08:30:05.103888+0000","last_became_peered":"2026-02-24T08:30:05.103888+0000","last_unstale":"2026-02-24T08:31:51.512021+0000","last_undegraded":"2026-02-24T08:31:51.512021+0000","last_fullsized":"2026-02-24T08:31:51.512021+0000","mapping_epoch":88,"log_start":"98'14200","ondisk_log_start":"98'14200","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21152","last_scrub_stamp":"2026-02-24T08:31:33.751877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:33.751877+0000","objects_scrubbed":2638,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:52.958858+0000","scrub_duration":1405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24279,"num_write_kb":174976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"98'24562","reported_seq":24621,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.194867+0000","last_change":"2026-02-24T08:31:43.678268+0000","last_active":"2026-02-24T08:31:51.194867+0000","last_peered":"2026-02-24T08:31:51.194867+0000","last_clean":"2026-02-24T08:31:51.194867+0000","last_became_active":"2026-02-24T08:30:05.105196+0000","last_became_peered":"2026-02-24T08:30:05.105196+0000","last_unstale":"2026-02-24T08:31:51.194867+0000","last_undegraded":"2026-02-24T08:31:51.194867+0000","last_fullsized":"2026-02-24T08:31:51.194867+0000","mapping_epoch":88,"log_start":"98'14500","ondisk_log_start":"98'14500","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'23156","last_scrub_stamp":"2026-02-24T08:31:43.678116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:43.678116+0000","objects_scrubbed":2175,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:02.057493+0000","scrub_duration":3655,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27435008,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24562,"num_write_kb":177640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"98'22986","reported_seq":23046,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.198950+0000","last_change":"2026-02-24T08:31:31.120661+0000","last_active":"2026-02-24T08:31:51.198950+0000","last_peered":"2026-02-24T08:31:51.198950+0000","last_clean":"2026-02-24T08:31:51.198950+0000","last_became_active":"2026-02-24T08:30:05.099480+0000","last_became_peered":"2026-02-24T08:30:05.099480+0000","last_unstale":"2026-02-24T08:31:51.198950+0000","last_undegraded":"2026-02-24T08:31:51.198950+0000","last_fullsized":"2026-02-24T08:31:51.198950+0000","mapping_epoch":88,"log_start":"98'12900","ondisk_log_start":"98'12900","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'19520","last_scrub_stamp":"2026-02-24T08:31:31.120505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:31.120505+0000","objects_scrubbed":2423,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:33.435352+0000","scrub_duration":1006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182784,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":369,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22986,"num_write_kb":166080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"98'24607","reported_seq":24672,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:51.551183+0000","last_change":"2026-02-24T08:31:35.327061+0000","last_active":"2026-02-24T08:31:51.551183+0000","last_peered":"2026-02-24T08:31:51.551183+0000","last_clean":"2026-02-24T08:31:51.551183+0000","last_became_active":"2026-02-24T08:30:05.105476+0000","last_became_peered":"2026-02-24T08:30:05.105476+0000","last_unstale":"2026-02-24T08:31:51.551183+0000","last_undegraded":"2026-02-24T08:31:51.551183+0000","last_fullsized":"2026-02-24T08:31:51.551183+0000","mapping_epoch":88,"log_start":"98'14600","ondisk_log_start":"98'14600","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'21720","last_scrub_stamp":"2026-02-24T08:31:35.326990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:30:04.076740+0000","last_clean_scrub_stamp":"2026-02-24T08:31:35.326990+0000","objects_scrubbed":2686,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:54.972705+0000","scrub_duration":2016,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24607,"num_write_kb":177344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":264,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:25.187933+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:31:25.187933+0000","last_peered":"2026-02-24T08:31:25.187933+0000","last_clean":"2026-02-24T08:31:25.187933+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:31:25.187933+0000","last_undegraded":"2026-02-24T08:31:25.187933+0000","last_fullsized":"2026-02-24T08:31:25.187933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":348233752,"num_objects":5315,"num_object_clones":0,"num_object_copies":15945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5315,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":388398,"num_write_kb":2799721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1050808320,"data_stored":1050796104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160798,"ondisk_log_size":160798,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247948,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1941672,"kb_used_data":388692,"kb_used_omap":26,"kb_used_meta":1552933,"kb_avail":732061528,"statfs":{"total":751619276800,"available":749631004672,"internally_reserved":0,"allocated":398020608,"data_stored":397375176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27602,"internal_metadata":1590203438},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,1,2,0,1,9,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444174,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1870060,"kb_used_data":269144,"kb_used_omap":30,"kb_used_meta":1600865,"kb_avail":732133140,"statfs":{"total":751619276800,"available":749704335360,"internally_reserved":0,"allocated":275603456,"data_stored":274953952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":1639286322},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1715840,"kb_used_data":281580,"kb_used_omap":27,"kb_used_meta":1434084,"kb_avail":732287360,"statfs":{"total":751619276800,"available":749862256640,"internally_reserved":0,"allocated":288337920,"data_stored":287691968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27924,"internal_metadata":1468502764},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,2,7,12,16,12,19,14],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705810,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2120044,"kb_used_data":461336,"kb_used_omap":27,"kb_used_meta":1658660,"kb_avail":731883156,"statfs":{"total":751619276800,"available":749448351744,"internally_reserved":0,"allocated":472408064,"data_stored":471758560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28582,"internal_metadata":1698467930},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,7,16,9,8,15,11,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":289583104,"data_stored":289579032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":229576704,"data_stored":229572632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":251965440,"data_stored":251961368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":279683072,"data_stored":279683072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:31:55.879 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:31:55.879 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 251 2026-02-24T08:31:55.995 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:56.094 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:56.092+0000 7f0d7a9f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:56.094 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:55 trial105 ceph-mon[39442]: pgmap v418: 17 pgs: 17 active+clean; 333 MiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.52k op/s 2026-02-24T08:31:56.094 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3594493743' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:56.094 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:56.092+0000 7f0d7a9f0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:56.203 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:31:56.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:31:57.079 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:31:57.102 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:56 trial105 ceph-mon[39442]: from='client.15451 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:31:57.102 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4120775066' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "251"} : dispatch 2026-02-24T08:31:57.195 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:57.294 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:57.291+0000 7fae9226d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:57.294 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:57.291+0000 7fae9226d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:57.306 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:57.306 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:57.316 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:57.316 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:57.328 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:57.328 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:57.338 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:57.339 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:57.470 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_5 2026-02-24T08:31:57.470 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2026-02-24T08:31:57.587 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:57.688 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:57.685+0000 7fe94bca1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:57.688 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:57.685+0000 7fe94bca1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:57.840 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_5' removed 2026-02-24T08:31:57.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:57 trial105 ceph-mon[39442]: pgmap v419: 17 pgs: 17 active+clean; 66 MiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.87k op/s 2026-02-24T08:31:57.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3046125835' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:31:57.863 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4047572940' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:31:57.889 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T08:31:57.889 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T08:31:57.889 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_6 2026-02-24T08:31:57.889 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool create unique_pool_6 16 2026-02-24T08:31:58.003 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:58.107 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:58.105+0000 7fc846847640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:58.108 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:58.105+0000 7fc846847640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:58.847 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_6' created 2026-02-24T08:31:58.887 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2026-02-24T08:31:59.001 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:59.102 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:59.100+0000 7f430f06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:59.102 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4047572940' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_5", "pool2": "unique_pool_5", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:31:59.102 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:58 trial105 ceph-mon[39442]: osdmap e99: 4 total, 4 up, 4 in 2026-02-24T08:31:59.102 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1787871757' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16} : dispatch 2026-02-24T08:31:59.102 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:59.100+0000 7f430f06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:59.373 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:31:59.488 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:31:59.585 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:59.583+0000 7fafe96d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:59.586 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:31:59.583+0000 7fafe96d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:31:59.597 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:31:59.598 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:31:59.608 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:31:59.608 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:31:59.620 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:31:59.620 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:31:59.630 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:31:59.631 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:31:59.651 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:31:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:31:59] "GET /metrics HTTP/1.1" 200 4154 "" "Prometheus/3.6.0" 2026-02-24T08:31:59.848 INFO:teuthology.orchestra.run.trial105.stderr:enabled application 'rados' on pool 'unique_pool_6' 2026-02-24T08:31:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:31:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:31:59.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:31:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:59 trial105 ceph-mon[39442]: pgmap v421: 1 pgs: 1 active+clean; 577 KiB data, 6.0 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:31:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1787871757' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_6", "pg_num": 16}]': finished 2026-02-24T08:31:59.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:59 trial105 ceph-mon[39442]: osdmap e100: 4 total, 4 up, 4 in 2026-02-24T08:31:59.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:31:59.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2421995788' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:31:59.940 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:31:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1893461074' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:00.892 DEBUG:teuthology.orchestra.run.trial105:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_6 bench 90 write' 2026-02-24T08:32:00.895 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T08:32:00.895 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T08:32:00.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout:hints = 1 2026-02-24T08:32:00.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T08:32:00.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object prefix: benchmark_data_trial105_138543 2026-02-24T08:32:00.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:32:00.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 0 0 0 0 0 0 - 0 2026-02-24T08:32:01.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2421995788' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_6", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:32:01.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:00 trial105 ceph-mon[39442]: osdmap e101: 4 total, 4 up, 4 in 2026-02-24T08:32:01.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:00 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:32:01.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:00 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:32:01.235 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:01.235 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:01.235 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:32:01.235 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:32:01.384 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:01.512 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:01.510+0000 7f4691ea6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:01.513 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:01.510+0000 7f4691ea6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:01.665 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:01.681 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:32:01.681 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:32:01.735 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":425,"stamp":"2026-02-24T08:32:00.850885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6288572,"kb_used_data":5740,"kb_used_omap":112,"kb_used_meta":6282639,"kb_avail":2929724228,"statfs":{"total":3006477107200,"available":3000037609472,"internally_reserved":0,"allocated":5877760,"data_stored":3299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115290,"internal_metadata":6433422758},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-68616192,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-3141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-392666,"num_write_kb":-2799721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.067061"},"pg_stats":[{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:31:58.841840+0000","last_change":"2026-02-24T08:31:58.841840+0000","last_active":"2026-02-24T08:31:58.841840+0000","last_peered":"2026-02-24T08:31:58.841840+0000","last_clean":"2026-02-24T08:31:58.841840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:31:58.841840+0000","last_undegraded":"2026-02-24T08:31:58.841840+0000","last_fullsized":"2026-02-24T08:31:58.841840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":264,"reported_epoch":98,"state":"active+clean","last_fresh":"2026-02-24T08:31:25.187933+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:31:25.187933+0000","last_peered":"2026-02-24T08:31:25.187933+0000","last_clean":"2026-02-24T08:31:25.187933+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:31:25.187933+0000","last_undegraded":"2026-02-24T08:31:25.187933+0000","last_fullsized":"2026-02-24T08:31:25.187933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247949,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1554560,"kb_used_data":1580,"kb_used_omap":26,"kb_used_meta":1552933,"kb_avail":732448640,"statfs":{"total":751619276800,"available":750027407360,"internally_reserved":0,"allocated":1617920,"data_stored":972488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27602,"internal_metadata":1590203438},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444175,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1602496,"kb_used_data":1580,"kb_used_omap":30,"kb_used_meta":1600865,"kb_avail":732400704,"statfs":{"total":751619276800,"available":749978320896,"internally_reserved":0,"allocated":1617920,"data_stored":972488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":1639286322},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1435132,"kb_used_data":1000,"kb_used_omap":27,"kb_used_meta":1434084,"kb_avail":732568068,"statfs":{"total":751619276800,"available":750149701632,"internally_reserved":0,"allocated":1024000,"data_stored":382120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27924,"internal_metadata":1468502764},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705811,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1696384,"kb_used_data":1580,"kb_used_omap":27,"kb_used_meta":1694756,"kb_avail":732306816,"statfs":{"total":751619276800,"available":749882179584,"internally_reserved":0,"allocated":1617920,"data_stored":972488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28582,"internal_metadata":1735430234},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8381,"internal_metadata":0}]}} 2026-02-24T08:32:01.737 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:32:01.737 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 261 2026-02-24T08:32:01.825 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:01.928 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:01.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 1 128 9906 9778 76.3843 76.3906 0.00694331 0.0129547 2026-02-24T08:32:01.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:01.981+0000 7f4ead8d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:01.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:01.981+0000 7f4ead8d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:02.008 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:02.008 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:02.031 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:02.032 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:02.052 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:02.052 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:02.066 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:02.066 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:02.066 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:01 trial105 ceph-mon[39442]: pgmap v424: 17 pgs: 16 unknown, 1 active+clean; 577 KiB data, 6.0 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:32:02.066 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:01 trial105 ceph-mon[39442]: osdmap e102: 4 total, 4 up, 4 in 2026-02-24T08:32:02.067 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:02.064+0000 7fd305299640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:02.067 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:02.065+0000 7fd305299640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:02.230 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:32:02.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:32:02.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 2 128 19655 19527 76.2711 76.1641 0.00467364 0.0130562 2026-02-24T08:32:03.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:02 trial105 ceph-mon[39442]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:32:03.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/845396787' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:03.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1449195067' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "261"} : dispatch 2026-02-24T08:32:03.942 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 3 128 29689 29561 76.9757 78.3906 0.00749674 0.0129499 2026-02-24T08:32:04.112 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:04.140 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:03 trial105 ceph-mon[39442]: pgmap v426: 17 pgs: 17 active+clean; 42 MiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail; 8.4 MiB/s wr, 1.08k op/s 2026-02-24T08:32:04.277 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:04.405 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:04.402+0000 7f990d518640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:04.405 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:04.402+0000 7f990d518640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:04.424 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:04.425 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:04.440 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:04.440 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:04.454 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:04.455 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:04.471 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:04.472 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:04.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 4 128 39151 39023 76.2109 73.9219 0.00546884 0.0130898 2026-02-24T08:32:05.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:04 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3156385254' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:05.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 5 128 48499 48371 75.5738 73.0312 0.00315178 0.0131872 2026-02-24T08:32:06.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:05 trial105 ceph-mon[39442]: pgmap v427: 17 pgs: 17 active+clean; 42 MiB data, 6.1 GiB used, 2.7 TiB / 2.7 TiB avail; 7.0 MiB/s wr, 890 op/s 2026-02-24T08:32:06.522 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:06.690 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:06.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 6 128 56868 56740 73.8745 65.3828 0.0112934 0.0135069 2026-02-24T08:32:07.124 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:07.124 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:07.124 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:07.124 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:07.125 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:07.052+0000 7f5af215d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:07.125 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:07.053+0000 7f5af215d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:07.125 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:07.125 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:07.125 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:07.125 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:07.278 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:07.278 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:07.278 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_6 2026-02-24T08:32:07.278 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:32:07.474 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:07.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 7 128 62530 62402 69.6398 44.2344 0.00869435 0.0143056 2026-02-24T08:32:07.997 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:07.945+0000 7f1f74566640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:07.997 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:07.945+0000 7f1f74566640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:08.113 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:32:08.114 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:32:08.114 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:07 trial105 ceph-mon[39442]: pgmap v428: 17 pgs: 17 active+clean; 300 MiB data, 7.1 GiB used, 2.7 TiB / 2.7 TiB avail; 38 MiB/s wr, 4.82k op/s 2026-02-24T08:32:08.114 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3994120171' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:08.763 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":428,"stamp":"2026-02-24T08:32:06.785386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":314352160,"num_objects":4790,"num_object_clones":0,"num_object_copies":14370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4790,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":38436,"num_write_kb":308558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38400,"ondisk_log_size":38400,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7441340,"kb_used_data":923884,"kb_used_omap":123,"kb_used_meta":6517252,"kb_avail":2928571460,"statfs":{"total":3006477107200,"available":2998857175040,"internally_reserved":0,"allocated":946057216,"data_stored":943357200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126334,"internal_metadata":6673666690},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":313761792,"num_objects":4788,"num_object_clones":0,"num_object_copies":14364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38301,"num_write_kb":306408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.939584"},"pg_stats":[{"pgid":"8.f","version":"102'3472","reported_seq":3486,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.556542+0000","last_change":"2026-02-24T08:31:59.852372+0000","last_active":"2026-02-24T08:32:06.556542+0000","last_peered":"2026-02-24T08:32:06.556542+0000","last_clean":"2026-02-24T08:32:06.556542+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:32:06.556542+0000","last_undegraded":"2026-02-24T08:32:06.556542+0000","last_fullsized":"2026-02-24T08:32:06.556542+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:11.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28442624,"num_objects":434,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":434,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3472,"num_write_kb":27776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"102'3360","reported_seq":3374,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.547782+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:32:06.547782+0000","last_peered":"2026-02-24T08:32:06.547782+0000","last_clean":"2026-02-24T08:32:06.547782+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:32:06.547782+0000","last_undegraded":"2026-02-24T08:32:06.547782+0000","last_fullsized":"2026-02-24T08:32:06.547782+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27525120,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3360,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"102'2944","reported_seq":2958,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.175529+0000","last_change":"2026-02-24T08:31:59.856660+0000","last_active":"2026-02-24T08:32:06.175529+0000","last_peered":"2026-02-24T08:32:06.175529+0000","last_clean":"2026-02-24T08:32:06.175529+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:32:06.175529+0000","last_undegraded":"2026-02-24T08:32:06.175529+0000","last_fullsized":"2026-02-24T08:32:06.175529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":2944,"log_dups_size":0,"ondisk_log_size":2944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:00.936091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":368,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2944,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"102'3360","reported_seq":3374,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.548318+0000","last_change":"2026-02-24T08:31:59.854071+0000","last_active":"2026-02-24T08:32:06.548318+0000","last_peered":"2026-02-24T08:32:06.548318+0000","last_clean":"2026-02-24T08:32:06.548318+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:32:06.548318+0000","last_undegraded":"2026-02-24T08:32:06.548318+0000","last_fullsized":"2026-02-24T08:32:06.548318+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:18.460030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27525120,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3360,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"102'3552","reported_seq":3566,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.523379+0000","last_change":"2026-02-24T08:31:59.855384+0000","last_active":"2026-02-24T08:32:06.523379+0000","last_peered":"2026-02-24T08:32:06.523379+0000","last_clean":"2026-02-24T08:32:06.523379+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:32:06.523379+0000","last_undegraded":"2026-02-24T08:32:06.523379+0000","last_fullsized":"2026-02-24T08:32:06.523379+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:07.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29097984,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3552,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'464","reported_seq":462,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:01.758254+0000","last_change":"2026-02-24T08:31:59.852330+0000","last_active":"2026-02-24T08:32:01.758254+0000","last_peered":"2026-02-24T08:32:01.758254+0000","last_clean":"2026-02-24T08:32:01.758254+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:32:01.758254+0000","last_undegraded":"2026-02-24T08:32:01.758254+0000","last_fullsized":"2026-02-24T08:32:01.758254+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:12.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"102'3136","reported_seq":3150,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.195158+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:32:06.195158+0000","last_peered":"2026-02-24T08:32:06.195158+0000","last_clean":"2026-02-24T08:32:06.195158+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:32:06.195158+0000","last_undegraded":"2026-02-24T08:32:06.195158+0000","last_fullsized":"2026-02-24T08:32:06.195158+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3136,"log_dups_size":0,"ondisk_log_size":3136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25690112,"num_objects":392,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":392,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3136,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'480","reported_seq":478,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:01.758084+0000","last_change":"2026-02-24T08:31:59.852686+0000","last_active":"2026-02-24T08:32:01.758084+0000","last_peered":"2026-02-24T08:32:01.758084+0000","last_clean":"2026-02-24T08:32:01.758084+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:32:01.758084+0000","last_undegraded":"2026-02-24T08:32:01.758084+0000","last_fullsized":"2026-02-24T08:32:01.758084+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:16.520309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"102'3240","reported_seq":3252,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.559318+0000","last_change":"2026-02-24T08:31:59.854212+0000","last_active":"2026-02-24T08:32:06.559318+0000","last_peered":"2026-02-24T08:32:06.559318+0000","last_clean":"2026-02-24T08:32:06.559318+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:32:06.559318+0000","last_undegraded":"2026-02-24T08:32:06.559318+0000","last_fullsized":"2026-02-24T08:32:06.559318+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3240,"log_dups_size":0,"ondisk_log_size":3240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:24.238297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":405,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3240,"num_write_kb":25920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"102'3360","reported_seq":3371,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.210100+0000","last_change":"2026-02-24T08:31:59.855283+0000","last_active":"2026-02-24T08:32:06.210100+0000","last_peered":"2026-02-24T08:32:06.210100+0000","last_clean":"2026-02-24T08:32:06.210100+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:32:06.210100+0000","last_undegraded":"2026-02-24T08:32:06.210100+0000","last_fullsized":"2026-02-24T08:32:06.210100+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.783477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27525120,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3360,"num_write_kb":26880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"102'3144","reported_seq":3154,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.211711+0000","last_change":"2026-02-24T08:31:59.856513+0000","last_active":"2026-02-24T08:32:06.211711+0000","last_peered":"2026-02-24T08:32:06.211711+0000","last_clean":"2026-02-24T08:32:06.211711+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:32:06.211711+0000","last_undegraded":"2026-02-24T08:32:06.211711+0000","last_fullsized":"2026-02-24T08:32:06.211711+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3144,"log_dups_size":0,"ondisk_log_size":3144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:09.276792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3144,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'528","reported_seq":542,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:01.765296+0000","last_change":"2026-02-24T08:31:59.854560+0000","last_active":"2026-02-24T08:32:01.765296+0000","last_peered":"2026-02-24T08:32:01.765296+0000","last_clean":"2026-02-24T08:32:01.765296+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:32:01.765296+0000","last_undegraded":"2026-02-24T08:32:01.765296+0000","last_fullsized":"2026-02-24T08:32:01.765296+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:19.422928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"102'3157","reported_seq":3168,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.209578+0000","last_change":"2026-02-24T08:31:59.855084+0000","last_active":"2026-02-24T08:32:06.209578+0000","last_peered":"2026-02-24T08:32:06.209578+0000","last_clean":"2026-02-24T08:32:06.209578+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:32:06.209578+0000","last_undegraded":"2026-02-24T08:32:06.209578+0000","last_fullsized":"2026-02-24T08:32:06.209578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3157,"log_dups_size":0,"ondisk_log_size":3157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:20.596585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25862144,"num_objects":395,"num_object_clones":0,"num_object_copies":1185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3157,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'496","reported_seq":486,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:01.762345+0000","last_change":"2026-02-24T08:31:59.854573+0000","last_active":"2026-02-24T08:32:01.762345+0000","last_peered":"2026-02-24T08:32:01.762345+0000","last_clean":"2026-02-24T08:32:01.762345+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:32:01.762345+0000","last_undegraded":"2026-02-24T08:32:01.762345+0000","last_fullsized":"2026-02-24T08:32:01.762345+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.228790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'496","reported_seq":510,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:01.786223+0000","last_change":"2026-02-24T08:31:59.854291+0000","last_active":"2026-02-24T08:32:01.786223+0000","last_peered":"2026-02-24T08:32:01.786223+0000","last_clean":"2026-02-24T08:32:01.786223+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:32:01.786223+0000","last_undegraded":"2026-02-24T08:32:01.786223+0000","last_fullsized":"2026-02-24T08:32:01.786223+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:17.273593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"102'3112","reported_seq":3122,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:06.208425+0000","last_change":"2026-02-24T08:31:59.855720+0000","last_active":"2026-02-24T08:32:06.208425+0000","last_peered":"2026-02-24T08:32:06.208425+0000","last_clean":"2026-02-24T08:32:06.208425+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:32:06.208425+0000","last_undegraded":"2026-02-24T08:32:06.208425+0000","last_fullsized":"2026-02-24T08:32:06.208425+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":3112,"log_dups_size":0,"ondisk_log_size":3112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:58.889239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3112,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":272,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:00.944644+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:32:00.944644+0000","last_peered":"2026-02-24T08:32:00.944644+0000","last_clean":"2026-02-24T08:32:00.944644+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:32:00.944644+0000","last_undegraded":"2026-02-24T08:32:00.944644+0000","last_fullsized":"2026-02-24T08:32:00.944644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":313761792,"num_objects":4788,"num_object_clones":0,"num_object_copies":14364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38301,"num_write_kb":306408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1028759552,"data_stored":1028759552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38301,"ondisk_log_size":38301,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8550,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247951,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1966160,"kb_used_data":304892,"kb_used_omap":30,"kb_used_meta":1661217,"kb_avail":732037040,"statfs":{"total":751619276800,"available":749605928960,"internally_reserved":0,"allocated":312209408,"data_stored":311533516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30822,"internal_metadata":1701087130},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444177,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1955736,"kb_used_data":300676,"kb_used_omap":32,"kb_used_meta":1655007,"kb_avail":732047464,"statfs":{"total":751619276800,"available":749616603136,"internally_reserved":0,"allocated":307892224,"data_stored":307216332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33790,"internal_metadata":1694727170},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1470620,"kb_used_data":18440,"kb_used_omap":29,"kb_used_meta":1452130,"kb_avail":732532580,"statfs":{"total":751619276800,"available":750113361920,"internally_reserved":0,"allocated":18882560,"data_stored":18210220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30532,"internal_metadata":1486981308},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2048824,"kb_used_data":299876,"kb_used_omap":30,"kb_used_meta":1748897,"kb_avail":731954376,"statfs":{"total":751619276800,"available":749521281024,"internally_reserved":0,"allocated":307073024,"data_stored":306397132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31190,"internal_metadata":1790871082},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8550,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":362004480,"data_stored":362004480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45817856,"data_stored":45817856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":309985280,"data_stored":309985280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":310951936,"data_stored":310951936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:32:08.764 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:32:08.764 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_6 pg_num 26 2026-02-24T08:32:08.914 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:08.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 8 127 68415 68288 66.682 45.9844 0.0172908 0.0149686 2026-02-24T08:32:09.358 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:09.312+0000 7f7bfffff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:09.358 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:09.313+0000 7f7bfffff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:09.491 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:32:09.590 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:09.615 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:32:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:32:09] "GET /metrics HTTP/1.1" 200 4154 "" "Prometheus/3.6.0" 2026-02-24T08:32:09.739 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:09.842 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:32:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:32:09.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:32:09.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:09 trial105 ceph-mon[39442]: from='client.15478 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:32:09.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:09 trial105 ceph-mon[39442]: pgmap v429: 17 pgs: 17 active+clean; 417 MiB data, 7.4 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s wr, 5.97k op/s 2026-02-24T08:32:09.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:09 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2021626222' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T08:32:09.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 9 128 73426 73298 63.6215 39.1406 0.0387762 0.0156524 2026-02-24T08:32:10.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:32:10.456 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:10.457 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:10.457 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:10.406+0000 7f385fd05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:10.457 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:10.407+0000 7f385fd05640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:10.457 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:10.457 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:10.462 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:10.463 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:10.477 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:10.478 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:10.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 10 128 78453 78325 61.1864 39.2734 0.0201926 0.0163206 2026-02-24T08:32:11.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1309049578' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:11.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 11 128 84977 84849 60.2572 50.9688 0.00823168 0.0165699 2026-02-24T08:32:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:11 trial105 ceph-mon[39442]: pgmap v430: 17 pgs: 17 active+clean; 417 MiB data, 7.4 GiB used, 2.7 TiB / 2.7 TiB avail; 42 MiB/s wr, 5.33k op/s 2026-02-24T08:32:12.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 12 128 91248 91120 59.3181 48.9922 0.0176707 0.0168359 2026-02-24T08:32:13.072 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:13.242 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:13.361 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:13 trial105 ceph-mon[39442]: pgmap v431: 17 pgs: 17 active+clean; 642 MiB data, 8.2 GiB used, 2.7 TiB / 2.7 TiB avail; 54 MiB/s wr, 6.88k op/s 2026-02-24T08:32:13.381 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:13.377+0000 7f426ee8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:13.381 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:13.377+0000 7f426ee8a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:13.395 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:13.395 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:13.411 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:13.411 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:13.424 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:13.424 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:13.438 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:13.438 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:13.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 13 128 97187 97059 58.324 46.3984 0.00914797 0.0171226 2026-02-24T08:32:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:14 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2228742302' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:32:14.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 14 128 103016 102888 57.4106 45.5391 0.00668182 0.0173871 2026-02-24T08:32:15.066 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:15.066 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:15.066 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:32:15.066 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:32:15.228 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:15.351 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:15.347+0000 7ff12c93b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:15.351 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:15.348+0000 7ff12c93b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:15.352 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:15 trial105 ceph-mon[39442]: pgmap v432: 17 pgs: 17 active+clean; 642 MiB data, 8.2 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.39k op/s 2026-02-24T08:32:15.485 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:15.518 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:32:15.518 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:32:15.571 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2026-02-24T08:32:14.786578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":672891424,"num_objects":10264,"num_object_clones":0,"num_object_copies":30792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10264,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":82203,"num_write_kb":658694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82167,"ondisk_log_size":82167,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8601300,"kb_used_data":1903364,"kb_used_omap":123,"kb_used_meta":6697732,"kb_avail":2927411500,"statfs":{"total":3006477107200,"available":2997669376000,"internally_reserved":0,"allocated":1949044736,"data_stored":1946344720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126334,"internal_metadata":6858478210},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[28,8,12,32,61,21,60,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":628547584,"num_objects":9592,"num_object_clones":0,"num_object_copies":28776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76727,"num_write_kb":613816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001777"},"pg_stats":[{"pgid":"8.f","version":"102'5184","reported_seq":5198,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.563733+0000","last_change":"2026-02-24T08:31:59.852372+0000","last_active":"2026-02-24T08:32:11.563733+0000","last_peered":"2026-02-24T08:32:11.563733+0000","last_clean":"2026-02-24T08:32:11.563733+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:32:11.563733+0000","last_undegraded":"2026-02-24T08:32:11.563733+0000","last_fullsized":"2026-02-24T08:32:11.563733+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5184,"log_dups_size":0,"ondisk_log_size":5184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:11.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5184,"num_write_kb":41472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"102'5288","reported_seq":5297,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.565816+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:32:11.565816+0000","last_peered":"2026-02-24T08:32:11.565816+0000","last_clean":"2026-02-24T08:32:11.565816+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:32:11.565816+0000","last_undegraded":"2026-02-24T08:32:11.565816+0000","last_fullsized":"2026-02-24T08:32:11.565816+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5288,"log_dups_size":0,"ondisk_log_size":5288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5288,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"102'4520","reported_seq":4534,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.198140+0000","last_change":"2026-02-24T08:31:59.856660+0000","last_active":"2026-02-24T08:32:11.198140+0000","last_peered":"2026-02-24T08:32:11.198140+0000","last_clean":"2026-02-24T08:32:11.198140+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:32:11.198140+0000","last_undegraded":"2026-02-24T08:32:11.198140+0000","last_fullsized":"2026-02-24T08:32:11.198140+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:00.936091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37027840,"num_objects":565,"num_object_clones":0,"num_object_copies":1695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":565,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4520,"num_write_kb":36160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"102'5280","reported_seq":5294,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.559708+0000","last_change":"2026-02-24T08:31:59.854071+0000","last_active":"2026-02-24T08:32:11.559708+0000","last_peered":"2026-02-24T08:32:11.559708+0000","last_clean":"2026-02-24T08:32:11.559708+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:32:11.559708+0000","last_undegraded":"2026-02-24T08:32:11.559708+0000","last_fullsized":"2026-02-24T08:32:11.559708+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5280,"log_dups_size":0,"ondisk_log_size":5280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:18.460030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43253760,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":660,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5280,"num_write_kb":42240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"102'5249","reported_seq":5256,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.566739+0000","last_change":"2026-02-24T08:31:59.855384+0000","last_active":"2026-02-24T08:32:11.566739+0000","last_peered":"2026-02-24T08:32:11.566739+0000","last_clean":"2026-02-24T08:32:11.566739+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:32:11.566739+0000","last_undegraded":"2026-02-24T08:32:11.566739+0000","last_fullsized":"2026-02-24T08:32:11.566739+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5249,"log_dups_size":0,"ondisk_log_size":5249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:07.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42999808,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":657,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":41992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'5659","reported_seq":5666,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.826199+0000","last_change":"2026-02-24T08:31:59.852330+0000","last_active":"2026-02-24T08:32:11.826199+0000","last_peered":"2026-02-24T08:32:11.826199+0000","last_clean":"2026-02-24T08:32:11.826199+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:32:11.826199+0000","last_undegraded":"2026-02-24T08:32:11.826199+0000","last_fullsized":"2026-02-24T08:32:11.826199+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5659,"log_dups_size":0,"ondisk_log_size":5659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:12.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46358528,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":708,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5659,"num_write_kb":45272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"102'4875","reported_seq":4884,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.220089+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:32:11.220089+0000","last_peered":"2026-02-24T08:32:11.220089+0000","last_clean":"2026-02-24T08:32:11.220089+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:32:11.220089+0000","last_undegraded":"2026-02-24T08:32:11.220089+0000","last_fullsized":"2026-02-24T08:32:11.220089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":4875,"log_dups_size":0,"ondisk_log_size":4875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39936000,"num_objects":610,"num_object_clones":0,"num_object_copies":1830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":610,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4875,"num_write_kb":39000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'5096","reported_seq":5110,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.813487+0000","last_change":"2026-02-24T08:31:59.852686+0000","last_active":"2026-02-24T08:32:11.813487+0000","last_peered":"2026-02-24T08:32:11.813487+0000","last_clean":"2026-02-24T08:32:11.813487+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:32:11.813487+0000","last_undegraded":"2026-02-24T08:32:11.813487+0000","last_fullsized":"2026-02-24T08:32:11.813487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5096,"log_dups_size":0,"ondisk_log_size":5096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:16.520309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41746432,"num_objects":637,"num_object_clones":0,"num_object_copies":1911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5096,"num_write_kb":40768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"102'5000","reported_seq":5014,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.551778+0000","last_change":"2026-02-24T08:31:59.854212+0000","last_active":"2026-02-24T08:32:11.551778+0000","last_peered":"2026-02-24T08:32:11.551778+0000","last_clean":"2026-02-24T08:32:11.551778+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:32:11.551778+0000","last_undegraded":"2026-02-24T08:32:11.551778+0000","last_fullsized":"2026-02-24T08:32:11.551778+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5000,"log_dups_size":0,"ondisk_log_size":5000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:24.238297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40960000,"num_objects":625,"num_object_clones":0,"num_object_copies":1875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5000,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"102'5365","reported_seq":5378,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.210423+0000","last_change":"2026-02-24T08:31:59.855283+0000","last_active":"2026-02-24T08:32:11.210423+0000","last_peered":"2026-02-24T08:32:11.210423+0000","last_clean":"2026-02-24T08:32:11.210423+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:32:11.210423+0000","last_undegraded":"2026-02-24T08:32:11.210423+0000","last_fullsized":"2026-02-24T08:32:11.210423+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5365,"log_dups_size":0,"ondisk_log_size":5365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.783477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43950080,"num_objects":671,"num_object_clones":0,"num_object_copies":2013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5365,"num_write_kb":42920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"102'5080","reported_seq":5094,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.183216+0000","last_change":"2026-02-24T08:31:59.856513+0000","last_active":"2026-02-24T08:32:11.183216+0000","last_peered":"2026-02-24T08:32:11.183216+0000","last_clean":"2026-02-24T08:32:11.183216+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:32:11.183216+0000","last_undegraded":"2026-02-24T08:32:11.183216+0000","last_fullsized":"2026-02-24T08:32:11.183216+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5080,"log_dups_size":0,"ondisk_log_size":5080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:09.276792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":635,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5080,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'5230","reported_seq":5242,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.825392+0000","last_change":"2026-02-24T08:31:59.854560+0000","last_active":"2026-02-24T08:32:11.825392+0000","last_peered":"2026-02-24T08:32:11.825392+0000","last_clean":"2026-02-24T08:32:11.825392+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:32:11.825392+0000","last_undegraded":"2026-02-24T08:32:11.825392+0000","last_fullsized":"2026-02-24T08:32:11.825392+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5230,"log_dups_size":0,"ondisk_log_size":5230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:19.422928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42844160,"num_objects":654,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":654,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5230,"num_write_kb":41840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"102'5016","reported_seq":5030,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.214465+0000","last_change":"2026-02-24T08:31:59.855084+0000","last_active":"2026-02-24T08:32:11.214465+0000","last_peered":"2026-02-24T08:32:11.214465+0000","last_clean":"2026-02-24T08:32:11.214465+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:32:11.214465+0000","last_undegraded":"2026-02-24T08:32:11.214465+0000","last_fullsized":"2026-02-24T08:32:11.214465+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5016,"log_dups_size":0,"ondisk_log_size":5016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:20.596585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41091072,"num_objects":627,"num_object_clones":0,"num_object_copies":1881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":627,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5016,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'5317","reported_seq":5328,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.825883+0000","last_change":"2026-02-24T08:31:59.854573+0000","last_active":"2026-02-24T08:32:11.825883+0000","last_peered":"2026-02-24T08:32:11.825883+0000","last_clean":"2026-02-24T08:32:11.825883+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:32:11.825883+0000","last_undegraded":"2026-02-24T08:32:11.825883+0000","last_fullsized":"2026-02-24T08:32:11.825883+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5317,"log_dups_size":0,"ondisk_log_size":5317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.228790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43556864,"num_objects":665,"num_object_clones":0,"num_object_copies":1995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":665,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5317,"num_write_kb":42536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'5192","reported_seq":5206,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.820826+0000","last_change":"2026-02-24T08:31:59.854291+0000","last_active":"2026-02-24T08:32:11.820826+0000","last_peered":"2026-02-24T08:32:11.820826+0000","last_clean":"2026-02-24T08:32:11.820826+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:32:11.820826+0000","last_undegraded":"2026-02-24T08:32:11.820826+0000","last_fullsized":"2026-02-24T08:32:11.820826+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":5192,"log_dups_size":0,"ondisk_log_size":5192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:17.273593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42532864,"num_objects":649,"num_object_clones":0,"num_object_copies":1947,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5192,"num_write_kb":41536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"102'4717","reported_seq":4725,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:11.218611+0000","last_change":"2026-02-24T08:31:59.855720+0000","last_active":"2026-02-24T08:32:11.218611+0000","last_peered":"2026-02-24T08:32:11.218611+0000","last_clean":"2026-02-24T08:32:11.218611+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:32:11.218611+0000","last_undegraded":"2026-02-24T08:32:11.218611+0000","last_fullsized":"2026-02-24T08:32:11.218611+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:58.889239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38641664,"num_objects":590,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":590,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4717,"num_write_kb":37736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":272,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:00.944644+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:32:00.944644+0000","last_peered":"2026-02-24T08:32:00.944644+0000","last_clean":"2026-02-24T08:32:00.944644+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:32:00.944644+0000","last_undegraded":"2026-02-24T08:32:00.944644+0000","last_fullsized":"2026-02-24T08:32:00.944644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":672301056,"num_objects":10262,"num_object_clones":0,"num_object_copies":30786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10262,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82068,"num_write_kb":656544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2008875008,"data_stored":2008875008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82068,"ondisk_log_size":82068,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8550,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247952,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2176504,"kb_used_data":479140,"kb_used_omap":30,"kb_used_meta":1697313,"kb_avail":731826696,"statfs":{"total":751619276800,"available":749390536704,"internally_reserved":0,"allocated":490639360,"data_stored":489963468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30822,"internal_metadata":1738049434},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444178,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2167424,"kb_used_data":476268,"kb_used_omap":32,"kb_used_meta":1691103,"kb_avail":731835776,"statfs":{"total":751619276800,"available":749399834624,"internally_reserved":0,"allocated":487698432,"data_stored":487022540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33790,"internal_metadata":1731689474},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,1,8,8,23,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1989324,"kb_used_data":446904,"kb_used_omap":29,"kb_used_meta":1542370,"kb_avail":732013876,"statfs":{"total":751619276800,"available":749582209024,"internally_reserved":0,"allocated":457629696,"data_stored":456957356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30532,"internal_metadata":1579387068},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,7,4,16,0,0,44],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705814,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2268048,"kb_used_data":501052,"kb_used_omap":30,"kb_used_meta":1766945,"kb_avail":731735152,"statfs":{"total":751619276800,"available":749296795648,"internally_reserved":0,"allocated":513077248,"data_stored":512401356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31190,"internal_metadata":1809352234},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,0,0,8,38,19,16,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8550,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":549453824,"data_stored":549453824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":477339648,"data_stored":477339648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":489586688,"data_stored":489586688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":492494848,"data_stored":492494848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:32:15.573 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:32:15.574 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 271 2026-02-24T08:32:15.643 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:15.774 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:15.782 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:15.779+0000 7fc924ffb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:15.783 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:15.779+0000 7fc924ffb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:15.803 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:15.803 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:15.817 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:15.817 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:15.831 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:15.831 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:15.848 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:15.848 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:15.912 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:15.909+0000 7f26babe1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:15.912 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:15.909+0000 7f26babe1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:15.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 15 128 108277 108149 56.3231 41.1016 0.00693826 0.0177314 2026-02-24T08:32:16.069 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:32:16.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:32:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:16 trial105 ceph-mon[39442]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:32:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4280336931' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/853931801' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "271"} : dispatch 2026-02-24T08:32:16.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 16 128 113524 113396 55.3647 40.9922 0.0113745 0.0180455 2026-02-24T08:32:17.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:17 trial105 ceph-mon[39442]: pgmap v433: 17 pgs: 17 active+clean; 800 MiB data, 8.7 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s wr, 8.09k op/s 2026-02-24T08:32:17.897 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:17.943 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 17 128 118702 118574 54.4874 40.4531 0.0144841 0.0183306 2026-02-24T08:32:18.049 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:18.507 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:18.508 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:18.465+0000 7fa3f3acf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:18.508 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:18.466+0000 7fa3f3acf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:18.508 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:18.512 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:18.513 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:18.530 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:18.530 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:18.530 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1866396385' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:18.544 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:18.544 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:18.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 18 127 122617 122490 53.1598 30.5938 0.026733 0.018794 2026-02-24T08:32:19.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:32:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:32:19.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:32:19.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:19 trial105 ceph-mon[39442]: pgmap v434: 17 pgs: 17 active+clean; 869 MiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s wr, 6.07k op/s 2026-02-24T08:32:19.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:32:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:32:19] "GET /metrics HTTP/1.1" 200 4213 "" "Prometheus/3.6.0" 2026-02-24T08:32:19.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 19 128 127518 127390 52.3766 38.2812 0.0494404 0.0190755 2026-02-24T08:32:20.845 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:20.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:32:20.942818+0000 min lat: 0.000762728 max lat: 0.169697 avg lat: 0.0193727 2026-02-24T08:32:20.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:32:20.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 20 127 132163 132036 51.5724 36.2969 0.0548049 0.0193727 2026-02-24T08:32:21.004 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:21.109 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:21.109 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:21.109 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:32:21.109 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:32:21.129 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:21.126+0000 7fe474047640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:21.130 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:21.126+0000 7fe474047640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:21.149 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:21.149 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:21.169 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:21.170 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:21.183 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:21.183 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:21.199 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:21.200 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:21.269 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:21.402 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:21.399+0000 7f2860e7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:21.406 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:21.399+0000 7f2860e7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:21.427 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:21.473 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:21.473 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:21.473 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:32:21.681 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:21.819 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:21.815+0000 7f5e77cb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:21.820 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:21.815+0000 7f5e77cb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:21.844 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:21.844 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:21.844 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:21.844 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:21.845 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:21.845 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:21.845 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:21.845 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:21.845 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:21.845 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:21.845 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:21.845 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:21.885 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:21.885 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:21.886 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:32:21.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 21 128 136467 136339 50.7172 33.6172 0.0412403 0.0196988 2026-02-24T08:32:22.035 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:21 trial105 ceph-mon[39442]: pgmap v435: 17 pgs: 17 active+clean; 869 MiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 38 MiB/s wr, 4.82k op/s 2026-02-24T08:32:22.036 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3864239859' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:22.045 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:22.178 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:22.174+0000 7f3258b4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:22.178 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:22.174+0000 7f3258b4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:22.203 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:22.203 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:22.203 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:22.204 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:22.204 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:22.204 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:22.204 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:22.204 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:22.204 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:22.204 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:22.204 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:22.204 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:22.245 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:22.246 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:22.246 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:32:22.406 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:22.544 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:22.540+0000 7f29e3aba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:22.544 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:22.541+0000 7f29e3aba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:22.569 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:22.569 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:22.569 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:22.570 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:22.570 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:22.570 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:22.570 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:22.570 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:22.570 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:22.570 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:22.570 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:22.570 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:22.612 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:22.613 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:22.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 22 128 140685 140557 49.9096 32.9531 0.00728815 0.0200173 2026-02-24T08:32:23.250 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:23.402 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:23.535 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:23.533+0000 7f828ee12640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:23.536 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:23.533+0000 7f828ee12640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:23.551 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:23.551 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:23.572 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:23.572 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:23.590 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:23.590 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:23.605 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:23.605 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:23.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 23 128 144620 144492 49.0761 30.7422 0.0288669 0.0203605 2026-02-24T08:32:24.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:23 trial105 ceph-mon[39442]: pgmap v436: 17 pgs: 17 active+clean; 1.0 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.77k op/s 2026-02-24T08:32:24.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2812400530' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:24.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 24 128 148657 148529 48.3453 31.5391 0.00916491 0.0206599 2026-02-24T08:32:25.655 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:25.803 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:25.923 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:25.920+0000 7f81f33c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:25.923 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:25.920+0000 7f81f33c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:25.938 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:25.938 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:25.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:25 trial105 ceph-mon[39442]: pgmap v437: 17 pgs: 17 active+clean; 1.0 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.37k op/s 2026-02-24T08:32:25.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 25 128 152481 152353 47.6064 29.875 0.0270523 0.0209727 2026-02-24T08:32:25.950 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:25.950 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:25.966 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:25.966 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:25.981 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:25.981 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:26.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 26 127 156402 156275 46.9538 30.6406 0.0692757 0.0212757 2026-02-24T08:32:27.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2176913617' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:27.614 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:27.614 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:27.614 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_6 2026-02-24T08:32:27.614 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:32:27.766 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:27.898 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:27 trial105 ceph-mon[39442]: pgmap v438: 17 pgs: 17 active+clean; 1.1 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 43 MiB/s wr, 5.52k op/s 2026-02-24T08:32:27.898 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:27.895+0000 7f9e46466640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:27.898 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:27.895+0000 7f9e46466640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:27.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 27 128 160005 159877 46.2569 28.1406 0.0473843 0.0215991 2026-02-24T08:32:28.028 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:28.061 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:32:28.061 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:32:28.112 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2026-02-24T08:32:26.788362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1215808032,"num_objects":18548,"num_object_clones":0,"num_object_copies":55644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18548,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":148477,"num_write_kb":1188886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148341,"ondisk_log_size":148341,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10434380,"kb_used_data":3555900,"kb_used_omap":123,"kb_used_meta":6878276,"kb_avail":2925578420,"statfs":{"total":3006477107200,"available":2995792302080,"internally_reserved":0,"allocated":3641241600,"data_stored":3638541584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126334,"internal_metadata":7043355266},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[13,5,11,13,17,26,29,3,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":542916608,"num_objects":8284,"num_object_clones":0,"num_object_copies":24852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66274,"num_write_kb":530192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001783"},"pg_stats":[{"pgid":"8.f","version":"102'9618","reported_seq":9630,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.605231+0000","last_change":"2026-02-24T08:31:59.852372+0000","last_active":"2026-02-24T08:32:26.605231+0000","last_peered":"2026-02-24T08:32:26.605231+0000","last_clean":"2026-02-24T08:32:26.605231+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:32:26.605231+0000","last_undegraded":"2026-02-24T08:32:26.605231+0000","last_fullsized":"2026-02-24T08:32:26.605231+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9618,"log_dups_size":0,"ondisk_log_size":9618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:11.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78790656,"num_objects":1203,"num_object_clones":0,"num_object_copies":3609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9618,"num_write_kb":76944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"102'10127","reported_seq":10133,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.600740+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:32:26.600740+0000","last_peered":"2026-02-24T08:32:26.600740+0000","last_clean":"2026-02-24T08:32:26.600740+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:32:26.600740+0000","last_undegraded":"2026-02-24T08:32:26.600740+0000","last_fullsized":"2026-02-24T08:32:26.600740+0000","mapping_epoch":100,"log_start":"102'100","ondisk_log_start":"102'100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82960384,"num_objects":1266,"num_object_clones":0,"num_object_copies":3798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1266,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10127,"num_write_kb":81016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"102'9048","reported_seq":9060,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.241928+0000","last_change":"2026-02-24T08:31:59.856660+0000","last_active":"2026-02-24T08:32:26.241928+0000","last_peered":"2026-02-24T08:32:26.241928+0000","last_clean":"2026-02-24T08:32:26.241928+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:32:26.241928+0000","last_undegraded":"2026-02-24T08:32:26.241928+0000","last_fullsized":"2026-02-24T08:32:26.241928+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9048,"log_dups_size":0,"ondisk_log_size":9048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:00.936091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74121216,"num_objects":1131,"num_object_clones":0,"num_object_copies":3393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9048,"num_write_kb":72384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"102'9880","reported_seq":9893,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.601828+0000","last_change":"2026-02-24T08:31:59.854071+0000","last_active":"2026-02-24T08:32:26.601828+0000","last_peered":"2026-02-24T08:32:26.601828+0000","last_clean":"2026-02-24T08:32:26.601828+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:32:26.601828+0000","last_undegraded":"2026-02-24T08:32:26.601828+0000","last_fullsized":"2026-02-24T08:32:26.601828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9880,"log_dups_size":0,"ondisk_log_size":9880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:18.460030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80936960,"num_objects":1235,"num_object_clones":0,"num_object_copies":3705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1235,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9880,"num_write_kb":79040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"102'9960","reported_seq":9974,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.588261+0000","last_change":"2026-02-24T08:31:59.855384+0000","last_active":"2026-02-24T08:32:26.588261+0000","last_peered":"2026-02-24T08:32:26.588261+0000","last_clean":"2026-02-24T08:32:26.588261+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:32:26.588261+0000","last_undegraded":"2026-02-24T08:32:26.588261+0000","last_fullsized":"2026-02-24T08:32:26.588261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9960,"log_dups_size":0,"ondisk_log_size":9960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:07.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81592320,"num_objects":1245,"num_object_clones":0,"num_object_copies":3735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1245,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9960,"num_write_kb":79680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'8720","reported_seq":8734,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:21.832663+0000","last_change":"2026-02-24T08:31:59.852330+0000","last_active":"2026-02-24T08:32:21.832663+0000","last_peered":"2026-02-24T08:32:21.832663+0000","last_clean":"2026-02-24T08:32:21.832663+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:32:21.832663+0000","last_undegraded":"2026-02-24T08:32:21.832663+0000","last_fullsized":"2026-02-24T08:32:21.832663+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":8720,"log_dups_size":0,"ondisk_log_size":8720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:12.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71434240,"num_objects":1090,"num_object_clones":0,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1090,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8720,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"102'9496","reported_seq":9505,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.239901+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:32:26.239901+0000","last_peered":"2026-02-24T08:32:26.239901+0000","last_clean":"2026-02-24T08:32:26.239901+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:32:26.239901+0000","last_undegraded":"2026-02-24T08:32:26.239901+0000","last_fullsized":"2026-02-24T08:32:26.239901+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9496,"log_dups_size":0,"ondisk_log_size":9496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77791232,"num_objects":1187,"num_object_clones":0,"num_object_copies":3561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1187,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9496,"num_write_kb":75968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'8360","reported_seq":8374,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:21.831657+0000","last_change":"2026-02-24T08:31:59.852686+0000","last_active":"2026-02-24T08:32:21.831657+0000","last_peered":"2026-02-24T08:32:21.831657+0000","last_clean":"2026-02-24T08:32:21.831657+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:32:21.831657+0000","last_undegraded":"2026-02-24T08:32:21.831657+0000","last_fullsized":"2026-02-24T08:32:21.831657+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":8360,"log_dups_size":0,"ondisk_log_size":8360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:16.520309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68485120,"num_objects":1045,"num_object_clones":0,"num_object_copies":3135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1045,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8360,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"102'9520","reported_seq":9534,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.571992+0000","last_change":"2026-02-24T08:31:59.854212+0000","last_active":"2026-02-24T08:32:26.571992+0000","last_peered":"2026-02-24T08:32:26.571992+0000","last_clean":"2026-02-24T08:32:26.571992+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:32:26.571992+0000","last_undegraded":"2026-02-24T08:32:26.571992+0000","last_fullsized":"2026-02-24T08:32:26.571992+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9520,"log_dups_size":0,"ondisk_log_size":9520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:24.238297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77987840,"num_objects":1190,"num_object_clones":0,"num_object_copies":3570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9520,"num_write_kb":76160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"102'9796","reported_seq":9809,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.251735+0000","last_change":"2026-02-24T08:31:59.855283+0000","last_active":"2026-02-24T08:32:26.251735+0000","last_peered":"2026-02-24T08:32:26.251735+0000","last_clean":"2026-02-24T08:32:26.251735+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:32:26.251735+0000","last_undegraded":"2026-02-24T08:32:26.251735+0000","last_fullsized":"2026-02-24T08:32:26.251735+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9796,"log_dups_size":0,"ondisk_log_size":9796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.783477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80248832,"num_objects":1225,"num_object_clones":0,"num_object_copies":3675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9796,"num_write_kb":78368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"102'9800","reported_seq":9806,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.247565+0000","last_change":"2026-02-24T08:31:59.856513+0000","last_active":"2026-02-24T08:32:26.247565+0000","last_peered":"2026-02-24T08:32:26.247565+0000","last_clean":"2026-02-24T08:32:26.247565+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:32:26.247565+0000","last_undegraded":"2026-02-24T08:32:26.247565+0000","last_fullsized":"2026-02-24T08:32:26.247565+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9800,"log_dups_size":0,"ondisk_log_size":9800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:09.276792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80281600,"num_objects":1225,"num_object_clones":0,"num_object_copies":3675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9800,"num_write_kb":78400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'8158","reported_seq":8172,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:21.837009+0000","last_change":"2026-02-24T08:31:59.854560+0000","last_active":"2026-02-24T08:32:21.837009+0000","last_peered":"2026-02-24T08:32:21.837009+0000","last_clean":"2026-02-24T08:32:21.837009+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:32:21.837009+0000","last_undegraded":"2026-02-24T08:32:21.837009+0000","last_fullsized":"2026-02-24T08:32:21.837009+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":8158,"log_dups_size":0,"ondisk_log_size":8158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:19.422928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66830336,"num_objects":1020,"num_object_clones":0,"num_object_copies":3060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8158,"num_write_kb":65264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"102'9608","reported_seq":9622,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.230458+0000","last_change":"2026-02-24T08:31:59.855084+0000","last_active":"2026-02-24T08:32:26.230458+0000","last_peered":"2026-02-24T08:32:26.230458+0000","last_clean":"2026-02-24T08:32:26.230458+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:32:26.230458+0000","last_undegraded":"2026-02-24T08:32:26.230458+0000","last_fullsized":"2026-02-24T08:32:26.230458+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9608,"log_dups_size":0,"ondisk_log_size":9608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:20.596585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78708736,"num_objects":1201,"num_object_clones":0,"num_object_copies":3603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9608,"num_write_kb":76864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'8382","reported_seq":8393,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:21.841205+0000","last_change":"2026-02-24T08:31:59.854573+0000","last_active":"2026-02-24T08:32:21.841205+0000","last_peered":"2026-02-24T08:32:21.841205+0000","last_clean":"2026-02-24T08:32:21.841205+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:32:21.841205+0000","last_undegraded":"2026-02-24T08:32:21.841205+0000","last_fullsized":"2026-02-24T08:32:21.841205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":8382,"log_dups_size":0,"ondisk_log_size":8382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.228790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68665344,"num_objects":1048,"num_object_clones":0,"num_object_copies":3144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8382,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'8595","reported_seq":8585,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:21.830865+0000","last_change":"2026-02-24T08:31:59.854291+0000","last_active":"2026-02-24T08:32:21.830865+0000","last_peered":"2026-02-24T08:32:21.830865+0000","last_clean":"2026-02-24T08:32:21.830865+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:32:21.830865+0000","last_undegraded":"2026-02-24T08:32:21.830865+0000","last_fullsized":"2026-02-24T08:32:21.830865+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":8595,"log_dups_size":0,"ondisk_log_size":8595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:17.273593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70410240,"num_objects":1075,"num_object_clones":0,"num_object_copies":3225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1075,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8595,"num_write_kb":68760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"102'9274","reported_seq":9280,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:26.245071+0000","last_change":"2026-02-24T08:31:59.855720+0000","last_active":"2026-02-24T08:32:26.245071+0000","last_peered":"2026-02-24T08:32:26.245071+0000","last_clean":"2026-02-24T08:32:26.245071+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:32:26.245071+0000","last_undegraded":"2026-02-24T08:32:26.245071+0000","last_fullsized":"2026-02-24T08:32:26.245071+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":9274,"log_dups_size":0,"ondisk_log_size":9274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:58.889239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75972608,"num_objects":1160,"num_object_clones":0,"num_object_copies":3480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9274,"num_write_kb":74192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":273,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:00.944670+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:32:00.944670+0000","last_peered":"2026-02-24T08:32:00.944670+0000","last_clean":"2026-02-24T08:32:00.944670+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:32:00.944670+0000","last_undegraded":"2026-02-24T08:32:00.944670+0000","last_fullsized":"2026-02-24T08:32:00.944670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1215217664,"num_objects":18546,"num_object_clones":0,"num_object_copies":55638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148342,"num_write_kb":1186736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3682820096,"data_stored":3682820096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148242,"ondisk_log_size":148242,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8550,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247955,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2709040,"kb_used_data":921436,"kb_used_omap":30,"kb_used_meta":1787553,"kb_avail":731294160,"statfs":{"total":751619276800,"available":748845219840,"internally_reserved":0,"allocated":943550464,"data_stored":942874572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30822,"internal_metadata":1830455194},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,2,6,10,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444181,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2695056,"kb_used_data":913660,"kb_used_omap":32,"kb_used_meta":1781343,"kb_avail":731308144,"statfs":{"total":751619276800,"available":748859539456,"internally_reserved":0,"allocated":935587840,"data_stored":934911948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33790,"internal_metadata":1824095234},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,3,5,3,12,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2331644,"kb_used_data":735080,"kb_used_omap":29,"kb_used_meta":1596514,"kb_avail":731671556,"statfs":{"total":751619276800,"available":749231673344,"internally_reserved":0,"allocated":752721920,"data_stored":752049580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30532,"internal_metadata":1634830524},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,18,29,3,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705817,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2698640,"kb_used_data":985724,"kb_used_omap":30,"kb_used_meta":1712865,"kb_avail":731304560,"statfs":{"total":751619276800,"available":748855869440,"internally_reserved":0,"allocated":1009381376,"data_stored":1008705484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31190,"internal_metadata":1753974314},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8550,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1031143424,"data_stored":1031143424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":769458176,"data_stored":769458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":938565632,"data_stored":938565632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":943652864,"data_stored":943652864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:32:28.113 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:32:28.113 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_6 pg_num 36 2026-02-24T08:32:28.177 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:28.303 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:28.303 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:28.300+0000 7fea06d96640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:28.304 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:28.300+0000 7fea06d96640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:28.319 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:28.319 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:28.334 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:28.335 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:28.348 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:28.348 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:28.360 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:28.360 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:28.427 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:28.425+0000 7fbf34224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:28.427 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:28.426+0000 7fbf34224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:28.564 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:32:28.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:32:28.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 28 128 163412 163284 45.5554 26.6172 0.0623452 0.0219309 2026-02-24T08:32:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1374754162' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:29.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3162067960' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T08:32:29.849 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:32:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:32:29] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-24T08:32:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:32:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:32:29.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:32:29.944 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 29 128 167020 166892 44.9565 28.1875 0.0228787 0.0222253 2026-02-24T08:32:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:29 trial105 ceph-mon[39442]: from='client.15508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:32:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:29 trial105 ceph-mon[39442]: pgmap v439: 17 pgs: 17 active+clean; 1.2 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.37k op/s 2026-02-24T08:32:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:32:30.412 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:30.560 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:30.688 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:30.684+0000 7fc3e1a82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:30.688 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:30.685+0000 7fc3e1a82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:30.706 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:30.707 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:30.720 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:30.720 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:30.735 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:30.736 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:30.749 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:30.750 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:30.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 30 128 170571 170443 44.3826 27.7422 0.0367508 0.0225128 2026-02-24T08:32:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3751708559' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:31.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 31 128 174016 173888 43.819 26.9141 0.0200783 0.0227824 2026-02-24T08:32:32.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:31 trial105 ceph-mon[39442]: pgmap v440: 17 pgs: 17 active+clean; 1.2 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.63k op/s 2026-02-24T08:32:32.799 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:32.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 32 128 177578 177450 43.3193 27.8281 0.044672 0.0230659 2026-02-24T08:32:32.951 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:33.088 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:33.085+0000 7f1ee9992640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:33.088 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:33.085+0000 7f1ee9992640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:33.105 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:33.105 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:33.123 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:33.123 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:33.141 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:33.141 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:33.156 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:33.156 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:33 trial105 ceph-mon[39442]: pgmap v441: 17 pgs: 17 active+clean; 1.3 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 40 MiB/s wr, 5.12k op/s 2026-02-24T08:32:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/938065721' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:33.604 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:33.604 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:33.604 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:32:33.605 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:32:33.759 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:33.902 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:33.898+0000 7f3e4637b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:33.902 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:33.899+0000 7f3e4637b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:33.929 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:33.929 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:33.929 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:33.929 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:33.929 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:33.929 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:33.929 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:33.930 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:33.930 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:33.930 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:33.930 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:33.930 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:33.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 33 127 181118 180991 42.8448 27.6641 0.0171017 0.0233226 2026-02-24T08:32:33.970 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:33.970 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:33.971 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:32:34.119 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:34.259 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:34.256+0000 7f72fab19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:34.259 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:34.256+0000 7f72fab19640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:34.282 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:34.283 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:34.283 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:34.283 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:34.283 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:34.283 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:34.283 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:34.283 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:34.283 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:34.283 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:34.284 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:34.284 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:34.317 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:34.317 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:34.318 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:32:34.468 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:34.588 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:34.585+0000 7f49fdc9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:34.588 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:34.585+0000 7f49fdc9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:34.612 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:34.657 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:34.657 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:34.657 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:32:34.801 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:34.931 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:34.928+0000 7f9c7404f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:34.931 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:34.928+0000 7f9c7404f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:34.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 34 128 184449 184321 42.3498 26.0156 0.0105237 0.0235992 2026-02-24T08:32:34.958 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:34.959 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:35.002 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:35.003 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:35.203 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:35.356 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:35.647 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:35.644+0000 7f082cba9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:35.647 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:35.644+0000 7f082cba9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:35.662 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:35.662 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:35.679 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:35.679 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:35.692 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:35.692 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:35.707 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:35.708 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:35.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 35 128 187661 187533 41.8567 25.0938 0.0159364 0.0238656 2026-02-24T08:32:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:35 trial105 ceph-mon[39442]: pgmap v442: 17 pgs: 17 active+clean; 1.3 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.17k op/s 2026-02-24T08:32:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3249110105' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:36.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 36 128 191283 191155 41.48 28.2969 0.0292889 0.0240911 2026-02-24T08:32:37.753 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:37.890 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:37.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 37 128 194854 194726 41.1128 27.8984 0.0151408 0.0243022 2026-02-24T08:32:38.025 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:38.022+0000 7f6b793e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:38.027 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:38.025+0000 7f6b793e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:38.027 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:37 trial105 ceph-mon[39442]: pgmap v443: 17 pgs: 17 active+clean; 1.4 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.16k op/s 2026-02-24T08:32:38.044 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:38.044 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:38.059 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:38.059 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:38.073 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:38.073 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:38.086 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:38.087 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:38.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 38 128 198311 198183 40.7416 27.0078 0.0666318 0.0245273 2026-02-24T08:32:39.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:38 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2563665259' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:39.841 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:32:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:32:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:32:39.846 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:32:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:32:39] "GET /metrics HTTP/1.1" 200 4218 "" "Prometheus/3.6.0" 2026-02-24T08:32:39.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 39 128 201585 201457 40.3527 25.5781 0.0209357 0.0247589 2026-02-24T08:32:40.004 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:40.004 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:40.005 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:32:40.005 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:32:40.140 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:40.152 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:40.161 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:39 trial105 ceph-mon[39442]: pgmap v444: 17 pgs: 17 active+clean; 1.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.47k op/s 2026-02-24T08:32:40.303 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:40.500+0000 7f82a3d28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:40.500+0000 7f82a3d28640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:40.557 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:40.558 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:40.558 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:40.558 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:40.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:32:40.944434+0000 min lat: 0.000762728 max lat: 0.292776 avg lat: 0.0250705 2026-02-24T08:32:40.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:32:40.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 40 127 204167 204040 39.8484 20.1797 0.0463254 0.0250705 2026-02-24T08:32:40.975 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:40.975 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:40.975 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:32:41.105 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:41.102+0000 7f0aa17ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:41.105 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:32:41.106 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:32:41.106 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:32:41.106 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:32:41.106 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:32:41.106 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:41.102+0000 7f0aa17ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:41.123 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:41.123 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:41.138 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:41.138 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:41.153 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:41.154 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:41.171 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:41.171 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:41.173 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:41.770 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:41.732+0000 7fbcda8cd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:41.770 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:41.733+0000 7fbcda8cd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:41.770 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:41.771 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:41.827 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:41.827 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:41.828 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:32:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:41 trial105 ceph-mon[39442]: pgmap v445: 17 pgs: 17 active+clean; 1.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.93k op/s 2026-02-24T08:32:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:41 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1458289650' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:41 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:32:41.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:41 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:32:41.945 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 41 128 207022 206894 39.4202 22.2969 0.0380241 0.0253468 2026-02-24T08:32:41.977 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:42.111 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:42.109+0000 7f19efa5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:42.114 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:42.109+0000 7f19efa5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:42.138 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:42.138 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:42.138 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:42.138 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:42.138 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:42.139 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:42.139 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:42.139 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:42.139 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:42.139 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:42.139 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:42.139 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:42.186 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:42.187 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:42.187 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:32:42.333 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:42.460 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:42.457+0000 7f69d4281640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:42.460 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:42.457+0000 7f69d4281640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:42.483 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:32:42.483 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:32:42.484 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:32:42.484 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:32:42.484 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:32:42.484 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:32:42.484 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:32:42.484 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:32:42.484 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:32:42.484 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:32:42.484 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:32:42.485 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:32:42.520 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:32:42.521 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:32:42.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 42 127 210405 210278 39.1111 26.4375 0.00718161 0.0255518 2026-02-24T08:32:43.394 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:43.544 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:43.662 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:43.659+0000 7fcca3e04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:43.662 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:43.660+0000 7fcca3e04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:43.678 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:43.679 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:43.693 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:43.693 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:43.706 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:43.706 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:43.720 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:43.720 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:43.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:43 trial105 ceph-mon[39442]: pgmap v446: 17 pgs: 17 active+clean; 1.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.26k op/s 2026-02-24T08:32:43.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:43 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:32:43.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:43 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:32:43.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/792665024' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:43.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 43 128 213775 213647 38.8132 26.3203 0.0212711 0.0257433 2026-02-24T08:32:44.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 44 128 217394 217266 38.5736 28.2734 0.0279975 0.0259086 2026-02-24T08:32:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:32:45.769 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:45.922 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:45.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 45 127 220996 220869 38.3419 28.1484 0.0183811 0.0260661 2026-02-24T08:32:46.049 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:46.046+0000 7f8cd9636640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:46.049 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:46.046+0000 7f8cd9636640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:46.049 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:45 trial105 ceph-mon[39442]: pgmap v447: 17 pgs: 17 active+clean; 1.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.78k op/s 2026-02-24T08:32:46.067 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:46.067 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:46.082 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:46.083 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:46.095 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:46.095 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:46.114 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:46.114 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:46.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 46 127 224615 224488 38.123 28.2734 0.0694586 0.0262125 2026-02-24T08:32:47.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3222530012' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:47.522 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:47.522 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:47.523 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:32:47.680 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:47.804 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:47.801+0000 7f32d0a9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:47.804 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:47.802+0000 7f32d0a9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:47.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 47 128 228020 227892 37.8776 26.5938 0.0961762 0.0263839 2026-02-24T08:32:47.954 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:32:47.955 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:32:48.002 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":448,"stamp":"2026-02-24T08:32:46.791150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1785127456,"num_objects":27235,"num_object_clones":0,"num_object_copies":81705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27235,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":217974,"num_write_kb":1744862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161138,"ondisk_log_size":161138,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10262244,"kb_used_data":5224588,"kb_used_omap":71,"kb_used_meta":5037496,"kb_avail":2925750556,"statfs":{"total":3006477107200,"available":2995968569344,"internally_reserved":0,"allocated":5349978112,"data_stored":5347278096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73627,"internal_metadata":5158396005},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10,36,19],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":370991104,"num_objects":5660,"num_object_clones":0,"num_object_copies":16980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5660,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45287,"num_write_kb":362296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001623"},"pg_stats":[{"pgid":"8.f","version":"102'13696","reported_seq":13710,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.671134+0000","last_change":"2026-02-24T08:31:59.852372+0000","last_active":"2026-02-24T08:32:46.671134+0000","last_peered":"2026-02-24T08:32:46.671134+0000","last_clean":"2026-02-24T08:32:46.671134+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:32:46.671134+0000","last_undegraded":"2026-02-24T08:32:46.671134+0000","last_fullsized":"2026-02-24T08:32:46.671134+0000","mapping_epoch":100,"log_start":"102'3600","ondisk_log_start":"102'3600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:11.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112197632,"num_objects":1712,"num_object_clones":0,"num_object_copies":5136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1712,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13696,"num_write_kb":109568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"102'14336","reported_seq":14350,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.699185+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:32:46.699185+0000","last_peered":"2026-02-24T08:32:46.699185+0000","last_clean":"2026-02-24T08:32:46.699185+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:32:46.699185+0000","last_undegraded":"2026-02-24T08:32:46.699185+0000","last_fullsized":"2026-02-24T08:32:46.699185+0000","mapping_epoch":100,"log_start":"102'4300","ondisk_log_start":"102'4300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":1792,"num_object_clones":0,"num_object_copies":5376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14336,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"102'13432","reported_seq":13446,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.268273+0000","last_change":"2026-02-24T08:31:59.856660+0000","last_active":"2026-02-24T08:32:46.268273+0000","last_peered":"2026-02-24T08:32:46.268273+0000","last_clean":"2026-02-24T08:32:46.268273+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:32:46.268273+0000","last_undegraded":"2026-02-24T08:32:46.268273+0000","last_fullsized":"2026-02-24T08:32:46.268273+0000","mapping_epoch":100,"log_start":"102'3400","ondisk_log_start":"102'3400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:00.936091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110034944,"num_objects":1679,"num_object_clones":0,"num_object_copies":5037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1679,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13432,"num_write_kb":107456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"102'13776","reported_seq":13790,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.594027+0000","last_change":"2026-02-24T08:31:59.854071+0000","last_active":"2026-02-24T08:32:46.594027+0000","last_peered":"2026-02-24T08:32:46.594027+0000","last_clean":"2026-02-24T08:32:46.594027+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:32:46.594027+0000","last_undegraded":"2026-02-24T08:32:46.594027+0000","last_fullsized":"2026-02-24T08:32:46.594027+0000","mapping_epoch":100,"log_start":"102'3700","ondisk_log_start":"102'3700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:18.460030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112852992,"num_objects":1722,"num_object_clones":0,"num_object_copies":5166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1722,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13776,"num_write_kb":110208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"102'14800","reported_seq":14809,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.702303+0000","last_change":"2026-02-24T08:31:59.855384+0000","last_active":"2026-02-24T08:32:46.702303+0000","last_peered":"2026-02-24T08:32:46.702303+0000","last_clean":"2026-02-24T08:32:46.702303+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:32:46.702303+0000","last_undegraded":"2026-02-24T08:32:46.702303+0000","last_fullsized":"2026-02-24T08:32:46.702303+0000","mapping_epoch":100,"log_start":"102'4700","ondisk_log_start":"102'4700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:07.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121241600,"num_objects":1850,"num_object_clones":0,"num_object_copies":5550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1850,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14800,"num_write_kb":118400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'13276","reported_seq":13284,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:41.927111+0000","last_change":"2026-02-24T08:31:59.852330+0000","last_active":"2026-02-24T08:32:41.927111+0000","last_peered":"2026-02-24T08:32:41.927111+0000","last_clean":"2026-02-24T08:32:41.927111+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:32:41.927111+0000","last_undegraded":"2026-02-24T08:32:41.927111+0000","last_fullsized":"2026-02-24T08:32:41.927111+0000","mapping_epoch":100,"log_start":"102'3200","ondisk_log_start":"102'3200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:12.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108756992,"num_objects":1660,"num_object_clones":0,"num_object_copies":4980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1660,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13276,"num_write_kb":106208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"102'13480","reported_seq":13494,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.268718+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:32:46.268718+0000","last_peered":"2026-02-24T08:32:46.268718+0000","last_clean":"2026-02-24T08:32:46.268718+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:32:46.268718+0000","last_undegraded":"2026-02-24T08:32:46.268718+0000","last_fullsized":"2026-02-24T08:32:46.268718+0000","mapping_epoch":100,"log_start":"102'3400","ondisk_log_start":"102'3400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110428160,"num_objects":1685,"num_object_clones":0,"num_object_copies":5055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13480,"num_write_kb":107840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'12814","reported_seq":12825,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:41.936219+0000","last_change":"2026-02-24T08:31:59.852686+0000","last_active":"2026-02-24T08:32:41.936219+0000","last_peered":"2026-02-24T08:32:41.936219+0000","last_clean":"2026-02-24T08:32:41.936219+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:32:41.936219+0000","last_undegraded":"2026-02-24T08:32:41.936219+0000","last_fullsized":"2026-02-24T08:32:41.936219+0000","mapping_epoch":100,"log_start":"102'2800","ondisk_log_start":"102'2800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:16.520309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104972288,"num_objects":1602,"num_object_clones":0,"num_object_copies":4806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1602,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12814,"num_write_kb":102512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"102'13978","reported_seq":13992,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.699291+0000","last_change":"2026-02-24T08:31:59.854212+0000","last_active":"2026-02-24T08:32:46.699291+0000","last_peered":"2026-02-24T08:32:46.699291+0000","last_clean":"2026-02-24T08:32:46.699291+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:32:46.699291+0000","last_undegraded":"2026-02-24T08:32:46.699291+0000","last_fullsized":"2026-02-24T08:32:46.699291+0000","mapping_epoch":100,"log_start":"102'3900","ondisk_log_start":"102'3900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:24.238297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114507776,"num_objects":1748,"num_object_clones":0,"num_object_copies":5244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13978,"num_write_kb":111824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"102'14056","reported_seq":14070,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.162498+0000","last_change":"2026-02-24T08:31:59.855283+0000","last_active":"2026-02-24T08:32:46.162498+0000","last_peered":"2026-02-24T08:32:46.162498+0000","last_clean":"2026-02-24T08:32:46.162498+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:32:46.162498+0000","last_undegraded":"2026-02-24T08:32:46.162498+0000","last_fullsized":"2026-02-24T08:32:46.162498+0000","mapping_epoch":100,"log_start":"102'4000","ondisk_log_start":"102'4000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.783477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115146752,"num_objects":1757,"num_object_clones":0,"num_object_copies":5271,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1757,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14056,"num_write_kb":112448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"102'14257","reported_seq":14265,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.306706+0000","last_change":"2026-02-24T08:31:59.856513+0000","last_active":"2026-02-24T08:32:46.306706+0000","last_peered":"2026-02-24T08:32:46.306706+0000","last_clean":"2026-02-24T08:32:46.306706+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:32:46.306706+0000","last_undegraded":"2026-02-24T08:32:46.306706+0000","last_fullsized":"2026-02-24T08:32:46.306706+0000","mapping_epoch":100,"log_start":"102'4200","ondisk_log_start":"102'4200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:09.276792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116793344,"num_objects":1783,"num_object_clones":0,"num_object_copies":5349,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1783,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14257,"num_write_kb":114056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'12496","reported_seq":12510,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:41.910173+0000","last_change":"2026-02-24T08:31:59.854560+0000","last_active":"2026-02-24T08:32:41.910173+0000","last_peered":"2026-02-24T08:32:41.910173+0000","last_clean":"2026-02-24T08:32:41.910173+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:32:41.910173+0000","last_undegraded":"2026-02-24T08:32:41.910173+0000","last_fullsized":"2026-02-24T08:32:41.910173+0000","mapping_epoch":100,"log_start":"102'2400","ondisk_log_start":"102'2400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:19.422928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102367232,"num_objects":1562,"num_object_clones":0,"num_object_copies":4686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12496,"num_write_kb":99968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"102'14136","reported_seq":14150,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.292802+0000","last_change":"2026-02-24T08:31:59.855084+0000","last_active":"2026-02-24T08:32:46.292802+0000","last_peered":"2026-02-24T08:32:46.292802+0000","last_clean":"2026-02-24T08:32:46.292802+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:32:46.292802+0000","last_undegraded":"2026-02-24T08:32:46.292802+0000","last_fullsized":"2026-02-24T08:32:46.292802+0000","mapping_epoch":100,"log_start":"102'4100","ondisk_log_start":"102'4100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:20.596585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115802112,"num_objects":1767,"num_object_clones":0,"num_object_copies":5301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1767,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14136,"num_write_kb":113088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'12744","reported_seq":12758,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:41.906664+0000","last_change":"2026-02-24T08:31:59.854573+0000","last_active":"2026-02-24T08:32:41.906664+0000","last_peered":"2026-02-24T08:32:41.906664+0000","last_clean":"2026-02-24T08:32:41.906664+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:32:41.906664+0000","last_undegraded":"2026-02-24T08:32:41.906664+0000","last_fullsized":"2026-02-24T08:32:41.906664+0000","mapping_epoch":100,"log_start":"102'2700","ondisk_log_start":"102'2700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.228790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104398848,"num_objects":1593,"num_object_clones":0,"num_object_copies":4779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1593,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12744,"num_write_kb":101952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'13184","reported_seq":13198,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:41.831398+0000","last_change":"2026-02-24T08:31:59.854291+0000","last_active":"2026-02-24T08:32:41.831398+0000","last_peered":"2026-02-24T08:32:41.831398+0000","last_clean":"2026-02-24T08:32:41.831398+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:32:41.831398+0000","last_undegraded":"2026-02-24T08:32:41.831398+0000","last_fullsized":"2026-02-24T08:32:41.831398+0000","mapping_epoch":100,"log_start":"102'3100","ondisk_log_start":"102'3100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:17.273593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108003328,"num_objects":1648,"num_object_clones":0,"num_object_copies":4944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13184,"num_write_kb":105472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"102'13378","reported_seq":13392,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:46.274119+0000","last_change":"2026-02-24T08:31:59.855720+0000","last_active":"2026-02-24T08:32:46.274119+0000","last_peered":"2026-02-24T08:32:46.274119+0000","last_clean":"2026-02-24T08:32:46.274119+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:32:46.274119+0000","last_undegraded":"2026-02-24T08:32:46.274119+0000","last_fullsized":"2026-02-24T08:32:46.274119+0000","mapping_epoch":100,"log_start":"102'3300","ondisk_log_start":"102'3300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:58.889239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109592576,"num_objects":1673,"num_object_clones":0,"num_object_copies":5019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13378,"num_write_kb":107024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":273,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:00.944670+0000","last_change":"2026-02-24T08:31:25.187933+0000","last_active":"2026-02-24T08:32:00.944670+0000","last_peered":"2026-02-24T08:32:00.944670+0000","last_clean":"2026-02-24T08:32:00.944670+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:32:00.944670+0000","last_undegraded":"2026-02-24T08:32:00.944670+0000","last_fullsized":"2026-02-24T08:32:00.944670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:31:25.187897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:31:25.187897+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:51.046623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1784537088,"num_objects":27233,"num_object_clones":0,"num_object_copies":81699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":217839,"num_write_kb":1742712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5385043968,"data_stored":5385043968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161039,"ondisk_log_size":161039,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8550,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247959,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3137864,"kb_used_data":1332148,"kb_used_omap":30,"kb_used_meta":1805665,"kb_avail":730865336,"statfs":{"total":751619276800,"available":748406104064,"internally_reserved":0,"allocated":1364119552,"data_stored":1363443660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30822,"internal_metadata":1849001882},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444185,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2042136,"kb_used_data":1325628,"kb_used_omap":5,"kb_used_meta":716474,"kb_avail":731961064,"statfs":{"total":751619276800,"available":749528129536,"internally_reserved":0,"allocated":1357443072,"data_stored":1356767180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6131,"internal_metadata":733669389},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2840780,"kb_used_data":1135928,"kb_used_omap":29,"kb_used_meta":1704802,"kb_avail":731162420,"statfs":{"total":751619276800,"available":748710318080,"internally_reserved":0,"allocated":1163190272,"data_stored":1162517932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30532,"internal_metadata":1745717436},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10,36,19],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705821,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2241464,"kb_used_data":1430884,"kb_used_omap":5,"kb_used_meta":810554,"kb_avail":731761736,"statfs":{"total":751619276800,"available":749324017664,"internally_reserved":0,"allocated":1465225216,"data_stored":1464549324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6142,"internal_metadata":830007298},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8550,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1487036416,"data_stored":1487036416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1170292736,"data_stored":1170292736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1362223104,"data_stored":1362223104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1365491712,"data_stored":1365491712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:32:48.159 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:48.183 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:47 trial105 ceph-mon[39442]: pgmap v448: 17 pgs: 17 active+clean; 1.7 GiB data, 9.8 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.77k op/s 2026-02-24T08:32:48.308 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:48.435 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:48.432+0000 7f2cd6649640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:48.436 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:48.434+0000 7f2cd6649640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:48.450 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:48.450 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:48.464 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:48.464 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:48.478 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:48.479 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:48.492 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:48.492 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:48.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 48 128 231354 231226 37.6311 26.0469 0.0278389 0.0265565 2026-02-24T08:32:49.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:48 trial105 ceph-mon[39442]: from='client.15544 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:32:49.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:48 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4066133442' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:49.856 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:32:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:32:49] "GET /metrics HTTP/1.1" 200 4213 "" "Prometheus/3.6.0" 2026-02-24T08:32:49.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:32:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:32:49.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:32:49.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 49 128 234960 234832 37.438 28.1719 0.0759031 0.0266947 2026-02-24T08:32:50.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:49 trial105 ceph-mon[39442]: pgmap v449: 17 pgs: 17 active+clean; 1.7 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.25k op/s 2026-02-24T08:32:50.542 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:50.695 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:50.826 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:50.823+0000 7f25ee6d4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:50.826 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:50.824+0000 7f25ee6d4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:50.844 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:50.844 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:50.859 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:50.859 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:50.871 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:50.871 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:50.885 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:50.885 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:50.946 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 50 128 238441 238313 37.2331 27.1953 0.0366786 0.0268452 2026-02-24T08:32:51.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1525724384' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:51.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 51 128 241978 241850 37.0448 27.6328 0.012843 0.0269828 2026-02-24T08:32:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:51 trial105 ceph-mon[39442]: pgmap v450: 17 pgs: 17 active+clean; 1.7 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.79k op/s 2026-02-24T08:32:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:51 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:32:52.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:51 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:32:52.934 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:52.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 52 128 245505 245377 36.8623 27.5547 0.0766389 0.0271093 2026-02-24T08:32:53.003 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:53.003 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:53.004 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_6 2026-02-24T08:32:53.004 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:32:53.083 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:53.150 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:53.215 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:53 trial105 ceph-mon[39442]: pgmap v451: 17 pgs: 17 active+clean; 1.8 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.23k op/s 2026-02-24T08:32:53.231 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:53.228+0000 7faaa2ebb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:53.231 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:53.229+0000 7faaa2ebb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:53.247 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:53.249 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:53.266 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:53.266 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:53.282 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:53.282 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:53.283 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:53.281+0000 7f05b2a9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:53.283 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:53.281+0000 7f05b2a9a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:53.296 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:53.297 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:53.444 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:32:53.444 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:32:53.496 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2026-02-24T08:32:52.791992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1973322272,"num_objects":30106,"num_object_clones":0,"num_object_copies":90318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30106,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":240947,"num_write_kb":1928646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161011,"ondisk_log_size":161011,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10905244,"kb_used_data":5759308,"kb_used_omap":72,"kb_used_meta":5145783,"kb_avail":2925107556,"statfs":{"total":3006477107200,"available":2995310137344,"internally_reserved":0,"allocated":5897531392,"data_stored":5894831376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74279,"internal_metadata":5269282265},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,14,17,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":416292864,"num_objects":6350,"num_object_clones":0,"num_object_copies":19050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50817,"num_write_kb":406536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001682"},"pg_stats":[{"pgid":"8.f","version":"102'14732","reported_seq":14743,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.684986+0000","last_change":"2026-02-24T08:31:59.852372+0000","last_active":"2026-02-24T08:32:51.684986+0000","last_peered":"2026-02-24T08:32:51.684986+0000","last_clean":"2026-02-24T08:32:51.684986+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:32:51.684986+0000","last_undegraded":"2026-02-24T08:32:51.684986+0000","last_fullsized":"2026-02-24T08:32:51.684986+0000","mapping_epoch":100,"log_start":"102'4700","ondisk_log_start":"102'4700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:11.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120684544,"num_objects":1842,"num_object_clones":0,"num_object_copies":5526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14732,"num_write_kb":117856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"102'15376","reported_seq":15390,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.711701+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:32:51.711701+0000","last_peered":"2026-02-24T08:32:51.711701+0000","last_clean":"2026-02-24T08:32:51.711701+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:32:51.711701+0000","last_undegraded":"2026-02-24T08:32:51.711701+0000","last_fullsized":"2026-02-24T08:32:51.711701+0000","mapping_epoch":100,"log_start":"102'5300","ondisk_log_start":"102'5300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":1922,"num_object_clones":0,"num_object_copies":5766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1922,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15376,"num_write_kb":123008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"102'14424","reported_seq":14438,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.304515+0000","last_change":"2026-02-24T08:31:59.856660+0000","last_active":"2026-02-24T08:32:51.304515+0000","last_peered":"2026-02-24T08:32:51.304515+0000","last_clean":"2026-02-24T08:32:51.304515+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:32:51.304515+0000","last_undegraded":"2026-02-24T08:32:51.304515+0000","last_fullsized":"2026-02-24T08:32:51.304515+0000","mapping_epoch":100,"log_start":"102'4400","ondisk_log_start":"102'4400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:00.936091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118161408,"num_objects":1803,"num_object_clones":0,"num_object_copies":5409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1803,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14424,"num_write_kb":115392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"102'14880","reported_seq":14894,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.698090+0000","last_change":"2026-02-24T08:31:59.854071+0000","last_active":"2026-02-24T08:32:51.698090+0000","last_peered":"2026-02-24T08:32:51.698090+0000","last_clean":"2026-02-24T08:32:51.698090+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:32:51.698090+0000","last_undegraded":"2026-02-24T08:32:51.698090+0000","last_fullsized":"2026-02-24T08:32:51.698090+0000","mapping_epoch":100,"log_start":"102'4800","ondisk_log_start":"102'4800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:18.460030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121896960,"num_objects":1860,"num_object_clones":0,"num_object_copies":5580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1860,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14880,"num_write_kb":119040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"102'15800","reported_seq":15814,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.657365+0000","last_change":"2026-02-24T08:31:59.855384+0000","last_active":"2026-02-24T08:32:51.657365+0000","last_peered":"2026-02-24T08:32:51.657365+0000","last_clean":"2026-02-24T08:32:51.657365+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:32:51.657365+0000","last_undegraded":"2026-02-24T08:32:51.657365+0000","last_fullsized":"2026-02-24T08:32:51.657365+0000","mapping_epoch":100,"log_start":"102'5700","ondisk_log_start":"102'5700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:07.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129433600,"num_objects":1975,"num_object_clones":0,"num_object_copies":5925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15800,"num_write_kb":126400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'15503","reported_seq":15501,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.960845+0000","last_change":"2026-02-24T08:31:59.852330+0000","last_active":"2026-02-24T08:32:51.960845+0000","last_peered":"2026-02-24T08:32:51.960845+0000","last_clean":"2026-02-24T08:32:51.960845+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:32:51.960845+0000","last_undegraded":"2026-02-24T08:32:51.960845+0000","last_fullsized":"2026-02-24T08:32:51.960845+0000","mapping_epoch":100,"log_start":"102'5500","ondisk_log_start":"102'5500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:12.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127000576,"num_objects":1938,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15503,"num_write_kb":124024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"102'14581","reported_seq":14591,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.319309+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:32:51.319309+0000","last_peered":"2026-02-24T08:32:51.319309+0000","last_clean":"2026-02-24T08:32:51.319309+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:32:51.319309+0000","last_undegraded":"2026-02-24T08:32:51.319309+0000","last_fullsized":"2026-02-24T08:32:51.319309+0000","mapping_epoch":100,"log_start":"102'4500","ondisk_log_start":"102'4500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119447552,"num_objects":1823,"num_object_clones":0,"num_object_copies":5469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14581,"num_write_kb":116648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'15136","reported_seq":15150,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.950639+0000","last_change":"2026-02-24T08:31:59.852686+0000","last_active":"2026-02-24T08:32:51.950639+0000","last_peered":"2026-02-24T08:32:51.950639+0000","last_clean":"2026-02-24T08:32:51.950639+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:32:51.950639+0000","last_undegraded":"2026-02-24T08:32:51.950639+0000","last_fullsized":"2026-02-24T08:32:51.950639+0000","mapping_epoch":100,"log_start":"102'5100","ondisk_log_start":"102'5100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:16.520309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123994112,"num_objects":1892,"num_object_clones":0,"num_object_copies":5676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15136,"num_write_kb":121088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"102'15144","reported_seq":15158,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.689381+0000","last_change":"2026-02-24T08:31:59.854212+0000","last_active":"2026-02-24T08:32:51.689381+0000","last_peered":"2026-02-24T08:32:51.689381+0000","last_clean":"2026-02-24T08:32:51.689381+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:32:51.689381+0000","last_undegraded":"2026-02-24T08:32:51.689381+0000","last_fullsized":"2026-02-24T08:32:51.689381+0000","mapping_epoch":100,"log_start":"102'5100","ondisk_log_start":"102'5100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:24.238297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124059648,"num_objects":1893,"num_object_clones":0,"num_object_copies":5679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1893,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15144,"num_write_kb":121152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"102'15136","reported_seq":15150,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.256150+0000","last_change":"2026-02-24T08:31:59.855283+0000","last_active":"2026-02-24T08:32:51.256150+0000","last_peered":"2026-02-24T08:32:51.256150+0000","last_clean":"2026-02-24T08:32:51.256150+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:32:51.256150+0000","last_undegraded":"2026-02-24T08:32:51.256150+0000","last_fullsized":"2026-02-24T08:32:51.256150+0000","mapping_epoch":100,"log_start":"102'5100","ondisk_log_start":"102'5100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.783477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123994112,"num_objects":1892,"num_object_clones":0,"num_object_copies":5676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1892,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15136,"num_write_kb":121088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"102'15427","reported_seq":15441,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.307744+0000","last_change":"2026-02-24T08:31:59.856513+0000","last_active":"2026-02-24T08:32:51.307744+0000","last_peered":"2026-02-24T08:32:51.307744+0000","last_clean":"2026-02-24T08:32:51.307744+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:32:51.307744+0000","last_undegraded":"2026-02-24T08:32:51.307744+0000","last_fullsized":"2026-02-24T08:32:51.307744+0000","mapping_epoch":100,"log_start":"102'5400","ondisk_log_start":"102'5400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:09.276792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126377984,"num_objects":1929,"num_object_clones":0,"num_object_copies":5787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1929,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15427,"num_write_kb":123416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'14968","reported_seq":14982,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.935780+0000","last_change":"2026-02-24T08:31:59.854560+0000","last_active":"2026-02-24T08:32:51.935780+0000","last_peered":"2026-02-24T08:32:51.935780+0000","last_clean":"2026-02-24T08:32:51.935780+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:32:51.935780+0000","last_undegraded":"2026-02-24T08:32:51.935780+0000","last_fullsized":"2026-02-24T08:32:51.935780+0000","mapping_epoch":100,"log_start":"102'4900","ondisk_log_start":"102'4900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:19.422928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122617856,"num_objects":1871,"num_object_clones":0,"num_object_copies":5613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1871,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14968,"num_write_kb":119744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"102'15176","reported_seq":15190,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.313300+0000","last_change":"2026-02-24T08:31:59.855084+0000","last_active":"2026-02-24T08:32:51.313300+0000","last_peered":"2026-02-24T08:32:51.313300+0000","last_clean":"2026-02-24T08:32:51.313300+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:32:51.313300+0000","last_undegraded":"2026-02-24T08:32:51.313300+0000","last_fullsized":"2026-02-24T08:32:51.313300+0000","mapping_epoch":100,"log_start":"102'5100","ondisk_log_start":"102'5100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:20.596585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124321792,"num_objects":1897,"num_object_clones":0,"num_object_copies":5691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15176,"num_write_kb":121408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'14888","reported_seq":14902,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.916726+0000","last_change":"2026-02-24T08:31:59.854573+0000","last_active":"2026-02-24T08:32:51.916726+0000","last_peered":"2026-02-24T08:32:51.916726+0000","last_clean":"2026-02-24T08:32:51.916726+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:32:51.916726+0000","last_undegraded":"2026-02-24T08:32:51.916726+0000","last_fullsized":"2026-02-24T08:32:51.916726+0000","mapping_epoch":100,"log_start":"102'4800","ondisk_log_start":"102'4800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.228790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121962496,"num_objects":1861,"num_object_clones":0,"num_object_copies":5583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1861,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14888,"num_write_kb":119104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'15153","reported_seq":15154,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.962848+0000","last_change":"2026-02-24T08:31:59.854291+0000","last_active":"2026-02-24T08:32:51.962848+0000","last_peered":"2026-02-24T08:32:51.962848+0000","last_clean":"2026-02-24T08:32:51.962848+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:32:51.962848+0000","last_undegraded":"2026-02-24T08:32:51.962848+0000","last_fullsized":"2026-02-24T08:32:51.962848+0000","mapping_epoch":100,"log_start":"102'5100","ondisk_log_start":"102'5100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:17.273593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124133376,"num_objects":1895,"num_object_clones":0,"num_object_copies":5685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1895,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15153,"num_write_kb":121224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"102'14488","reported_seq":14502,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.283394+0000","last_change":"2026-02-24T08:31:59.855720+0000","last_active":"2026-02-24T08:32:51.283394+0000","last_peered":"2026-02-24T08:32:51.283394+0000","last_clean":"2026-02-24T08:32:51.283394+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:32:51.283394+0000","last_undegraded":"2026-02-24T08:32:51.283394+0000","last_fullsized":"2026-02-24T08:32:51.283394+0000","mapping_epoch":100,"log_start":"102'4400","ondisk_log_start":"102'4400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:58.889239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118685696,"num_objects":1811,"num_object_clones":0,"num_object_copies":5433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1811,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14488,"num_write_kb":115904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":281,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.098242+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:32:51.098242+0000","last_peered":"2026-02-24T08:32:51.098242+0000","last_clean":"2026-02-24T08:32:51.098242+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:32:51.098242+0000","last_undegraded":"2026-02-24T08:32:51.098242+0000","last_fullsized":"2026-02-24T08:32:51.098242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1972731904,"num_objects":30104,"num_object_clones":0,"num_object_copies":90312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240812,"num_write_kb":1926496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5912928256,"data_stored":5912928256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160912,"ondisk_log_size":160912,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10335,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247960,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3260432,"kb_used_data":1436668,"kb_used_omap":30,"kb_used_meta":1823713,"kb_avail":730742768,"statfs":{"total":751619276800,"available":748280594432,"internally_reserved":0,"allocated":1471148032,"data_stored":1470472140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30822,"internal_metadata":1867483034},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444186,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2165824,"kb_used_data":1431276,"kb_used_omap":5,"kb_used_meta":734522,"kb_avail":731837376,"statfs":{"total":751619276800,"available":749401473024,"internally_reserved":0,"allocated":1465626624,"data_stored":1464950732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6131,"internal_metadata":752150541},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,14,17,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3066484,"kb_used_data":1325536,"kb_used_omap":30,"kb_used_meta":1740897,"kb_avail":730936716,"statfs":{"total":751619276800,"available":748479197184,"internally_reserved":0,"allocated":1357348864,"data_stored":1356676524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31184,"internal_metadata":1782679088},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705822,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2412504,"kb_used_data":1565828,"kb_used_omap":5,"kb_used_meta":846650,"kb_avail":731590696,"statfs":{"total":751619276800,"available":749148872704,"internally_reserved":0,"allocated":1603407872,"data_stored":1602731980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6142,"internal_metadata":866969602},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10335,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1602002944,"data_stored":1602002944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1367105536,"data_stored":1367105536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1469538304,"data_stored":1469538304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1474281472,"data_stored":1474281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:32:53.498 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:32:53.498 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_6 pg_num 46 2026-02-24T08:32:53.636 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:53.754 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:53.751+0000 7f2fa47aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:53.754 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:53.752+0000 7f2fa47aa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:53.902 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:32:53.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 53 127 248553 248426 36.6162 23.8203 0.0293517 0.0272918 2026-02-24T08:32:53.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:32:54.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2704694656' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:54.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:54 trial105 ceph-mon[39442]: from='client.15552 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:32:54.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1489641437' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T08:32:54.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 54 128 252079 251951 36.4481 27.5391 0.0459808 0.0274242 2026-02-24T08:32:55.348 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:32:55.372 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:55 trial105 ceph-mon[39442]: pgmap v452: 17 pgs: 17 active+clean; 1.8 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.90k op/s 2026-02-24T08:32:55.502 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:55.639 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:55.636+0000 7fc940c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:55.639 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:55.636+0000 7fc940c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:55.656 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:55.656 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:55.670 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:55.670 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:55.687 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:55.687 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:55.703 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:55.703 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:55.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 55 128 255351 255223 36.2501 25.5625 0.037369 0.0275747 2026-02-24T08:32:56.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3369094491' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:56.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 56 127 258882 258755 36.0955 27.5938 0.0296309 0.0276899 2026-02-24T08:32:57.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:57 trial105 ceph-mon[39442]: pgmap v453: 17 pgs: 17 active+clean; 1.9 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.89k op/s 2026-02-24T08:32:57.753 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:32:57.902 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:57.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 57 127 262360 262233 35.9389 27.1719 0.0425864 0.027804 2026-02-24T08:32:58.038 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:58.035+0000 7f81c6dc0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:58.040 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:58.036+0000 7f81c6dc0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:58.058 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:32:58.059 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:32:58.073 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:32:58.073 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:32:58.087 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:32:58.087 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:32:58.101 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:32:58.101 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:32:58.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3259196688' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:32:58.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 58 128 265887 265759 35.7942 27.5469 0.0733331 0.0279245 2026-02-24T08:32:58.949 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:32:58.949 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:32:58.949 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_6 2026-02-24T08:32:58.949 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:32:59.096 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:59.224 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:59.220+0000 7fa2fe365640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:59.224 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:59 trial105 ceph-mon[39442]: pgmap v454: 17 pgs: 17 active+clean; 2.0 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.32k op/s 2026-02-24T08:32:59.224 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:32:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:32:59.227 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:59.224+0000 7fa2fe365640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:59.386 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:32:59.387 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:32:59.439 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2026-02-24T08:32:58.792920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2111636000,"num_objects":32216,"num_object_clones":0,"num_object_copies":96648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32216,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":257831,"num_write_kb":2063718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160895,"ondisk_log_size":160895,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11459772,"kb_used_data":6165292,"kb_used_omap":72,"kb_used_meta":5294327,"kb_avail":2924553028,"statfs":{"total":3006477107200,"available":2994742300672,"internally_reserved":0,"allocated":6313259008,"data_stored":6310558992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74345,"internal_metadata":5421391255},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[9,4,2,9,28,15],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":326508544,"num_objects":4981,"num_object_clones":0,"num_object_copies":14943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39857,"num_write_kb":318856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001770"},"pg_stats":[{"pgid":"8.f","version":"102'15580","reported_seq":15594,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.714460+0000","last_change":"2026-02-24T08:31:59.852372+0000","last_active":"2026-02-24T08:32:56.714460+0000","last_peered":"2026-02-24T08:32:56.714460+0000","last_clean":"2026-02-24T08:32:56.714460+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:32:56.714460+0000","last_undegraded":"2026-02-24T08:32:56.714460+0000","last_fullsized":"2026-02-24T08:32:56.714460+0000","mapping_epoch":100,"log_start":"102'5500","ondisk_log_start":"102'5500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:11.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127631360,"num_objects":1948,"num_object_clones":0,"num_object_copies":5844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1948,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15580,"num_write_kb":124640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"102'16520","reported_seq":16534,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.694286+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:32:56.694286+0000","last_peered":"2026-02-24T08:32:56.694286+0000","last_clean":"2026-02-24T08:32:56.694286+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:32:56.694286+0000","last_undegraded":"2026-02-24T08:32:56.694286+0000","last_fullsized":"2026-02-24T08:32:56.694286+0000","mapping_epoch":100,"log_start":"102'6500","ondisk_log_start":"102'6500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135331840,"num_objects":2065,"num_object_clones":0,"num_object_copies":6195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2065,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16520,"num_write_kb":132160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"102'15576","reported_seq":15583,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.325552+0000","last_change":"2026-02-24T08:31:59.856660+0000","last_active":"2026-02-24T08:32:56.325552+0000","last_peered":"2026-02-24T08:32:56.325552+0000","last_clean":"2026-02-24T08:32:56.325552+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:32:56.325552+0000","last_undegraded":"2026-02-24T08:32:56.325552+0000","last_fullsized":"2026-02-24T08:32:56.325552+0000","mapping_epoch":100,"log_start":"102'5500","ondisk_log_start":"102'5500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:00.936091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127598592,"num_objects":1947,"num_object_clones":0,"num_object_copies":5841,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1947,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15576,"num_write_kb":124608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"102'15808","reported_seq":15822,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.706584+0000","last_change":"2026-02-24T08:31:59.854071+0000","last_active":"2026-02-24T08:32:56.706584+0000","last_peered":"2026-02-24T08:32:56.706584+0000","last_clean":"2026-02-24T08:32:56.706584+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:32:56.706584+0000","last_undegraded":"2026-02-24T08:32:56.706584+0000","last_fullsized":"2026-02-24T08:32:56.706584+0000","mapping_epoch":100,"log_start":"102'5800","ondisk_log_start":"102'5800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:18.460030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129499136,"num_objects":1976,"num_object_clones":0,"num_object_copies":5928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15808,"num_write_kb":126464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"102'16960","reported_seq":16974,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.706719+0000","last_change":"2026-02-24T08:31:59.855384+0000","last_active":"2026-02-24T08:32:56.706719+0000","last_peered":"2026-02-24T08:32:56.706719+0000","last_clean":"2026-02-24T08:32:56.706719+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:32:56.706719+0000","last_undegraded":"2026-02-24T08:32:56.706719+0000","last_fullsized":"2026-02-24T08:32:56.706719+0000","mapping_epoch":100,"log_start":"102'6900","ondisk_log_start":"102'6900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:07.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138936320,"num_objects":2120,"num_object_clones":0,"num_object_copies":6360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16960,"num_write_kb":135680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'16446","reported_seq":16455,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.957727+0000","last_change":"2026-02-24T08:31:59.852330+0000","last_active":"2026-02-24T08:32:56.957727+0000","last_peered":"2026-02-24T08:32:56.957727+0000","last_clean":"2026-02-24T08:32:56.957727+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:32:56.957727+0000","last_undegraded":"2026-02-24T08:32:56.957727+0000","last_fullsized":"2026-02-24T08:32:56.957727+0000","mapping_epoch":100,"log_start":"102'6400","ondisk_log_start":"102'6400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:12.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134725632,"num_objects":2056,"num_object_clones":0,"num_object_copies":6168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2056,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16446,"num_write_kb":131568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"102'15688","reported_seq":15702,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.268835+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:32:56.268835+0000","last_peered":"2026-02-24T08:32:56.268835+0000","last_clean":"2026-02-24T08:32:56.268835+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:32:56.268835+0000","last_undegraded":"2026-02-24T08:32:56.268835+0000","last_fullsized":"2026-02-24T08:32:56.268835+0000","mapping_epoch":100,"log_start":"102'5600","ondisk_log_start":"102'5600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128516096,"num_objects":1961,"num_object_clones":0,"num_object_copies":5883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15688,"num_write_kb":125504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'16136","reported_seq":16150,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.957257+0000","last_change":"2026-02-24T08:31:59.852686+0000","last_active":"2026-02-24T08:32:56.957257+0000","last_peered":"2026-02-24T08:32:56.957257+0000","last_clean":"2026-02-24T08:32:56.957257+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:32:56.957257+0000","last_undegraded":"2026-02-24T08:32:56.957257+0000","last_fullsized":"2026-02-24T08:32:56.957257+0000","mapping_epoch":100,"log_start":"102'6100","ondisk_log_start":"102'6100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:16.520309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132186112,"num_objects":2017,"num_object_clones":0,"num_object_copies":6051,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16136,"num_write_kb":129088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"102'16384","reported_seq":16398,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.724792+0000","last_change":"2026-02-24T08:31:59.854212+0000","last_active":"2026-02-24T08:32:56.724792+0000","last_peered":"2026-02-24T08:32:56.724792+0000","last_clean":"2026-02-24T08:32:56.724792+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:32:56.724792+0000","last_undegraded":"2026-02-24T08:32:56.724792+0000","last_fullsized":"2026-02-24T08:32:56.724792+0000","mapping_epoch":100,"log_start":"102'6300","ondisk_log_start":"102'6300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:24.238297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":2048,"num_object_clones":0,"num_object_copies":6144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16384,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"102'16157","reported_seq":16171,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.263856+0000","last_change":"2026-02-24T08:31:59.855283+0000","last_active":"2026-02-24T08:32:56.263856+0000","last_peered":"2026-02-24T08:32:56.263856+0000","last_clean":"2026-02-24T08:32:56.263856+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:32:56.263856+0000","last_undegraded":"2026-02-24T08:32:56.263856+0000","last_fullsized":"2026-02-24T08:32:56.263856+0000","mapping_epoch":100,"log_start":"102'6100","ondisk_log_start":"102'6100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.783477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132358144,"num_objects":2020,"num_object_clones":0,"num_object_copies":6060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2020,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16157,"num_write_kb":129256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"102'16432","reported_seq":16444,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.316061+0000","last_change":"2026-02-24T08:31:59.856513+0000","last_active":"2026-02-24T08:32:56.316061+0000","last_peered":"2026-02-24T08:32:56.316061+0000","last_clean":"2026-02-24T08:32:56.316061+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:32:56.316061+0000","last_undegraded":"2026-02-24T08:32:56.316061+0000","last_fullsized":"2026-02-24T08:32:56.316061+0000","mapping_epoch":100,"log_start":"102'6400","ondisk_log_start":"102'6400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:09.276792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134610944,"num_objects":2054,"num_object_clones":0,"num_object_copies":6162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2054,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16432,"num_write_kb":131456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'16041","reported_seq":16055,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.964050+0000","last_change":"2026-02-24T08:31:59.854560+0000","last_active":"2026-02-24T08:32:56.964050+0000","last_peered":"2026-02-24T08:32:56.964050+0000","last_clean":"2026-02-24T08:32:56.964050+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:32:56.964050+0000","last_undegraded":"2026-02-24T08:32:56.964050+0000","last_fullsized":"2026-02-24T08:32:56.964050+0000","mapping_epoch":100,"log_start":"102'6000","ondisk_log_start":"102'6000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:19.422928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131407872,"num_objects":2006,"num_object_clones":0,"num_object_copies":6018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2006,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16041,"num_write_kb":128328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"102'16232","reported_seq":16246,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.264028+0000","last_change":"2026-02-24T08:31:59.855084+0000","last_active":"2026-02-24T08:32:56.264028+0000","last_peered":"2026-02-24T08:32:56.264028+0000","last_clean":"2026-02-24T08:32:56.264028+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:32:56.264028+0000","last_undegraded":"2026-02-24T08:32:56.264028+0000","last_fullsized":"2026-02-24T08:32:56.264028+0000","mapping_epoch":100,"log_start":"102'6200","ondisk_log_start":"102'6200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:20.596585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132972544,"num_objects":2029,"num_object_clones":0,"num_object_copies":6087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2029,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16232,"num_write_kb":129856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'15960","reported_seq":15974,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.948196+0000","last_change":"2026-02-24T08:31:59.854573+0000","last_active":"2026-02-24T08:32:56.948196+0000","last_peered":"2026-02-24T08:32:56.948196+0000","last_clean":"2026-02-24T08:32:56.948196+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:32:56.948196+0000","last_undegraded":"2026-02-24T08:32:56.948196+0000","last_fullsized":"2026-02-24T08:32:56.948196+0000","mapping_epoch":100,"log_start":"102'5900","ondisk_log_start":"102'5900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:59.228790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130744320,"num_objects":1995,"num_object_clones":0,"num_object_copies":5985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1995,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15960,"num_write_kb":127680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'16144","reported_seq":16158,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.956816+0000","last_change":"2026-02-24T08:31:59.854291+0000","last_active":"2026-02-24T08:32:56.956816+0000","last_peered":"2026-02-24T08:32:56.956816+0000","last_clean":"2026-02-24T08:32:56.956816+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:32:56.956816+0000","last_undegraded":"2026-02-24T08:32:56.956816+0000","last_fullsized":"2026-02-24T08:32:56.956816+0000","mapping_epoch":100,"log_start":"102'6100","ondisk_log_start":"102'6100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:17.273593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132251648,"num_objects":2018,"num_object_clones":0,"num_object_copies":6054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2018,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16144,"num_write_kb":129152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"102'15632","reported_seq":15640,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:56.326364+0000","last_change":"2026-02-24T08:31:59.855720+0000","last_active":"2026-02-24T08:32:56.326364+0000","last_peered":"2026-02-24T08:32:56.326364+0000","last_clean":"2026-02-24T08:32:56.326364+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:32:56.326364+0000","last_undegraded":"2026-02-24T08:32:56.326364+0000","last_fullsized":"2026-02-24T08:32:56.326364+0000","mapping_epoch":100,"log_start":"102'5600","ondisk_log_start":"102'5600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:32:58.889239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128057344,"num_objects":1954,"num_object_clones":0,"num_object_copies":5862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1954,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15632,"num_write_kb":125056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":281,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.098242+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:32:51.098242+0000","last_peered":"2026-02-24T08:32:51.098242+0000","last_clean":"2026-02-24T08:32:51.098242+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:32:51.098242+0000","last_undegraded":"2026-02-24T08:32:51.098242+0000","last_fullsized":"2026-02-24T08:32:51.098242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2111045632,"num_objects":32214,"num_object_clones":0,"num_object_copies":96642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257696,"num_write_kb":2061568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6327255040,"data_stored":6327255040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160796,"ondisk_log_size":160796,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10335,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247961,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3414176,"kb_used_data":1536268,"kb_used_omap":30,"kb_used_meta":1877857,"kb_avail":730589024,"statfs":{"total":751619276800,"available":748123160576,"internally_reserved":0,"allocated":1573138432,"data_stored":1572462540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30888,"internal_metadata":1922926424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444187,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2289328,"kb_used_data":1536732,"kb_used_omap":5,"kb_used_meta":752570,"kb_avail":731713872,"statfs":{"total":751619276800,"available":749275004928,"internally_reserved":0,"allocated":1573613568,"data_stored":1572937676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6131,"internal_metadata":770631693},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,3,13,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3175116,"kb_used_data":1416120,"kb_used_omap":30,"kb_used_meta":1758945,"kb_avail":730828084,"statfs":{"total":751619276800,"available":748367958016,"internally_reserved":0,"allocated":1450106880,"data_stored":1449434540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31184,"internal_metadata":1801160240},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705823,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2581152,"kb_used_data":1676172,"kb_used_omap":5,"kb_used_meta":904954,"kb_avail":731422048,"statfs":{"total":751619276800,"available":748976177152,"internally_reserved":0,"allocated":1716400128,"data_stored":1715724236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6142,"internal_metadata":926672898},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,3,1,6,15,12],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10335,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1715052544,"data_stored":1715052544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1459658752,"data_stored":1459658752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1575174144,"data_stored":1575174144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1577369600,"data_stored":1577369600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:32:59.441 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:32:59.441 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_6 pg_num 56 2026-02-24T08:32:59.585 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:32:59.713 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:59.709+0000 7fc15137d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:59.714 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:32:59.710+0000 7fc15137d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:32:59.874 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:32:59.874 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:32:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:32:59] "GET /metrics HTTP/1.1" 200 4209 "" "Prometheus/3.6.0" 2026-02-24T08:32:59.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:32:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:32:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:32:59.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:32:59.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 59 128 269218 269090 35.6286 26.0234 0.0118472 0.0280529 2026-02-24T08:33:00.151 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:00.173 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:00 trial105 ceph-mon[39442]: 8.9 scrub starts 2026-02-24T08:33:00.174 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:00 trial105 ceph-mon[39442]: from='client.15560 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:00.174 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1334695050' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T08:33:00.296 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:00.428 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:00.424+0000 7f7be2d59640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:00.428 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:00.424+0000 7f7be2d59640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:00.442 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:00.443 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:00.455 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:00.456 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:00.471 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:00.471 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:00.487 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:00.488 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:00.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:33:00.946364+0000 min lat: 0.000762728 max lat: 0.292776 avg lat: 0.0281544 2026-02-24T08:33:00.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:33:00.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 60 127 272812 272685 35.5028 28.0859 0.0290836 0.0281544 2026-02-24T08:33:01.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3030784595' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:01.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:01 trial105 ceph-mon[39442]: 8.9 scrub ok 2026-02-24T08:33:01.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:01 trial105 ceph-mon[39442]: pgmap v455: 17 pgs: 17 active+clean; 2.0 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.85k op/s 2026-02-24T08:33:01.947 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 61 128 276321 276193 35.37 27.4062 0.0319085 0.028257 2026-02-24T08:33:02.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:02 trial105 ceph-mon[39442]: 8.1 scrub starts 2026-02-24T08:33:02.540 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:02.689 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:02.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 62 128 279604 279476 35.2132 25.6484 0.019104 0.0283836 2026-02-24T08:33:03.043 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:03.035+0000 7fac4191b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:03.043 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:03.035+0000 7fac4191b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:03.057 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:03.057 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:03.077 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:03.077 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:03.093 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:03.093 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:03.108 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:03.109 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:03.369 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:03 trial105 ceph-mon[39442]: 8.1 scrub ok 2026-02-24T08:33:03.369 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:03 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:33:03.369 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:03 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:33:03.369 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:03 trial105 ceph-mon[39442]: pgmap v456: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.1 GiB data, 9.2 GiB used, 2.7 TiB / 2.7 TiB avail; 34 MiB/s wr, 4.32k op/s 2026-02-24T08:33:03.369 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:03 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3342075158' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:03.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 63 127 282253 282126 34.9826 20.7031 0.0254254 0.0285706 2026-02-24T08:33:04.942 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:33:04.943 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:33:04.943 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:33:04.943 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:33:04.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 64 128 285449 285321 34.826 24.9609 0.10711 0.0286966 2026-02-24T08:33:05.096 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:05.123 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:04 trial105 ceph-mon[39442]: 8.d scrub starts 2026-02-24T08:33:05.225 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:05.222+0000 7fc7f8703640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:05.225 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:05.222+0000 7fc7f8703640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:05.244 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:33:05.244 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:33:05.245 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:33:05.282 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:33:05.282 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:33:05.283 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:33:05.475 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:05.604 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:05.600+0000 7fc55f697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:05.604 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:05.600+0000 7fc55f697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:05.627 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:33:05.627 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:33:05.628 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:33:05.668 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:33:05.668 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:33:05.669 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:33:05.733 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:05.818 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:05.876 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:05.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 65 128 288591 288463 34.6678 24.5469 0.0205804 0.0288232 2026-02-24T08:33:05.950 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:05.946+0000 7f86838d9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:05.950 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:05.947+0000 7f86838d9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:05.971 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:33:05.972 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:33:05.973 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:33:05.995 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:05.991+0000 7fabc771d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:05.995 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:05.992+0000 7fabc771d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:06.007 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:05 trial105 ceph-mon[39442]: pgmap v457: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.1 GiB data, 9.2 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.87k op/s 2026-02-24T08:33:06.008 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:05 trial105 ceph-mon[39442]: 8.d scrub ok 2026-02-24T08:33:06.009 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:33:06.009 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:33:06.010 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:33:06.012 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:06.013 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:06.028 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:06.028 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:06.041 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:06.041 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:06.057 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:06.057 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:06.164 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:06.287 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:06.284+0000 7f4043241640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:06.288 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:06.285+0000 7f4043241640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:06.310 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:33:06.310 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:33:06.310 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:33:06.310 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:33:06.311 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:33:06.311 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:33:06.311 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:33:06.311 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:33:06.311 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:33:06.311 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:33:06.311 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:33:06.311 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:33:06.345 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:33:06.345 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:33:06.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 66 128 291855 291727 34.5289 25.5 0.0238012 0.0289485 2026-02-24T08:33:07.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:06 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3277704974' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:07.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:06 trial105 ceph-mon[39442]: 8.5 scrub starts 2026-02-24T08:33:07.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 67 127 295376 295249 34.4242 27.5156 0.0202331 0.0290404 2026-02-24T08:33:08.109 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:08.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:07 trial105 ceph-mon[39442]: pgmap v458: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.2 GiB data, 9.5 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.78k op/s 2026-02-24T08:33:08.138 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:07 trial105 ceph-mon[39442]: 8.5 scrub ok 2026-02-24T08:33:08.270 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:08.401 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:08.398+0000 7f6188169640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:08.401 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:08.398+0000 7f6188169640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:08.419 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:08.419 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:08.433 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:08.433 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:08.448 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:08.449 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:08.462 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:08.462 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:08.948 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 68 128 298813 298685 34.3127 26.8438 0.0213443 0.0291331 2026-02-24T08:33:09.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:08 trial105 ceph-mon[39442]: 8.b scrub starts 2026-02-24T08:33:09.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3948056867' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:09.839 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:33:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:33:09.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:33:09.852 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:33:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:33:09] "GET /metrics HTTP/1.1" 200 4209 "" "Prometheus/3.6.0" 2026-02-24T08:33:09.949 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 69 127 302323 302196 34.2129 27.4297 0.0438206 0.0292159 2026-02-24T08:33:10.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:09 trial105 ceph-mon[39442]: pgmap v459: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.2 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.19k op/s 2026-02-24T08:33:10.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:09 trial105 ceph-mon[39442]: 8.b scrub ok 2026-02-24T08:33:10.510 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:10.654 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:10.771 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:10.768+0000 7f52967fc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:10.771 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:10.768+0000 7f52967fc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:10.787 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:10.788 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:10.801 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:10.802 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:10.816 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:10.816 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:10.831 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:10.831 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:10.949 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 70 127 305730 305603 34.1044 26.6172 0.0566175 0.0293112 2026-02-24T08:33:11.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/185414095' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:11.346 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:33:11.346 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:33:11.347 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:33:11.347 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:11.496 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:11.630 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:11.627+0000 7f9e23527640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:11.630 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:11.627+0000 7f9e23527640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:11.782 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:33:11.782 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:33:11.837 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":460,"stamp":"2026-02-24T08:33:10.794635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2384069152,"num_objects":36373,"num_object_clones":0,"num_object_copies":109119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36373,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":291087,"num_write_kb":2329766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160751,"ondisk_log_size":160751,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10080244,"kb_used_data":6961060,"kb_used_omap":24,"kb_used_meta":3119079,"kb_avail":2925932556,"statfs":{"total":3006477107200,"available":2996154937344,"internally_reserved":0,"allocated":7128125440,"data_stored":7125425424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25210,"internal_metadata":3193937286},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,4,8,4,1,0,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272433152,"num_objects":4157,"num_object_clones":0,"num_object_copies":12471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33256,"num_write_kb":266048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001715"},"pg_stats":[{"pgid":"8.f","version":"102'17712","reported_seq":17726,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.686767+0000","last_change":"2026-02-24T08:31:59.852372+0000","last_active":"2026-02-24T08:33:06.686767+0000","last_peered":"2026-02-24T08:33:06.686767+0000","last_clean":"2026-02-24T08:33:06.686767+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:33:06.686767+0000","last_undegraded":"2026-02-24T08:33:06.686767+0000","last_fullsized":"2026-02-24T08:33:06.686767+0000","mapping_epoch":100,"log_start":"102'7700","ondisk_log_start":"102'7700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:11.723933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145096704,"num_objects":2214,"num_object_clones":0,"num_object_copies":6642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17712,"num_write_kb":141696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"102'18504","reported_seq":18518,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.730997+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:33:06.730997+0000","last_peered":"2026-02-24T08:33:06.730997+0000","last_clean":"2026-02-24T08:33:06.730997+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:33:06.730997+0000","last_undegraded":"2026-02-24T08:33:06.730997+0000","last_fullsized":"2026-02-24T08:33:06.730997+0000","mapping_epoch":100,"log_start":"102'8500","ondisk_log_start":"102'8500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151584768,"num_objects":2313,"num_object_clones":0,"num_object_copies":6939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18504,"num_write_kb":148032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"102'17728","reported_seq":17771,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.289817+0000","last_change":"2026-02-24T08:33:05.192827+0000","last_active":"2026-02-24T08:33:06.289817+0000","last_peered":"2026-02-24T08:33:06.289817+0000","last_clean":"2026-02-24T08:33:06.289817+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:33:06.289817+0000","last_undegraded":"2026-02-24T08:33:06.289817+0000","last_fullsized":"2026-02-24T08:33:06.289817+0000","mapping_epoch":100,"log_start":"102'7700","ondisk_log_start":"102'7700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17536","last_scrub_stamp":"2026-02-24T08:33:05.192724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:05.192724+0000","objects_scrubbed":2178,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:18.812981+0000","scrub_duration":1000,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145227776,"num_objects":2216,"num_object_clones":0,"num_object_copies":6648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17728,"num_write_kb":141824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"102'17632","reported_seq":17646,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.731323+0000","last_change":"2026-02-24T08:31:59.854071+0000","last_active":"2026-02-24T08:33:06.731323+0000","last_peered":"2026-02-24T08:33:06.731323+0000","last_clean":"2026-02-24T08:33:06.731323+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:33:06.731323+0000","last_undegraded":"2026-02-24T08:33:06.731323+0000","last_fullsized":"2026-02-24T08:33:06.731323+0000","mapping_epoch":100,"log_start":"102'7600","ondisk_log_start":"102'7600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:18.460030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144441344,"num_objects":2204,"num_object_clones":0,"num_object_copies":6612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17632,"num_write_kb":141056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"102'18976","reported_seq":18990,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.722209+0000","last_change":"2026-02-24T08:31:59.855384+0000","last_active":"2026-02-24T08:33:06.722209+0000","last_peered":"2026-02-24T08:33:06.722209+0000","last_clean":"2026-02-24T08:33:06.722209+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:33:06.722209+0000","last_undegraded":"2026-02-24T08:33:06.722209+0000","last_fullsized":"2026-02-24T08:33:06.722209+0000","mapping_epoch":100,"log_start":"102'8900","ondisk_log_start":"102'8900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:07.572362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155451392,"num_objects":2372,"num_object_clones":0,"num_object_copies":7116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2372,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18976,"num_write_kb":151808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'18632","reported_seq":18646,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:07.003905+0000","last_change":"2026-02-24T08:31:59.852330+0000","last_active":"2026-02-24T08:33:07.003905+0000","last_peered":"2026-02-24T08:33:07.003905+0000","last_clean":"2026-02-24T08:33:07.003905+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:33:07.003905+0000","last_undegraded":"2026-02-24T08:33:07.003905+0000","last_fullsized":"2026-02-24T08:33:07.003905+0000","mapping_epoch":100,"log_start":"102'8600","ondisk_log_start":"102'8600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:12.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152633344,"num_objects":2329,"num_object_clones":0,"num_object_copies":6987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18632,"num_write_kb":149056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"102'17944","reported_seq":17958,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.324159+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:33:06.324159+0000","last_peered":"2026-02-24T08:33:06.324159+0000","last_clean":"2026-02-24T08:33:06.324159+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:33:06.324159+0000","last_undegraded":"2026-02-24T08:33:06.324159+0000","last_fullsized":"2026-02-24T08:33:06.324159+0000","mapping_epoch":100,"log_start":"102'7900","ondisk_log_start":"102'7900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146997248,"num_objects":2243,"num_object_clones":0,"num_object_copies":6729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17944,"num_write_kb":143552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'18079","reported_seq":18090,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:07.012384+0000","last_change":"2026-02-24T08:31:59.852686+0000","last_active":"2026-02-24T08:33:07.012384+0000","last_peered":"2026-02-24T08:33:07.012384+0000","last_clean":"2026-02-24T08:33:07.012384+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:33:07.012384+0000","last_undegraded":"2026-02-24T08:33:07.012384+0000","last_fullsized":"2026-02-24T08:33:07.012384+0000","mapping_epoch":100,"log_start":"102'8000","ondisk_log_start":"102'8000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:16.520309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148103168,"num_objects":2260,"num_object_clones":0,"num_object_copies":6780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2260,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18079,"num_write_kb":144632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"102'18720","reported_seq":18733,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.769047+0000","last_change":"2026-02-24T08:31:59.854212+0000","last_active":"2026-02-24T08:33:06.769047+0000","last_peered":"2026-02-24T08:33:06.769047+0000","last_clean":"2026-02-24T08:33:06.769047+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:33:06.769047+0000","last_undegraded":"2026-02-24T08:33:06.769047+0000","last_fullsized":"2026-02-24T08:33:06.769047+0000","mapping_epoch":100,"log_start":"102'8700","ondisk_log_start":"102'8700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:24.238297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153354240,"num_objects":2340,"num_object_clones":0,"num_object_copies":7020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2340,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18720,"num_write_kb":149760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"102'18468","reported_seq":18478,"reported_epoch":102,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:33:06.331959+0000","last_change":"2026-02-24T08:33:06.045473+0000","last_active":"2026-02-24T08:33:06.331959+0000","last_peered":"2026-02-24T08:33:06.331959+0000","last_clean":"2026-02-24T08:33:06.331959+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:33:06.331959+0000","last_undegraded":"2026-02-24T08:33:06.331959+0000","last_fullsized":"2026-02-24T08:33:06.331959+0000","mapping_epoch":100,"log_start":"102'8400","ondisk_log_start":"102'8400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":299,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151289856,"num_objects":2309,"num_object_clones":0,"num_object_copies":6927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18468,"num_write_kb":147744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"102'18460","reported_seq":18469,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.349922+0000","last_change":"2026-02-24T08:31:59.856513+0000","last_active":"2026-02-24T08:33:06.349922+0000","last_peered":"2026-02-24T08:33:06.349922+0000","last_clean":"2026-02-24T08:33:06.349922+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:33:06.349922+0000","last_undegraded":"2026-02-24T08:33:06.349922+0000","last_fullsized":"2026-02-24T08:33:06.349922+0000","mapping_epoch":100,"log_start":"102'8400","ondisk_log_start":"102'8400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:09.276792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151224320,"num_objects":2308,"num_object_clones":0,"num_object_copies":6924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2308,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18460,"num_write_kb":147680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'18021","reported_seq":18031,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:07.015077+0000","last_change":"2026-02-24T08:31:59.854560+0000","last_active":"2026-02-24T08:33:07.015077+0000","last_peered":"2026-02-24T08:33:07.015077+0000","last_clean":"2026-02-24T08:33:07.015077+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:33:07.015077+0000","last_undegraded":"2026-02-24T08:33:07.015077+0000","last_fullsized":"2026-02-24T08:33:07.015077+0000","mapping_epoch":100,"log_start":"102'8000","ondisk_log_start":"102'8000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:19.422928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147628032,"num_objects":2253,"num_object_clones":0,"num_object_copies":6759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2253,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18021,"num_write_kb":144168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"102'18208","reported_seq":18222,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.317598+0000","last_change":"2026-02-24T08:31:59.855084+0000","last_active":"2026-02-24T08:33:06.317598+0000","last_peered":"2026-02-24T08:33:06.317598+0000","last_clean":"2026-02-24T08:33:06.317598+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:33:06.317598+0000","last_undegraded":"2026-02-24T08:33:06.317598+0000","last_fullsized":"2026-02-24T08:33:06.317598+0000","mapping_epoch":100,"log_start":"102'8200","ondisk_log_start":"102'8200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:20.596585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149159936,"num_objects":2276,"num_object_clones":0,"num_object_copies":6828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2276,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18208,"num_write_kb":145664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'18036","reported_seq":18076,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:07.011689+0000","last_change":"2026-02-24T08:33:02.502815+0000","last_active":"2026-02-24T08:33:07.011689+0000","last_peered":"2026-02-24T08:33:07.011689+0000","last_clean":"2026-02-24T08:33:07.011689+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:33:07.011689+0000","last_undegraded":"2026-02-24T08:33:07.011689+0000","last_fullsized":"2026-02-24T08:33:07.011689+0000","mapping_epoch":100,"log_start":"102'8000","ondisk_log_start":"102'8000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17136","last_scrub_stamp":"2026-02-24T08:33:02.502774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:02.502774+0000","objects_scrubbed":2130,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.676850+0000","scrub_duration":986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147750912,"num_objects":2255,"num_object_clones":0,"num_object_copies":6765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2255,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18036,"num_write_kb":144288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'18184","reported_seq":18198,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:07.005782+0000","last_change":"2026-02-24T08:31:59.854291+0000","last_active":"2026-02-24T08:33:07.005782+0000","last_peered":"2026-02-24T08:33:07.005782+0000","last_clean":"2026-02-24T08:33:07.005782+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:33:07.005782+0000","last_undegraded":"2026-02-24T08:33:07.005782+0000","last_fullsized":"2026-02-24T08:33:07.005782+0000","mapping_epoch":100,"log_start":"102'8100","ondisk_log_start":"102'8100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:17.273593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148963328,"num_objects":2273,"num_object_clones":0,"num_object_copies":6819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2273,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18184,"num_write_kb":145472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"102'17648","reported_seq":17691,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:06.218356+0000","last_change":"2026-02-24T08:33:00.610675+0000","last_active":"2026-02-24T08:33:06.218356+0000","last_peered":"2026-02-24T08:33:06.218356+0000","last_clean":"2026-02-24T08:33:06.218356+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:33:06.218356+0000","last_undegraded":"2026-02-24T08:33:06.218356+0000","last_fullsized":"2026-02-24T08:33:06.218356+0000","mapping_epoch":100,"log_start":"102'7600","ondisk_log_start":"102'7600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'16512","last_scrub_stamp":"2026-02-24T08:33:00.610606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:00.610606+0000","objects_scrubbed":2041,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:28.134694+0000","scrub_duration":1365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144572416,"num_objects":2206,"num_object_clones":0,"num_object_copies":6618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17648,"num_write_kb":141184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":281,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.098242+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:32:51.098242+0000","last_peered":"2026-02-24T08:32:51.098242+0000","last_clean":"2026-02-24T08:32:51.098242+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:32:51.098242+0000","last_undegraded":"2026-02-24T08:32:51.098242+0000","last_fullsized":"2026-02-24T08:32:51.098242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2383478784,"num_objects":36371,"num_object_clones":0,"num_object_copies":109113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290952,"num_write_kb":2327616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7142686720,"data_stored":7142686720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160652,"ondisk_log_size":160652,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247963,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2501632,"kb_used_data":1738476,"kb_used_omap":6,"kb_used_meta":763129,"kb_avail":731501568,"statfs":{"total":751619276800,"available":749057605632,"internally_reserved":0,"allocated":1780199424,"data_stored":1779523532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6157,"internal_metadata":781445107},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,4,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2529744,"kb_used_data":1736892,"kb_used_omap":5,"kb_used_meta":792826,"kb_avail":731473456,"statfs":{"total":751619276800,"available":749028818944,"internally_reserved":0,"allocated":1778577408,"data_stored":1777901516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6131,"internal_metadata":811853837},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,7,4,1,0,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2215436,"kb_used_data":1593336,"kb_used_omap":5,"kb_used_meta":622074,"kb_avail":731787764,"statfs":{"total":751619276800,"available":749350670336,"internally_reserved":0,"allocated":1631576064,"data_stored":1630903724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6128,"internal_metadata":637003792},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705825,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2833432,"kb_used_data":1892356,"kb_used_omap":6,"kb_used_meta":941049,"kb_avail":731169768,"statfs":{"total":751619276800,"available":748717842432,"internally_reserved":0,"allocated":1937772544,"data_stored":1937096652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6794,"internal_metadata":963634550},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1936711680,"data_stored":1936711680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1641979904,"data_stored":1641979904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1780260864,"data_stored":1780260864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1783734272,"data_stored":1783734272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:33:11.839 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 271 2026-02-24T08:33:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:11 trial105 ceph-mon[39442]: pgmap v460: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.2 GiB data, 9.6 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.77k op/s 2026-02-24T08:33:11.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:11 trial105 ceph-mon[39442]: 8.4 scrub starts 2026-02-24T08:33:11.949 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 71 128 309139 309011 33.999 26.625 0.067027 0.0293927 2026-02-24T08:33:11.986 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:12.119 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:12.117+0000 7f52440c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:12.120 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:12.117+0000 7f52440c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:12.281 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:33:12.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:33:12.885 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:12.949 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 72 128 312427 312299 33.8835 25.6875 0.0483624 0.0294998 2026-02-24T08:33:13.038 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:13.107 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:12 trial105 ceph-mon[39442]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:13.108 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:12 trial105 ceph-mon[39442]: 8.f scrub starts 2026-02-24T08:33:13.108 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:12 trial105 ceph-mon[39442]: 8.4 scrub ok 2026-02-24T08:33:13.108 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:12 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2420457677' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "271"} : dispatch 2026-02-24T08:33:13.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:13.166+0000 7fb1e9300640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:13.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:13.166+0000 7fb1e9300640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:13.184 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:13.184 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:13.198 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:13.198 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:13.212 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:13.212 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:13.228 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:13.229 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:13.949 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 73 128 315772 315644 33.7773 26.1328 0.0209263 0.029584 2026-02-24T08:33:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:13 trial105 ceph-mon[39442]: 8.f scrub ok 2026-02-24T08:33:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:13 trial105 ceph-mon[39442]: pgmap v461: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.21k op/s 2026-02-24T08:33:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2879906513' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:14.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:13 trial105 ceph-mon[39442]: 8.a scrub starts 2026-02-24T08:33:14.949 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 74 128 319182 319054 33.6808 26.6406 0.0158096 0.0296781 2026-02-24T08:33:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:33:15.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:14 trial105 ceph-mon[39442]: 8.a scrub ok 2026-02-24T08:33:15.274 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:15.423 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:15.556 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:15.554+0000 7f12885f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:15.556 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:15.554+0000 7f12885f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:15.572 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:15.573 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:15.587 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:15.587 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:15.601 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:15.601 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:15.614 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:15.615 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:15.949 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 75 128 322162 322034 33.5422 23.2812 0.0225593 0.029794 2026-02-24T08:33:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:15 trial105 ceph-mon[39442]: pgmap v462: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.75k op/s 2026-02-24T08:33:16.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:15 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1578121397' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:16.949 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 76 128 325491 325363 33.443 26.0078 0.0166976 0.0298896 2026-02-24T08:33:17.325 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:33:17.325 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:33:17.326 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:33:17.326 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:17.470 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:17.602 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:17.599+0000 7fec7941a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:17.602 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:17.600+0000 7fec7941a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:17.754 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:33:17.754 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:33:17.802 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":463,"stamp":"2026-02-24T08:33:16.795504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2576835104,"num_objects":39316,"num_object_clones":0,"num_object_copies":117948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39316,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":314618,"num_write_kb":2518014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160782,"ondisk_log_size":160782,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10795956,"kb_used_data":7550436,"kb_used_omap":24,"kb_used_meta":3245415,"kb_avail":2925216844,"statfs":{"total":3006477107200,"available":2995422048256,"internally_reserved":0,"allocated":7731646464,"data_stored":7728946448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25210,"internal_metadata":3323305350},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,12,2,0,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":320888832,"num_objects":4897,"num_object_clones":0,"num_object_copies":14691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39171,"num_write_kb":313368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001762"},"pg_stats":[{"pgid":"8.f","version":"102'18836","reported_seq":18847,"reported_epoch":102,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:33:11.772050+0000","last_change":"2026-02-24T08:33:11.804749+0000","last_active":"2026-02-24T08:33:11.772050+0000","last_peered":"2026-02-24T08:33:11.772050+0000","last_clean":"2026-02-24T08:33:11.772050+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:33:11.772050+0000","last_undegraded":"2026-02-24T08:33:11.772050+0000","last_fullsized":"2026-02-24T08:33:11.772050+0000","mapping_epoch":100,"log_start":"102'8800","ondisk_log_start":"102'8800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154304512,"num_objects":2355,"num_object_clones":0,"num_object_copies":7065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18836,"num_write_kb":150688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"102'19528","reported_seq":19542,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:11.787922+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:33:11.787922+0000","last_peered":"2026-02-24T08:33:11.787922+0000","last_clean":"2026-02-24T08:33:11.787922+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:33:11.787922+0000","last_undegraded":"2026-02-24T08:33:11.787922+0000","last_fullsized":"2026-02-24T08:33:11.787922+0000","mapping_epoch":100,"log_start":"102'9500","ondisk_log_start":"102'9500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159973376,"num_objects":2441,"num_object_clones":0,"num_object_copies":7323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2441,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19528,"num_write_kb":156224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"102'19652","reported_seq":19695,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:16.339618+0000","last_change":"2026-02-24T08:33:05.192827+0000","last_active":"2026-02-24T08:33:16.339618+0000","last_peered":"2026-02-24T08:33:16.339618+0000","last_clean":"2026-02-24T08:33:16.339618+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:33:16.339618+0000","last_undegraded":"2026-02-24T08:33:16.339618+0000","last_fullsized":"2026-02-24T08:33:16.339618+0000","mapping_epoch":100,"log_start":"102'9600","ondisk_log_start":"102'9600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17536","last_scrub_stamp":"2026-02-24T08:33:05.192724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:05.192724+0000","objects_scrubbed":2178,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:18.812981+0000","scrub_duration":1000,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160989184,"num_objects":2457,"num_object_clones":0,"num_object_copies":7371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2457,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19652,"num_write_kb":157216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"102'18823","reported_seq":18832,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:11.792969+0000","last_change":"2026-02-24T08:31:59.854071+0000","last_active":"2026-02-24T08:33:11.792969+0000","last_peered":"2026-02-24T08:33:11.792969+0000","last_clean":"2026-02-24T08:33:11.792969+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:33:11.792969+0000","last_undegraded":"2026-02-24T08:33:11.792969+0000","last_fullsized":"2026-02-24T08:33:11.792969+0000","mapping_epoch":100,"log_start":"102'8800","ondisk_log_start":"102'8800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:18.460030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154198016,"num_objects":2353,"num_object_clones":0,"num_object_copies":7059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2353,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18823,"num_write_kb":150584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"102'19896","reported_seq":19942,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:11.777334+0000","last_change":"2026-02-24T08:33:08.865575+0000","last_active":"2026-02-24T08:33:11.777334+0000","last_peered":"2026-02-24T08:33:11.777334+0000","last_clean":"2026-02-24T08:33:11.777334+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:33:11.777334+0000","last_undegraded":"2026-02-24T08:33:11.777334+0000","last_fullsized":"2026-02-24T08:33:11.777334+0000","mapping_epoch":100,"log_start":"102'9800","ondisk_log_start":"102'9800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19384","last_scrub_stamp":"2026-02-24T08:33:08.865516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:08.865516+0000","objects_scrubbed":2420,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:25.957973+0000","scrub_duration":1087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162988032,"num_objects":2487,"num_object_clones":0,"num_object_copies":7461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2487,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19896,"num_write_kb":159168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'19851","reported_seq":19863,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:11.870299+0000","last_change":"2026-02-24T08:31:59.852330+0000","last_active":"2026-02-24T08:33:11.870299+0000","last_peered":"2026-02-24T08:33:11.870299+0000","last_clean":"2026-02-24T08:33:11.870299+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:33:11.870299+0000","last_undegraded":"2026-02-24T08:33:11.870299+0000","last_fullsized":"2026-02-24T08:33:11.870299+0000","mapping_epoch":100,"log_start":"102'9800","ondisk_log_start":"102'9800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:12.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162619392,"num_objects":2482,"num_object_clones":0,"num_object_copies":7446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2482,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19851,"num_write_kb":158808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"102'20112","reported_seq":20126,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:16.203552+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:33:16.203552+0000","last_peered":"2026-02-24T08:33:16.203552+0000","last_clean":"2026-02-24T08:33:16.203552+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:33:16.203552+0000","last_undegraded":"2026-02-24T08:33:16.203552+0000","last_fullsized":"2026-02-24T08:33:16.203552+0000","mapping_epoch":100,"log_start":"102'10100","ondisk_log_start":"102'10100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164757504,"num_objects":2514,"num_object_clones":0,"num_object_copies":7542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20112,"num_write_kb":160896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'19024","reported_seq":19038,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:12.006246+0000","last_change":"2026-02-24T08:31:59.852686+0000","last_active":"2026-02-24T08:33:12.006246+0000","last_peered":"2026-02-24T08:33:12.006246+0000","last_clean":"2026-02-24T08:33:12.006246+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:33:12.006246+0000","last_undegraded":"2026-02-24T08:33:12.006246+0000","last_fullsized":"2026-02-24T08:33:12.006246+0000","mapping_epoch":100,"log_start":"102'9000","ondisk_log_start":"102'9000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:16.520309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155844608,"num_objects":2378,"num_object_clones":0,"num_object_copies":7134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2378,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19024,"num_write_kb":152192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"102'19720","reported_seq":19734,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:11.756276+0000","last_change":"2026-02-24T08:31:59.854212+0000","last_active":"2026-02-24T08:33:11.756276+0000","last_peered":"2026-02-24T08:33:11.756276+0000","last_clean":"2026-02-24T08:33:11.756276+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:33:11.756276+0000","last_undegraded":"2026-02-24T08:33:11.756276+0000","last_fullsized":"2026-02-24T08:33:11.756276+0000","mapping_epoch":100,"log_start":"102'9700","ondisk_log_start":"102'9700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:24.238297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161546240,"num_objects":2465,"num_object_clones":0,"num_object_copies":7395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2465,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19720,"num_write_kb":157760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"102'20477","reported_seq":20512,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:16.345822+0000","last_change":"2026-02-24T08:33:06.806177+0000","last_active":"2026-02-24T08:33:16.345822+0000","last_peered":"2026-02-24T08:33:16.345822+0000","last_clean":"2026-02-24T08:33:16.345822+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:33:16.345822+0000","last_undegraded":"2026-02-24T08:33:16.345822+0000","last_fullsized":"2026-02-24T08:33:16.345822+0000","mapping_epoch":100,"log_start":"102'10400","ondisk_log_start":"102'10400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18536","last_scrub_stamp":"2026-02-24T08:33:06.806078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:06.806078+0000","objects_scrubbed":2313,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:19.273551+0000","scrub_duration":761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167747584,"num_objects":2560,"num_object_clones":0,"num_object_copies":7680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20477,"num_write_kb":163816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"102'20752","reported_seq":20798,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:16.366397+0000","last_change":"2026-02-24T08:33:12.060340+0000","last_active":"2026-02-24T08:33:16.366397+0000","last_peered":"2026-02-24T08:33:16.366397+0000","last_clean":"2026-02-24T08:33:16.366397+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:33:16.366397+0000","last_undegraded":"2026-02-24T08:33:16.366397+0000","last_fullsized":"2026-02-24T08:33:16.366397+0000","mapping_epoch":100,"log_start":"102'10700","ondisk_log_start":"102'10700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19736","last_scrub_stamp":"2026-02-24T08:33:12.060280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.060280+0000","objects_scrubbed":2462,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:16.715777+0000","scrub_duration":662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170000384,"num_objects":2594,"num_object_clones":0,"num_object_copies":7782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20752,"num_write_kb":166016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'19202","reported_seq":19210,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:12.026342+0000","last_change":"2026-02-24T08:31:59.854560+0000","last_active":"2026-02-24T08:33:12.026342+0000","last_peered":"2026-02-24T08:33:12.026342+0000","last_clean":"2026-02-24T08:33:12.026342+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:33:12.026342+0000","last_undegraded":"2026-02-24T08:33:12.026342+0000","last_fullsized":"2026-02-24T08:33:12.026342+0000","mapping_epoch":100,"log_start":"102'9200","ondisk_log_start":"102'9200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:19.422928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157302784,"num_objects":2401,"num_object_clones":0,"num_object_copies":7203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2401,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19202,"num_write_kb":153616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"102'20256","reported_seq":20267,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:16.367876+0000","last_change":"2026-02-24T08:31:59.855084+0000","last_active":"2026-02-24T08:33:16.367876+0000","last_peered":"2026-02-24T08:33:16.367876+0000","last_clean":"2026-02-24T08:33:16.367876+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:33:16.367876+0000","last_undegraded":"2026-02-24T08:33:16.367876+0000","last_fullsized":"2026-02-24T08:33:16.367876+0000","mapping_epoch":100,"log_start":"102'10200","ondisk_log_start":"102'10200","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:20.596585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165937152,"num_objects":2532,"num_object_clones":0,"num_object_copies":7596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20256,"num_write_kb":162048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'19074","reported_seq":19119,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:11.989314+0000","last_change":"2026-02-24T08:33:02.502815+0000","last_active":"2026-02-24T08:33:11.989314+0000","last_peered":"2026-02-24T08:33:11.989314+0000","last_clean":"2026-02-24T08:33:11.989314+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:33:11.989314+0000","last_undegraded":"2026-02-24T08:33:11.989314+0000","last_fullsized":"2026-02-24T08:33:11.989314+0000","mapping_epoch":100,"log_start":"102'9000","ondisk_log_start":"102'9000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17136","last_scrub_stamp":"2026-02-24T08:33:02.502774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:02.502774+0000","objects_scrubbed":2130,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.676850+0000","scrub_duration":986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156254208,"num_objects":2385,"num_object_clones":0,"num_object_copies":7155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19074,"num_write_kb":152592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'19368","reported_seq":19382,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:12.011689+0000","last_change":"2026-02-24T08:31:59.854291+0000","last_active":"2026-02-24T08:33:12.011689+0000","last_peered":"2026-02-24T08:33:12.011689+0000","last_clean":"2026-02-24T08:33:12.011689+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:33:12.011689+0000","last_undegraded":"2026-02-24T08:33:12.011689+0000","last_fullsized":"2026-02-24T08:33:12.011689+0000","mapping_epoch":100,"log_start":"102'9300","ondisk_log_start":"102'9300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:17.273593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158662656,"num_objects":2421,"num_object_clones":0,"num_object_copies":7263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2421,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19368,"num_write_kb":154944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"102'19912","reported_seq":19950,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:16.380019+0000","last_change":"2026-02-24T08:33:00.610675+0000","last_active":"2026-02-24T08:33:16.380019+0000","last_peered":"2026-02-24T08:33:16.380019+0000","last_clean":"2026-02-24T08:33:16.380019+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:33:16.380019+0000","last_undegraded":"2026-02-24T08:33:16.380019+0000","last_fullsized":"2026-02-24T08:33:16.380019+0000","mapping_epoch":100,"log_start":"102'9900","ondisk_log_start":"102'9900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'16512","last_scrub_stamp":"2026-02-24T08:33:00.610606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:00.610606+0000","objects_scrubbed":2041,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:28.134694+0000","scrub_duration":1365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163119104,"num_objects":2489,"num_object_clones":0,"num_object_copies":7467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2489,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19912,"num_write_kb":159296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":281,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:32:51.098242+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:32:51.098242+0000","last_peered":"2026-02-24T08:32:51.098242+0000","last_clean":"2026-02-24T08:32:51.098242+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:32:51.098242+0000","last_undegraded":"2026-02-24T08:32:51.098242+0000","last_fullsized":"2026-02-24T08:32:51.098242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2576244736,"num_objects":39314,"num_object_clones":0,"num_object_copies":117942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314483,"num_write_kb":2515864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7769939968,"data_stored":7769939968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160683,"ondisk_log_size":160683,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247965,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2755176,"kb_used_data":1937876,"kb_used_omap":6,"kb_used_meta":817273,"kb_avail":731248024,"statfs":{"total":751619276800,"available":748797976576,"internally_reserved":0,"allocated":1984385024,"data_stored":1983709132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6157,"internal_metadata":836888563},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444191,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2767760,"kb_used_data":1938812,"kb_used_omap":5,"kb_used_meta":828922,"kb_avail":731235440,"statfs":{"total":751619276800,"available":748785090560,"internally_reserved":0,"allocated":1985343488,"data_stored":1984667596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6131,"internal_metadata":848816141},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,12,2,0,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2348876,"kb_used_data":1690680,"kb_used_omap":5,"kb_used_meta":658170,"kb_avail":731654324,"statfs":{"total":751619276800,"available":749214027776,"internally_reserved":0,"allocated":1731256320,"data_stored":1730583980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6128,"internal_metadata":673966096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705826,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2924144,"kb_used_data":1983068,"kb_used_omap":6,"kb_used_meta":941049,"kb_avail":731079056,"statfs":{"total":751619276800,"available":748624953344,"internally_reserved":0,"allocated":2030661632,"data_stored":2029985740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6794,"internal_metadata":963634550},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2051956736,"data_stored":2051956736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1740619776,"data_stored":1740619776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1986854912,"data_stored":1986854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1990508544,"data_stored":1990508544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:33:17.805 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:33:17.805 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 281 2026-02-24T08:33:17.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 77 128 328744 328616 33.3385 25.4141 0.0197641 0.0299857 2026-02-24T08:33:17.959 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:18.040 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:18.095 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:18.093+0000 7f8fec7cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:18.095 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:18.093+0000 7f8fec7cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:17 trial105 ceph-mon[39442]: pgmap v463: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.4 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.26k op/s 2026-02-24T08:33:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:17 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:33:18.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:17 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:33:18.191 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:18.256 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:33:18.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:33:18.324 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:18.321+0000 7f31696c7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:18.324 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:18.322+0000 7f31696c7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:18.339 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:18.340 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:18.354 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:18.354 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:18.369 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:18.369 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:18.384 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:18.384 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:18.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 78 128 332056 331928 33.2427 25.875 0.0315112 0.0300635 2026-02-24T08:33:19.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:18 trial105 ceph-mon[39442]: from='client.15590 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:19.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2639924566' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "281"} : dispatch 2026-02-24T08:33:19.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3789639955' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:19.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:18 trial105 ceph-mon[39442]: 8.7 scrub starts 2026-02-24T08:33:19.865 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:33:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:33:19] "GET /metrics HTTP/1.1" 200 4221 "" "Prometheus/3.6.0" 2026-02-24T08:33:19.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:33:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:33:19.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:33:19.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 79 127 335515 335388 33.1641 27.0312 0.0646436 0.0301427 2026-02-24T08:33:20.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:19 trial105 ceph-mon[39442]: pgmap v464: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.20k op/s 2026-02-24T08:33:20.437 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:20.594 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:20.743 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:20.740+0000 7fbe6bbc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:20.743 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:20.740+0000 7fbe6bbc3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:20.758 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:20.759 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:20.775 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:20.775 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:20.790 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:20.790 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:20.806 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:20.807 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:20.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:33:20.949003+0000 min lat: 0.000762728 max lat: 0.292776 avg lat: 0.0302375 2026-02-24T08:33:20.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:33:20.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 80 128 338697 338569 33.0602 24.8516 0.0699681 0.0302375 2026-02-24T08:33:21.098 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:20 trial105 ceph-mon[39442]: 8.0 scrub starts 2026-02-24T08:33:21.098 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:20 trial105 ceph-mon[39442]: 8.7 scrub ok 2026-02-24T08:33:21.098 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:20 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/640599951' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:21.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 81 128 341941 341813 32.9649 25.3438 0.0448956 0.030326 2026-02-24T08:33:22.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:21 trial105 ceph-mon[39442]: pgmap v465: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.80k op/s 2026-02-24T08:33:22.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:21 trial105 ceph-mon[39442]: 8.2 scrub starts 2026-02-24T08:33:22.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:21 trial105 ceph-mon[39442]: 8.0 scrub ok 2026-02-24T08:33:22.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:21 trial105 ceph-mon[39442]: 8.3 scrub starts 2026-02-24T08:33:22.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 82 128 345357 345229 32.8883 26.6875 0.0160432 0.0303915 2026-02-24T08:33:23.145 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:23.170 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:22 trial105 ceph-mon[39442]: 8.2 scrub ok 2026-02-24T08:33:23.170 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:22 trial105 ceph-mon[39442]: 8.c scrub starts 2026-02-24T08:33:23.290 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:23.305 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:33:23.306 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:33:23.434 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:23.430+0000 7fbb1c486640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:23.434 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:23.430+0000 7fbb1c486640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:23.452 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:23.452 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:23.468 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:23.468 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:23.470 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:23.482 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:23.482 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:23.496 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:23.497 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:23.599 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:23.596+0000 7fee19cff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:23.599 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:23.596+0000 7fee19cff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:23.873 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:33:23.925 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:33:23.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 83 128 348470 348342 32.785 24.3203 0.100167 0.0304916 2026-02-24T08:33:24.087 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:24.134 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:23 trial105 ceph-mon[39442]: 8.c scrub ok 2026-02-24T08:33:24.134 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:23 trial105 ceph-mon[39442]: 8.3 scrub ok 2026-02-24T08:33:24.134 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:23 trial105 ceph-mon[39442]: pgmap v466: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.18k op/s 2026-02-24T08:33:24.134 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2555339053' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:24.134 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3604351016' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:33:24.204 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:24.202+0000 7fe9e2dbb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:24.205 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:24.203+0000 7fe9e2dbb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:24.876 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:33:24.925 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:33:24.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 84 128 351673 351545 32.6926 25.0234 0.0705876 0.0305717 2026-02-24T08:33:25.101 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:25.130 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3604351016' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:33:25.130 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:24 trial105 ceph-mon[39442]: osdmap e103: 4 total, 4 up, 4 in 2026-02-24T08:33:25.130 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:24 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1213417684' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:33:25.230 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:25.227+0000 7f5b807e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:25.230 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:25.227+0000 7f5b807e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:25.555 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:25.702 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:25.819 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:25.816+0000 7ff288b52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:25.819 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:25.817+0000 7ff288b52640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:25.836 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:25.836 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:25.850 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:25.850 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:25.866 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:25.866 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:25.879 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:33:25.881 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:25.881 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:25.929 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:33:25.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 85 128 354859 354731 32.6008 24.8906 0.0227408 0.0306651 2026-02-24T08:33:26.100 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:26.129 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:25 trial105 ceph-mon[39442]: pgmap v468: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.28k op/s 2026-02-24T08:33:26.129 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1213417684' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:33:26.130 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:25 trial105 ceph-mon[39442]: osdmap e104: 4 total, 4 up, 4 in 2026-02-24T08:33:26.130 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3456572636' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:33:26.130 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3089503155' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:26.234 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:26.231+0000 7fa37ec5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:26.234 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:26.232+0000 7fa37ec5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:26.881 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:33:26.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 86 128 358056 357928 32.5121 24.9766 0.0437031 0.0307399 2026-02-24T08:33:27.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:26 trial105 ceph-mon[39442]: 8.6 scrub starts 2026-02-24T08:33:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3456572636' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:33:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:26 trial105 ceph-mon[39442]: osdmap e105: 4 total, 4 up, 4 in 2026-02-24T08:33:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3999256462' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:33:27.345 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:33:27.345 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:27.485 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:27.611 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:27.608+0000 7fbebcdf6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:27.611 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:27.609+0000 7fbebcdf6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:27.759 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:33:27.760 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:33:27.809 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":472,"stamp":"2026-02-24T08:33:26.880225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2886861344,"num_objects":44045,"num_object_clones":0,"num_object_copies":132135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44045,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":352463,"num_write_kb":2820774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160927,"ondisk_log_size":160927,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11950552,"kb_used_data":8452344,"kb_used_omap":30,"kb_used_meta":3498081,"kb_avail":2924062248,"statfs":{"total":3006477107200,"available":2994239741952,"internally_reserved":0,"allocated":8655200256,"data_stored":8652429329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31730,"internal_metadata":3582034958},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,4,16,12,26,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":91979776,"num_objects":1402,"num_object_clones":0,"num_object_copies":4206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11228,"num_write_kb":89824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.083814"},"pg_stats":[{"pgid":"8.f","version":"105'22032","reported_seq":22084,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.847347+0000","last_change":"2026-02-24T08:33:12.558481+0000","last_active":"2026-02-24T08:33:26.847347+0000","last_peered":"2026-02-24T08:33:26.847347+0000","last_clean":"2026-02-24T08:33:26.847347+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:33:26.847347+0000","last_undegraded":"2026-02-24T08:33:26.847347+0000","last_fullsized":"2026-02-24T08:33:26.847347+0000","mapping_epoch":100,"log_start":"102'12000","ondisk_log_start":"102'12000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18952","last_scrub_stamp":"2026-02-24T08:33:12.558422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.558422+0000","objects_scrubbed":2367,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:14.407330+0000","scrub_duration":724,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180486144,"num_objects":2754,"num_object_clones":0,"num_object_copies":8262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22032,"num_write_kb":176256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"105'22560","reported_seq":22580,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.842811+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:33:26.842811+0000","last_peered":"2026-02-24T08:33:26.842811+0000","last_clean":"2026-02-24T08:33:26.842811+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:33:26.842811+0000","last_undegraded":"2026-02-24T08:33:26.842811+0000","last_fullsized":"2026-02-24T08:33:26.842811+0000","mapping_epoch":100,"log_start":"102'12500","ondisk_log_start":"102'12500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184811520,"num_objects":2820,"num_object_clones":0,"num_object_copies":8460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22560,"num_write_kb":180480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"105'21816","reported_seq":21865,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.401217+0000","last_change":"2026-02-24T08:33:05.192827+0000","last_active":"2026-02-24T08:33:26.401217+0000","last_peered":"2026-02-24T08:33:26.401217+0000","last_clean":"2026-02-24T08:33:26.401217+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:33:26.401217+0000","last_undegraded":"2026-02-24T08:33:26.401217+0000","last_fullsized":"2026-02-24T08:33:26.401217+0000","mapping_epoch":100,"log_start":"102'11800","ondisk_log_start":"102'11800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17536","last_scrub_stamp":"2026-02-24T08:33:05.192724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:05.192724+0000","objects_scrubbed":2178,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:18.812981+0000","scrub_duration":1000,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178716672,"num_objects":2727,"num_object_clones":0,"num_object_copies":8181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21816,"num_write_kb":174528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"105'22088","reported_seq":22143,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.747035+0000","last_change":"2026-02-24T08:33:22.777449+0000","last_active":"2026-02-24T08:33:26.747035+0000","last_peered":"2026-02-24T08:33:26.747035+0000","last_clean":"2026-02-24T08:33:26.747035+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:33:26.747035+0000","last_undegraded":"2026-02-24T08:33:26.747035+0000","last_fullsized":"2026-02-24T08:33:26.747035+0000","mapping_epoch":100,"log_start":"102'12000","ondisk_log_start":"102'12000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21224","last_scrub_stamp":"2026-02-24T08:33:22.777398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:22.777398+0000","objects_scrubbed":2638,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:49.901561+0000","scrub_duration":805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":8283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22088,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"105'22872","reported_seq":22920,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.861433+0000","last_change":"2026-02-24T08:33:08.865575+0000","last_active":"2026-02-24T08:33:26.861433+0000","last_peered":"2026-02-24T08:33:26.861433+0000","last_clean":"2026-02-24T08:33:26.861433+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:33:26.861433+0000","last_undegraded":"2026-02-24T08:33:26.861433+0000","last_fullsized":"2026-02-24T08:33:26.861433+0000","mapping_epoch":100,"log_start":"102'12800","ondisk_log_start":"102'12800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19384","last_scrub_stamp":"2026-02-24T08:33:08.865516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:08.865516+0000","objects_scrubbed":2420,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:25.957973+0000","scrub_duration":1087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187367424,"num_objects":2859,"num_object_clones":0,"num_object_copies":8577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22872,"num_write_kb":182976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'21816","reported_seq":21863,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:21.930166+0000","last_change":"2026-02-24T08:33:14.065578+0000","last_active":"2026-02-24T08:33:21.930166+0000","last_peered":"2026-02-24T08:33:21.930166+0000","last_clean":"2026-02-24T08:33:21.930166+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:33:21.930166+0000","last_undegraded":"2026-02-24T08:33:21.930166+0000","last_fullsized":"2026-02-24T08:33:21.930166+0000","mapping_epoch":100,"log_start":"102'11800","ondisk_log_start":"102'11800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20176","last_scrub_stamp":"2026-02-24T08:33:14.065505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:14.065505+0000","objects_scrubbed":2513,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.447959+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178716672,"num_objects":2727,"num_object_clones":0,"num_object_copies":8181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21816,"num_write_kb":174528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"105'21968","reported_seq":21988,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.414082+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:33:26.414082+0000","last_peered":"2026-02-24T08:33:26.414082+0000","last_clean":"2026-02-24T08:33:26.414082+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:33:26.414082+0000","last_undegraded":"2026-02-24T08:33:26.414082+0000","last_fullsized":"2026-02-24T08:33:26.414082+0000","mapping_epoch":100,"log_start":"102'11900","ondisk_log_start":"102'11900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179961856,"num_objects":2746,"num_object_clones":0,"num_object_copies":8238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21968,"num_write_kb":175744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'21030","reported_seq":21078,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:22.042893+0000","last_change":"2026-02-24T08:33:20.588017+0000","last_active":"2026-02-24T08:33:22.042893+0000","last_peered":"2026-02-24T08:33:22.042893+0000","last_clean":"2026-02-24T08:33:22.042893+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:33:22.042893+0000","last_undegraded":"2026-02-24T08:33:22.042893+0000","last_fullsized":"2026-02-24T08:33:22.042893+0000","mapping_epoch":100,"log_start":"102'11000","ondisk_log_start":"102'11000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20704","last_scrub_stamp":"2026-02-24T08:33:20.587976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:20.587976+0000","objects_scrubbed":2557,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:27.431033+0000","scrub_duration":2005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172277760,"num_objects":2629,"num_object_clones":0,"num_object_copies":7887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21030,"num_write_kb":168240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"105'22936","reported_seq":22985,"reported_epoch":105,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:33:26.862586+0000","last_change":"2026-02-24T08:33:24.943943+0000","last_active":"2026-02-24T08:33:26.862586+0000","last_peered":"2026-02-24T08:33:26.862586+0000","last_clean":"2026-02-24T08:33:26.862586+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:33:26.862586+0000","last_undegraded":"2026-02-24T08:33:26.862586+0000","last_fullsized":"2026-02-24T08:33:26.862586+0000","mapping_epoch":100,"log_start":"102'12900","ondisk_log_start":"102'12900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":2853,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187891712,"num_objects":2867,"num_object_clones":0,"num_object_copies":8601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22936,"num_write_kb":183488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"105'22568","reported_seq":22614,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.362984+0000","last_change":"2026-02-24T08:33:06.806177+0000","last_active":"2026-02-24T08:33:26.362984+0000","last_peered":"2026-02-24T08:33:26.362984+0000","last_clean":"2026-02-24T08:33:26.362984+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:33:26.362984+0000","last_undegraded":"2026-02-24T08:33:26.362984+0000","last_fullsized":"2026-02-24T08:33:26.362984+0000","mapping_epoch":100,"log_start":"102'12500","ondisk_log_start":"102'12500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18536","last_scrub_stamp":"2026-02-24T08:33:06.806078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:06.806078+0000","objects_scrubbed":2313,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:19.273551+0000","scrub_duration":761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184877056,"num_objects":2821,"num_object_clones":0,"num_object_copies":8463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22568,"num_write_kb":180544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"105'22544","reported_seq":22596,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.403183+0000","last_change":"2026-02-24T08:33:12.060340+0000","last_active":"2026-02-24T08:33:26.403183+0000","last_peered":"2026-02-24T08:33:26.403183+0000","last_clean":"2026-02-24T08:33:26.403183+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:33:26.403183+0000","last_undegraded":"2026-02-24T08:33:26.403183+0000","last_fullsized":"2026-02-24T08:33:26.403183+0000","mapping_epoch":100,"log_start":"102'12500","ondisk_log_start":"102'12500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19736","last_scrub_stamp":"2026-02-24T08:33:12.060280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.060280+0000","objects_scrubbed":2462,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:16.715777+0000","scrub_duration":662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184680448,"num_objects":2818,"num_object_clones":0,"num_object_copies":8454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2818,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22544,"num_write_kb":180352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'21424","reported_seq":21451,"reported_epoch":102,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:33:22.057629+0000","last_change":"2026-02-24T08:33:21.572479+0000","last_active":"2026-02-24T08:33:22.057629+0000","last_peered":"2026-02-24T08:33:22.057629+0000","last_clean":"2026-02-24T08:33:22.057629+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:33:22.057629+0000","last_undegraded":"2026-02-24T08:33:22.057629+0000","last_fullsized":"2026-02-24T08:33:22.057629+0000","mapping_epoch":100,"log_start":"102'11400","ondisk_log_start":"102'11400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":899,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175505408,"num_objects":2678,"num_object_clones":0,"num_object_copies":8034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21424,"num_write_kb":171392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"105'22188","reported_seq":22240,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.385105+0000","last_change":"2026-02-24T08:33:21.899212+0000","last_active":"2026-02-24T08:33:26.385105+0000","last_peered":"2026-02-24T08:33:26.385105+0000","last_clean":"2026-02-24T08:33:26.385105+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:33:26.385105+0000","last_undegraded":"2026-02-24T08:33:26.385105+0000","last_fullsized":"2026-02-24T08:33:26.385105+0000","mapping_epoch":100,"log_start":"102'12100","ondisk_log_start":"102'12100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21392","last_scrub_stamp":"2026-02-24T08:33:21.899145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.899145+0000","objects_scrubbed":2668,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:43.261018+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181764096,"num_objects":2774,"num_object_clones":0,"num_object_copies":8322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2774,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22188,"num_write_kb":177504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'21042","reported_seq":21080,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:22.046013+0000","last_change":"2026-02-24T08:33:02.502815+0000","last_active":"2026-02-24T08:33:22.046013+0000","last_peered":"2026-02-24T08:33:22.046013+0000","last_clean":"2026-02-24T08:33:22.046013+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:33:22.046013+0000","last_undegraded":"2026-02-24T08:33:22.046013+0000","last_fullsized":"2026-02-24T08:33:22.046013+0000","mapping_epoch":100,"log_start":"102'11000","ondisk_log_start":"102'11000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17136","last_scrub_stamp":"2026-02-24T08:33:02.502774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:02.502774+0000","objects_scrubbed":2130,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.676850+0000","scrub_duration":986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172376064,"num_objects":2631,"num_object_clones":0,"num_object_copies":7893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21042,"num_write_kb":168336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'21344","reported_seq":21393,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:22.001784+0000","last_change":"2026-02-24T08:33:21.507517+0000","last_active":"2026-02-24T08:33:22.001784+0000","last_peered":"2026-02-24T08:33:22.001784+0000","last_clean":"2026-02-24T08:33:22.001784+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:33:22.001784+0000","last_undegraded":"2026-02-24T08:33:22.001784+0000","last_fullsized":"2026-02-24T08:33:22.001784+0000","mapping_epoch":100,"log_start":"102'11300","ondisk_log_start":"102'11300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21274","last_scrub_stamp":"2026-02-24T08:33:21.507423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.507423+0000","objects_scrubbed":2641,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:40.355136+0000","scrub_duration":933,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174850048,"num_objects":2668,"num_object_clones":0,"num_object_copies":8004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21344,"num_write_kb":170752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"105'22100","reported_seq":22147,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.416194+0000","last_change":"2026-02-24T08:33:00.610675+0000","last_active":"2026-02-24T08:33:26.416194+0000","last_peered":"2026-02-24T08:33:26.416194+0000","last_clean":"2026-02-24T08:33:26.416194+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:33:26.416194+0000","last_undegraded":"2026-02-24T08:33:26.416194+0000","last_fullsized":"2026-02-24T08:33:26.416194+0000","mapping_epoch":100,"log_start":"102'12000","ondisk_log_start":"102'12000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'16512","last_scrub_stamp":"2026-02-24T08:33:00.610606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:00.610606+0000","objects_scrubbed":2041,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:28.134694+0000","scrub_duration":1365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181043200,"num_objects":2763,"num_object_clones":0,"num_object_copies":8289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22100,"num_write_kb":176800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":287,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:25.879196+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:25.879196+0000","last_peered":"2026-02-24T08:33:25.879196+0000","last_clean":"2026-02-24T08:33:25.879196+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:25.879196+0000","last_undegraded":"2026-02-24T08:33:25.879196+0000","last_fullsized":"2026-02-24T08:33:25.879196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2886270976,"num_objects":44043,"num_object_clones":0,"num_object_copies":132129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352328,"num_write_kb":2818624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8686526464,"data_stored":8686526464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160828,"ondisk_log_size":160828,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247967,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2988740,"kb_used_data":2135344,"kb_used_omap":8,"kb_used_meta":853367,"kb_avail":731014460,"statfs":{"total":751619276800,"available":748558807040,"internally_reserved":0,"allocated":2186592256,"data_stored":2185892727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8765,"internal_metadata":873848259},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,6,12,14],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3037900,"kb_used_data":2136752,"kb_used_omap":7,"kb_used_meta":901112,"kb_avail":730965300,"statfs":{"total":751619276800,"available":748508467200,"internally_reserved":0,"allocated":2188034048,"data_stored":2187334519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8087,"internal_metadata":922738793},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,10,0,12,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2586660,"kb_used_data":1874320,"kb_used_omap":5,"kb_used_meta":712314,"kb_avail":731416540,"statfs":{"total":751619276800,"available":748970536960,"internally_reserved":0,"allocated":1919303680,"data_stored":1918631340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6128,"internal_metadata":729409552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705829,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3337252,"kb_used_data":2305928,"kb_used_omap":8,"kb_used_meta":1031287,"kb_avail":730665948,"statfs":{"total":751619276800,"available":748201930752,"internally_reserved":0,"allocated":2361270272,"data_stored":2360570743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8750,"internal_metadata":1056038354},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2379751424,"data_stored":2379751424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1927815168,"data_stored":1927815168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2188730368,"data_stored":2188730368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2190229504,"data_stored":2190229504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:33:27.811 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:27.931 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:27.950 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 87 128 360912 360784 32.3949 22.3125 0.0314679 0.0308576 2026-02-24T08:33:27.961 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:28.081 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:28.098 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:28.095+0000 7f7e00f6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:28.098 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:28.095+0000 7f7e00f6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:28.145 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:27 trial105 ceph-mon[39442]: pgmap v471: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.6 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.74k op/s 2026-02-24T08:33:28.145 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3999256462' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:33:28.145 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:27 trial105 ceph-mon[39442]: osdmap e106: 4 total, 4 up, 4 in 2026-02-24T08:33:28.218 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:28.216+0000 7fa4830bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:28.218 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:28.216+0000 7fa4830bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:28.238 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:28.238 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:28.246 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:33:28.247 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:33:28.251 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:28.251 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:28.265 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:28.266 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:28.279 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:28.280 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:28.291 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":472,"stamp":"2026-02-24T08:33:26.880225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2886861344,"num_objects":44045,"num_object_clones":0,"num_object_copies":132135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44045,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":352463,"num_write_kb":2820774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160927,"ondisk_log_size":160927,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11950552,"kb_used_data":8452344,"kb_used_omap":30,"kb_used_meta":3498081,"kb_avail":2924062248,"statfs":{"total":3006477107200,"available":2994239741952,"internally_reserved":0,"allocated":8655200256,"data_stored":8652429329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31730,"internal_metadata":3582034958},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,4,16,12,26,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":91979776,"num_objects":1402,"num_object_clones":0,"num_object_copies":4206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11228,"num_write_kb":89824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.083814"},"pg_stats":[{"pgid":"8.f","version":"105'22032","reported_seq":22084,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.847347+0000","last_change":"2026-02-24T08:33:12.558481+0000","last_active":"2026-02-24T08:33:26.847347+0000","last_peered":"2026-02-24T08:33:26.847347+0000","last_clean":"2026-02-24T08:33:26.847347+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:33:26.847347+0000","last_undegraded":"2026-02-24T08:33:26.847347+0000","last_fullsized":"2026-02-24T08:33:26.847347+0000","mapping_epoch":100,"log_start":"102'12000","ondisk_log_start":"102'12000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18952","last_scrub_stamp":"2026-02-24T08:33:12.558422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.558422+0000","objects_scrubbed":2367,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:14.407330+0000","scrub_duration":724,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180486144,"num_objects":2754,"num_object_clones":0,"num_object_copies":8262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22032,"num_write_kb":176256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"105'22560","reported_seq":22580,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.842811+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:33:26.842811+0000","last_peered":"2026-02-24T08:33:26.842811+0000","last_clean":"2026-02-24T08:33:26.842811+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:33:26.842811+0000","last_undegraded":"2026-02-24T08:33:26.842811+0000","last_fullsized":"2026-02-24T08:33:26.842811+0000","mapping_epoch":100,"log_start":"102'12500","ondisk_log_start":"102'12500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184811520,"num_objects":2820,"num_object_clones":0,"num_object_copies":8460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22560,"num_write_kb":180480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"105'21816","reported_seq":21865,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.401217+0000","last_change":"2026-02-24T08:33:05.192827+0000","last_active":"2026-02-24T08:33:26.401217+0000","last_peered":"2026-02-24T08:33:26.401217+0000","last_clean":"2026-02-24T08:33:26.401217+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:33:26.401217+0000","last_undegraded":"2026-02-24T08:33:26.401217+0000","last_fullsized":"2026-02-24T08:33:26.401217+0000","mapping_epoch":100,"log_start":"102'11800","ondisk_log_start":"102'11800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17536","last_scrub_stamp":"2026-02-24T08:33:05.192724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:05.192724+0000","objects_scrubbed":2178,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:18.812981+0000","scrub_duration":1000,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178716672,"num_objects":2727,"num_object_clones":0,"num_object_copies":8181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21816,"num_write_kb":174528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"105'22088","reported_seq":22143,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.747035+0000","last_change":"2026-02-24T08:33:22.777449+0000","last_active":"2026-02-24T08:33:26.747035+0000","last_peered":"2026-02-24T08:33:26.747035+0000","last_clean":"2026-02-24T08:33:26.747035+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:33:26.747035+0000","last_undegraded":"2026-02-24T08:33:26.747035+0000","last_fullsized":"2026-02-24T08:33:26.747035+0000","mapping_epoch":100,"log_start":"102'12000","ondisk_log_start":"102'12000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21224","last_scrub_stamp":"2026-02-24T08:33:22.777398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:22.777398+0000","objects_scrubbed":2638,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:49.901561+0000","scrub_duration":805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":8283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22088,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"105'22872","reported_seq":22920,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.861433+0000","last_change":"2026-02-24T08:33:08.865575+0000","last_active":"2026-02-24T08:33:26.861433+0000","last_peered":"2026-02-24T08:33:26.861433+0000","last_clean":"2026-02-24T08:33:26.861433+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:33:26.861433+0000","last_undegraded":"2026-02-24T08:33:26.861433+0000","last_fullsized":"2026-02-24T08:33:26.861433+0000","mapping_epoch":100,"log_start":"102'12800","ondisk_log_start":"102'12800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19384","last_scrub_stamp":"2026-02-24T08:33:08.865516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:08.865516+0000","objects_scrubbed":2420,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:25.957973+0000","scrub_duration":1087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187367424,"num_objects":2859,"num_object_clones":0,"num_object_copies":8577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22872,"num_write_kb":182976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'21816","reported_seq":21863,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:21.930166+0000","last_change":"2026-02-24T08:33:14.065578+0000","last_active":"2026-02-24T08:33:21.930166+0000","last_peered":"2026-02-24T08:33:21.930166+0000","last_clean":"2026-02-24T08:33:21.930166+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:33:21.930166+0000","last_undegraded":"2026-02-24T08:33:21.930166+0000","last_fullsized":"2026-02-24T08:33:21.930166+0000","mapping_epoch":100,"log_start":"102'11800","ondisk_log_start":"102'11800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20176","last_scrub_stamp":"2026-02-24T08:33:14.065505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:14.065505+0000","objects_scrubbed":2513,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.447959+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178716672,"num_objects":2727,"num_object_clones":0,"num_object_copies":8181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21816,"num_write_kb":174528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"105'21968","reported_seq":21988,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.414082+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:33:26.414082+0000","last_peered":"2026-02-24T08:33:26.414082+0000","last_clean":"2026-02-24T08:33:26.414082+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:33:26.414082+0000","last_undegraded":"2026-02-24T08:33:26.414082+0000","last_fullsized":"2026-02-24T08:33:26.414082+0000","mapping_epoch":100,"log_start":"102'11900","ondisk_log_start":"102'11900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179961856,"num_objects":2746,"num_object_clones":0,"num_object_copies":8238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21968,"num_write_kb":175744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'21030","reported_seq":21078,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:22.042893+0000","last_change":"2026-02-24T08:33:20.588017+0000","last_active":"2026-02-24T08:33:22.042893+0000","last_peered":"2026-02-24T08:33:22.042893+0000","last_clean":"2026-02-24T08:33:22.042893+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:33:22.042893+0000","last_undegraded":"2026-02-24T08:33:22.042893+0000","last_fullsized":"2026-02-24T08:33:22.042893+0000","mapping_epoch":100,"log_start":"102'11000","ondisk_log_start":"102'11000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20704","last_scrub_stamp":"2026-02-24T08:33:20.587976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:20.587976+0000","objects_scrubbed":2557,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:27.431033+0000","scrub_duration":2005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172277760,"num_objects":2629,"num_object_clones":0,"num_object_copies":7887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21030,"num_write_kb":168240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"105'22936","reported_seq":22985,"reported_epoch":105,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:33:26.862586+0000","last_change":"2026-02-24T08:33:24.943943+0000","last_active":"2026-02-24T08:33:26.862586+0000","last_peered":"2026-02-24T08:33:26.862586+0000","last_clean":"2026-02-24T08:33:26.862586+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:33:26.862586+0000","last_undegraded":"2026-02-24T08:33:26.862586+0000","last_fullsized":"2026-02-24T08:33:26.862586+0000","mapping_epoch":100,"log_start":"102'12900","ondisk_log_start":"102'12900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":2853,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187891712,"num_objects":2867,"num_object_clones":0,"num_object_copies":8601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22936,"num_write_kb":183488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"105'22568","reported_seq":22614,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.362984+0000","last_change":"2026-02-24T08:33:06.806177+0000","last_active":"2026-02-24T08:33:26.362984+0000","last_peered":"2026-02-24T08:33:26.362984+0000","last_clean":"2026-02-24T08:33:26.362984+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:33:26.362984+0000","last_undegraded":"2026-02-24T08:33:26.362984+0000","last_fullsized":"2026-02-24T08:33:26.362984+0000","mapping_epoch":100,"log_start":"102'12500","ondisk_log_start":"102'12500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18536","last_scrub_stamp":"2026-02-24T08:33:06.806078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:06.806078+0000","objects_scrubbed":2313,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:19.273551+0000","scrub_duration":761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184877056,"num_objects":2821,"num_object_clones":0,"num_object_copies":8463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22568,"num_write_kb":180544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"105'22544","reported_seq":22596,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.403183+0000","last_change":"2026-02-24T08:33:12.060340+0000","last_active":"2026-02-24T08:33:26.403183+0000","last_peered":"2026-02-24T08:33:26.403183+0000","last_clean":"2026-02-24T08:33:26.403183+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:33:26.403183+0000","last_undegraded":"2026-02-24T08:33:26.403183+0000","last_fullsized":"2026-02-24T08:33:26.403183+0000","mapping_epoch":100,"log_start":"102'12500","ondisk_log_start":"102'12500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19736","last_scrub_stamp":"2026-02-24T08:33:12.060280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.060280+0000","objects_scrubbed":2462,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:16.715777+0000","scrub_duration":662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184680448,"num_objects":2818,"num_object_clones":0,"num_object_copies":8454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2818,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22544,"num_write_kb":180352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'21424","reported_seq":21451,"reported_epoch":102,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:33:22.057629+0000","last_change":"2026-02-24T08:33:21.572479+0000","last_active":"2026-02-24T08:33:22.057629+0000","last_peered":"2026-02-24T08:33:22.057629+0000","last_clean":"2026-02-24T08:33:22.057629+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:33:22.057629+0000","last_undegraded":"2026-02-24T08:33:22.057629+0000","last_fullsized":"2026-02-24T08:33:22.057629+0000","mapping_epoch":100,"log_start":"102'11400","ondisk_log_start":"102'11400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":899,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175505408,"num_objects":2678,"num_object_clones":0,"num_object_copies":8034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21424,"num_write_kb":171392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"105'22188","reported_seq":22240,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.385105+0000","last_change":"2026-02-24T08:33:21.899212+0000","last_active":"2026-02-24T08:33:26.385105+0000","last_peered":"2026-02-24T08:33:26.385105+0000","last_clean":"2026-02-24T08:33:26.385105+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:33:26.385105+0000","last_undegraded":"2026-02-24T08:33:26.385105+0000","last_fullsized":"2026-02-24T08:33:26.385105+0000","mapping_epoch":100,"log_start":"102'12100","ondisk_log_start":"102'12100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21392","last_scrub_stamp":"2026-02-24T08:33:21.899145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.899145+0000","objects_scrubbed":2668,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:43.261018+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181764096,"num_objects":2774,"num_object_clones":0,"num_object_copies":8322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2774,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22188,"num_write_kb":177504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'21042","reported_seq":21080,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:22.046013+0000","last_change":"2026-02-24T08:33:02.502815+0000","last_active":"2026-02-24T08:33:22.046013+0000","last_peered":"2026-02-24T08:33:22.046013+0000","last_clean":"2026-02-24T08:33:22.046013+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:33:22.046013+0000","last_undegraded":"2026-02-24T08:33:22.046013+0000","last_fullsized":"2026-02-24T08:33:22.046013+0000","mapping_epoch":100,"log_start":"102'11000","ondisk_log_start":"102'11000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17136","last_scrub_stamp":"2026-02-24T08:33:02.502774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:02.502774+0000","objects_scrubbed":2130,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.676850+0000","scrub_duration":986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172376064,"num_objects":2631,"num_object_clones":0,"num_object_copies":7893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21042,"num_write_kb":168336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'21344","reported_seq":21393,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:22.001784+0000","last_change":"2026-02-24T08:33:21.507517+0000","last_active":"2026-02-24T08:33:22.001784+0000","last_peered":"2026-02-24T08:33:22.001784+0000","last_clean":"2026-02-24T08:33:22.001784+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:33:22.001784+0000","last_undegraded":"2026-02-24T08:33:22.001784+0000","last_fullsized":"2026-02-24T08:33:22.001784+0000","mapping_epoch":100,"log_start":"102'11300","ondisk_log_start":"102'11300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21274","last_scrub_stamp":"2026-02-24T08:33:21.507423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.507423+0000","objects_scrubbed":2641,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:40.355136+0000","scrub_duration":933,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174850048,"num_objects":2668,"num_object_clones":0,"num_object_copies":8004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21344,"num_write_kb":170752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"105'22100","reported_seq":22147,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.416194+0000","last_change":"2026-02-24T08:33:00.610675+0000","last_active":"2026-02-24T08:33:26.416194+0000","last_peered":"2026-02-24T08:33:26.416194+0000","last_clean":"2026-02-24T08:33:26.416194+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:33:26.416194+0000","last_undegraded":"2026-02-24T08:33:26.416194+0000","last_fullsized":"2026-02-24T08:33:26.416194+0000","mapping_epoch":100,"log_start":"102'12000","ondisk_log_start":"102'12000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'16512","last_scrub_stamp":"2026-02-24T08:33:00.610606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:00.610606+0000","objects_scrubbed":2041,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:28.134694+0000","scrub_duration":1365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181043200,"num_objects":2763,"num_object_clones":0,"num_object_copies":8289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22100,"num_write_kb":176800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":287,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:25.879196+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:25.879196+0000","last_peered":"2026-02-24T08:33:25.879196+0000","last_clean":"2026-02-24T08:33:25.879196+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:25.879196+0000","last_undegraded":"2026-02-24T08:33:25.879196+0000","last_fullsized":"2026-02-24T08:33:25.879196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2886270976,"num_objects":44043,"num_object_clones":0,"num_object_copies":132129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352328,"num_write_kb":2818624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8686526464,"data_stored":8686526464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160828,"ondisk_log_size":160828,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247967,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2988740,"kb_used_data":2135344,"kb_used_omap":8,"kb_used_meta":853367,"kb_avail":731014460,"statfs":{"total":751619276800,"available":748558807040,"internally_reserved":0,"allocated":2186592256,"data_stored":2185892727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8765,"internal_metadata":873848259},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,6,12,14],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3037900,"kb_used_data":2136752,"kb_used_omap":7,"kb_used_meta":901112,"kb_avail":730965300,"statfs":{"total":751619276800,"available":748508467200,"internally_reserved":0,"allocated":2188034048,"data_stored":2187334519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8087,"internal_metadata":922738793},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,10,0,12,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2586660,"kb_used_data":1874320,"kb_used_omap":5,"kb_used_meta":712314,"kb_avail":731416540,"statfs":{"total":751619276800,"available":748970536960,"internally_reserved":0,"allocated":1919303680,"data_stored":1918631340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6128,"internal_metadata":729409552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705829,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3337252,"kb_used_data":2305928,"kb_used_omap":8,"kb_used_meta":1031287,"kb_avail":730665948,"statfs":{"total":751619276800,"available":748201930752,"internally_reserved":0,"allocated":2361270272,"data_stored":2360570743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8750,"internal_metadata":1056038354},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2379751424,"data_stored":2379751424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1927815168,"data_stored":1927815168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2188730368,"data_stored":2188730368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2190229504,"data_stored":2190229504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:33:28.293 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:33:28.293 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:33:28.293 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:33:28.294 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:28.505 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:28.637 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:28.634+0000 7efca094b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:28.637 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:28.634+0000 7efca094b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:28.791 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:33:28.792 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:33:28.838 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":472,"stamp":"2026-02-24T08:33:26.880225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2886861344,"num_objects":44045,"num_object_clones":0,"num_object_copies":132135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44045,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":352463,"num_write_kb":2820774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160927,"ondisk_log_size":160927,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11950552,"kb_used_data":8452344,"kb_used_omap":30,"kb_used_meta":3498081,"kb_avail":2924062248,"statfs":{"total":3006477107200,"available":2994239741952,"internally_reserved":0,"allocated":8655200256,"data_stored":8652429329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31730,"internal_metadata":3582034958},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,4,16,12,26,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":91979776,"num_objects":1402,"num_object_clones":0,"num_object_copies":4206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11228,"num_write_kb":89824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.083814"},"pg_stats":[{"pgid":"8.f","version":"105'22032","reported_seq":22084,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.847347+0000","last_change":"2026-02-24T08:33:12.558481+0000","last_active":"2026-02-24T08:33:26.847347+0000","last_peered":"2026-02-24T08:33:26.847347+0000","last_clean":"2026-02-24T08:33:26.847347+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:33:26.847347+0000","last_undegraded":"2026-02-24T08:33:26.847347+0000","last_fullsized":"2026-02-24T08:33:26.847347+0000","mapping_epoch":100,"log_start":"102'12000","ondisk_log_start":"102'12000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18952","last_scrub_stamp":"2026-02-24T08:33:12.558422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.558422+0000","objects_scrubbed":2367,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:14.407330+0000","scrub_duration":724,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180486144,"num_objects":2754,"num_object_clones":0,"num_object_copies":8262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2754,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22032,"num_write_kb":176256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"105'22560","reported_seq":22580,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.842811+0000","last_change":"2026-02-24T08:31:59.852154+0000","last_active":"2026-02-24T08:33:26.842811+0000","last_peered":"2026-02-24T08:33:26.842811+0000","last_clean":"2026-02-24T08:33:26.842811+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:33:26.842811+0000","last_undegraded":"2026-02-24T08:33:26.842811+0000","last_fullsized":"2026-02-24T08:33:26.842811+0000","mapping_epoch":100,"log_start":"102'12500","ondisk_log_start":"102'12500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:27.991481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184811520,"num_objects":2820,"num_object_clones":0,"num_object_copies":8460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2820,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22560,"num_write_kb":180480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"105'21816","reported_seq":21865,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.401217+0000","last_change":"2026-02-24T08:33:05.192827+0000","last_active":"2026-02-24T08:33:26.401217+0000","last_peered":"2026-02-24T08:33:26.401217+0000","last_clean":"2026-02-24T08:33:26.401217+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:33:26.401217+0000","last_undegraded":"2026-02-24T08:33:26.401217+0000","last_fullsized":"2026-02-24T08:33:26.401217+0000","mapping_epoch":100,"log_start":"102'11800","ondisk_log_start":"102'11800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17536","last_scrub_stamp":"2026-02-24T08:33:05.192724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:05.192724+0000","objects_scrubbed":2178,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:18.812981+0000","scrub_duration":1000,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178716672,"num_objects":2727,"num_object_clones":0,"num_object_copies":8181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21816,"num_write_kb":174528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"105'22088","reported_seq":22143,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.747035+0000","last_change":"2026-02-24T08:33:22.777449+0000","last_active":"2026-02-24T08:33:26.747035+0000","last_peered":"2026-02-24T08:33:26.747035+0000","last_clean":"2026-02-24T08:33:26.747035+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:33:26.747035+0000","last_undegraded":"2026-02-24T08:33:26.747035+0000","last_fullsized":"2026-02-24T08:33:26.747035+0000","mapping_epoch":100,"log_start":"102'12000","ondisk_log_start":"102'12000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21224","last_scrub_stamp":"2026-02-24T08:33:22.777398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:22.777398+0000","objects_scrubbed":2638,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:49.901561+0000","scrub_duration":805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180944896,"num_objects":2761,"num_object_clones":0,"num_object_copies":8283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22088,"num_write_kb":176704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"105'22872","reported_seq":22920,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.861433+0000","last_change":"2026-02-24T08:33:08.865575+0000","last_active":"2026-02-24T08:33:26.861433+0000","last_peered":"2026-02-24T08:33:26.861433+0000","last_clean":"2026-02-24T08:33:26.861433+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:33:26.861433+0000","last_undegraded":"2026-02-24T08:33:26.861433+0000","last_fullsized":"2026-02-24T08:33:26.861433+0000","mapping_epoch":100,"log_start":"102'12800","ondisk_log_start":"102'12800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19384","last_scrub_stamp":"2026-02-24T08:33:08.865516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:08.865516+0000","objects_scrubbed":2420,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:25.957973+0000","scrub_duration":1087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187367424,"num_objects":2859,"num_object_clones":0,"num_object_copies":8577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22872,"num_write_kb":182976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"102'21816","reported_seq":21863,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:21.930166+0000","last_change":"2026-02-24T08:33:14.065578+0000","last_active":"2026-02-24T08:33:21.930166+0000","last_peered":"2026-02-24T08:33:21.930166+0000","last_clean":"2026-02-24T08:33:21.930166+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:33:21.930166+0000","last_undegraded":"2026-02-24T08:33:21.930166+0000","last_fullsized":"2026-02-24T08:33:21.930166+0000","mapping_epoch":100,"log_start":"102'11800","ondisk_log_start":"102'11800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20176","last_scrub_stamp":"2026-02-24T08:33:14.065505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:14.065505+0000","objects_scrubbed":2513,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.447959+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178716672,"num_objects":2727,"num_object_clones":0,"num_object_copies":8181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21816,"num_write_kb":174528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"105'21968","reported_seq":21988,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.414082+0000","last_change":"2026-02-24T08:31:59.856310+0000","last_active":"2026-02-24T08:33:26.414082+0000","last_peered":"2026-02-24T08:33:26.414082+0000","last_clean":"2026-02-24T08:33:26.414082+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:33:26.414082+0000","last_undegraded":"2026-02-24T08:33:26.414082+0000","last_fullsized":"2026-02-24T08:33:26.414082+0000","mapping_epoch":100,"log_start":"102'11900","ondisk_log_start":"102'11900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:33:26.701148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179961856,"num_objects":2746,"num_object_clones":0,"num_object_copies":8238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2746,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21968,"num_write_kb":175744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"102'21030","reported_seq":21078,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:22.042893+0000","last_change":"2026-02-24T08:33:20.588017+0000","last_active":"2026-02-24T08:33:22.042893+0000","last_peered":"2026-02-24T08:33:22.042893+0000","last_clean":"2026-02-24T08:33:22.042893+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:33:22.042893+0000","last_undegraded":"2026-02-24T08:33:22.042893+0000","last_fullsized":"2026-02-24T08:33:22.042893+0000","mapping_epoch":100,"log_start":"102'11000","ondisk_log_start":"102'11000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20704","last_scrub_stamp":"2026-02-24T08:33:20.587976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:20.587976+0000","objects_scrubbed":2557,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:27.431033+0000","scrub_duration":2005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172277760,"num_objects":2629,"num_object_clones":0,"num_object_copies":7887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21030,"num_write_kb":168240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"105'22936","reported_seq":22985,"reported_epoch":105,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:33:26.862586+0000","last_change":"2026-02-24T08:33:24.943943+0000","last_active":"2026-02-24T08:33:26.862586+0000","last_peered":"2026-02-24T08:33:26.862586+0000","last_clean":"2026-02-24T08:33:26.862586+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:33:26.862586+0000","last_undegraded":"2026-02-24T08:33:26.862586+0000","last_fullsized":"2026-02-24T08:33:26.862586+0000","mapping_epoch":100,"log_start":"102'12900","ondisk_log_start":"102'12900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":2853,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187891712,"num_objects":2867,"num_object_clones":0,"num_object_copies":8601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2867,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22936,"num_write_kb":183488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"105'22568","reported_seq":22614,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.362984+0000","last_change":"2026-02-24T08:33:06.806177+0000","last_active":"2026-02-24T08:33:26.362984+0000","last_peered":"2026-02-24T08:33:26.362984+0000","last_clean":"2026-02-24T08:33:26.362984+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:33:26.362984+0000","last_undegraded":"2026-02-24T08:33:26.362984+0000","last_fullsized":"2026-02-24T08:33:26.362984+0000","mapping_epoch":100,"log_start":"102'12500","ondisk_log_start":"102'12500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18536","last_scrub_stamp":"2026-02-24T08:33:06.806078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:06.806078+0000","objects_scrubbed":2313,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:19.273551+0000","scrub_duration":761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184877056,"num_objects":2821,"num_object_clones":0,"num_object_copies":8463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2821,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22568,"num_write_kb":180544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"105'22544","reported_seq":22596,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.403183+0000","last_change":"2026-02-24T08:33:12.060340+0000","last_active":"2026-02-24T08:33:26.403183+0000","last_peered":"2026-02-24T08:33:26.403183+0000","last_clean":"2026-02-24T08:33:26.403183+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:33:26.403183+0000","last_undegraded":"2026-02-24T08:33:26.403183+0000","last_fullsized":"2026-02-24T08:33:26.403183+0000","mapping_epoch":100,"log_start":"102'12500","ondisk_log_start":"102'12500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19736","last_scrub_stamp":"2026-02-24T08:33:12.060280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.060280+0000","objects_scrubbed":2462,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:16.715777+0000","scrub_duration":662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184680448,"num_objects":2818,"num_object_clones":0,"num_object_copies":8454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2818,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22544,"num_write_kb":180352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"102'21424","reported_seq":21451,"reported_epoch":102,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:33:22.057629+0000","last_change":"2026-02-24T08:33:21.572479+0000","last_active":"2026-02-24T08:33:22.057629+0000","last_peered":"2026-02-24T08:33:22.057629+0000","last_clean":"2026-02-24T08:33:22.057629+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:33:22.057629+0000","last_undegraded":"2026-02-24T08:33:22.057629+0000","last_fullsized":"2026-02-24T08:33:22.057629+0000","mapping_epoch":100,"log_start":"102'11400","ondisk_log_start":"102'11400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:31:58.841840+0000","objects_scrubbed":899,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175505408,"num_objects":2678,"num_object_clones":0,"num_object_copies":8034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2678,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21424,"num_write_kb":171392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"105'22188","reported_seq":22240,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.385105+0000","last_change":"2026-02-24T08:33:21.899212+0000","last_active":"2026-02-24T08:33:26.385105+0000","last_peered":"2026-02-24T08:33:26.385105+0000","last_clean":"2026-02-24T08:33:26.385105+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:33:26.385105+0000","last_undegraded":"2026-02-24T08:33:26.385105+0000","last_fullsized":"2026-02-24T08:33:26.385105+0000","mapping_epoch":100,"log_start":"102'12100","ondisk_log_start":"102'12100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21392","last_scrub_stamp":"2026-02-24T08:33:21.899145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.899145+0000","objects_scrubbed":2668,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:43.261018+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181764096,"num_objects":2774,"num_object_clones":0,"num_object_copies":8322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2774,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22188,"num_write_kb":177504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"102'21042","reported_seq":21080,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:22.046013+0000","last_change":"2026-02-24T08:33:02.502815+0000","last_active":"2026-02-24T08:33:22.046013+0000","last_peered":"2026-02-24T08:33:22.046013+0000","last_clean":"2026-02-24T08:33:22.046013+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:33:22.046013+0000","last_undegraded":"2026-02-24T08:33:22.046013+0000","last_fullsized":"2026-02-24T08:33:22.046013+0000","mapping_epoch":100,"log_start":"102'11000","ondisk_log_start":"102'11000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17136","last_scrub_stamp":"2026-02-24T08:33:02.502774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:02.502774+0000","objects_scrubbed":2130,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.676850+0000","scrub_duration":986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172376064,"num_objects":2631,"num_object_clones":0,"num_object_copies":7893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2631,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21042,"num_write_kb":168336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"102'21344","reported_seq":21393,"reported_epoch":102,"state":"active+clean","last_fresh":"2026-02-24T08:33:22.001784+0000","last_change":"2026-02-24T08:33:21.507517+0000","last_active":"2026-02-24T08:33:22.001784+0000","last_peered":"2026-02-24T08:33:22.001784+0000","last_clean":"2026-02-24T08:33:22.001784+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:33:22.001784+0000","last_undegraded":"2026-02-24T08:33:22.001784+0000","last_fullsized":"2026-02-24T08:33:22.001784+0000","mapping_epoch":100,"log_start":"102'11300","ondisk_log_start":"102'11300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21274","last_scrub_stamp":"2026-02-24T08:33:21.507423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.507423+0000","objects_scrubbed":2641,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:40.355136+0000","scrub_duration":933,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174850048,"num_objects":2668,"num_object_clones":0,"num_object_copies":8004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2668,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21344,"num_write_kb":170752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"105'22100","reported_seq":22147,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.416194+0000","last_change":"2026-02-24T08:33:00.610675+0000","last_active":"2026-02-24T08:33:26.416194+0000","last_peered":"2026-02-24T08:33:26.416194+0000","last_clean":"2026-02-24T08:33:26.416194+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:33:26.416194+0000","last_undegraded":"2026-02-24T08:33:26.416194+0000","last_fullsized":"2026-02-24T08:33:26.416194+0000","mapping_epoch":100,"log_start":"102'12000","ondisk_log_start":"102'12000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'16512","last_scrub_stamp":"2026-02-24T08:33:00.610606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:00.610606+0000","objects_scrubbed":2041,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:28.134694+0000","scrub_duration":1365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181043200,"num_objects":2763,"num_object_clones":0,"num_object_copies":8289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22100,"num_write_kb":176800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":287,"reported_epoch":105,"state":"active+clean","last_fresh":"2026-02-24T08:33:25.879196+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:25.879196+0000","last_peered":"2026-02-24T08:33:25.879196+0000","last_clean":"2026-02-24T08:33:25.879196+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:25.879196+0000","last_undegraded":"2026-02-24T08:33:25.879196+0000","last_fullsized":"2026-02-24T08:33:25.879196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":2886270976,"num_objects":44043,"num_object_clones":0,"num_object_copies":132129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44043,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352328,"num_write_kb":2818624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8686526464,"data_stored":8686526464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160828,"ondisk_log_size":160828,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247967,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2988740,"kb_used_data":2135344,"kb_used_omap":8,"kb_used_meta":853367,"kb_avail":731014460,"statfs":{"total":751619276800,"available":748558807040,"internally_reserved":0,"allocated":2186592256,"data_stored":2185892727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8765,"internal_metadata":873848259},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,6,12,14],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3037900,"kb_used_data":2136752,"kb_used_omap":7,"kb_used_meta":901112,"kb_avail":730965300,"statfs":{"total":751619276800,"available":748508467200,"internally_reserved":0,"allocated":2188034048,"data_stored":2187334519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8087,"internal_metadata":922738793},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,10,0,12,8],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2586660,"kb_used_data":1874320,"kb_used_omap":5,"kb_used_meta":712314,"kb_avail":731416540,"statfs":{"total":751619276800,"available":748970536960,"internally_reserved":0,"allocated":1919303680,"data_stored":1918631340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6128,"internal_metadata":729409552},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705829,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3337252,"kb_used_data":2305928,"kb_used_omap":8,"kb_used_meta":1031287,"kb_avail":730665948,"statfs":{"total":751619276800,"available":748201930752,"internally_reserved":0,"allocated":2361270272,"data_stored":2360570743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8750,"internal_metadata":1056038354},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2379751424,"data_stored":2379751424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1927815168,"data_stored":1927815168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2188730368,"data_stored":2188730368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2190229504,"data_stored":2190229504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:33:28.839 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 281 2026-02-24T08:33:28.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 88 128 363900 363772 32.292 23.3438 0.00859517 0.0309566 2026-02-24T08:33:28.989 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:29.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:28 trial105 ceph-mon[39442]: 8.6 scrub ok 2026-02-24T08:33:29.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:28 trial105 ceph-mon[39442]: from='client.15610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:29.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3837976174' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:29.045 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:28 trial105 ceph-mon[39442]: 8.8 scrub starts 2026-02-24T08:33:29.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:29.121+0000 7fa55913f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:29.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:29.121+0000 7fa55913f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:29.278 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:33:29.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:33:29.885 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:33:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:33:29] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-24T08:33:29.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:33:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:33:29.552Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:33:29.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 89 128 367201 367073 32.2189 25.7891 0.0124108 0.0310276 2026-02-24T08:33:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:29 trial105 ceph-mon[39442]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:29 trial105 ceph-mon[39442]: from='client.15616 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:29 trial105 ceph-mon[39442]: pgmap v473: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.29k op/s 2026-02-24T08:33:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:33:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:29 trial105 ceph-mon[39442]: 8.8 scrub ok 2026-02-24T08:33:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:29 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3802988462' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "281"} : dispatch 2026-02-24T08:33:30.324 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:30.476 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:30.596 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:30.593+0000 7eff3b585640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:30.596 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:30.593+0000 7eff3b585640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:30.616 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:30.616 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:30.629 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:30.629 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:30.643 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:30.643 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:30.659 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:30.659 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:30.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 90 85 370485 370400 32.1497 25.9922 0.0361269 0.0310956 2026-02-24T08:33:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:30 trial105 ceph-mon[39442]: 8.e scrub starts 2026-02-24T08:33:31.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1639070963' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total time run: 90.0498 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total writes made: 370485 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Write size: 8192 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object size: 65536 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Bandwidth (MB/sec): 32.1424 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Bandwidth: 12.9041 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max bandwidth (MB/sec): 78.3906 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min bandwidth (MB/sec): 20.1797 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average IOPS: 4114 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev IOPS: 1651.73 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max IOPS: 10034 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min IOPS: 2583 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average Latency(s): 0.0310984 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Latency(s): 0.0242067 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max latency(s): 0.292776 2026-02-24T08:33:31.951 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min latency(s): 0.000762728 2026-02-24T08:33:31.958 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:33:32.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:31 trial105 ceph-mon[39442]: 8.e scrub ok 2026-02-24T08:33:32.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:31 trial105 ceph-mon[39442]: pgmap v474: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.70k op/s 2026-02-24T08:33:32.708 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:32.869 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:33.006 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:33.002+0000 7fc0c6a65640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:33.006 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:33.003+0000 7fc0c6a65640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:33.031 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:33.031 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:33.047 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:33.047 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:33.062 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:33.062 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:33.086 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:33.086 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:33 trial105 ceph-mon[39442]: pgmap v475: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.74k op/s 2026-02-24T08:33:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3249924519' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:34.323 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:33:34.323 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:33:34.324 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_6 2026-02-24T08:33:34.324 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:34.490 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:34.623 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:34.619+0000 7f7eb6368640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:34.623 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:34.620+0000 7f7eb6368640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:34.797 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:33:34.798 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:33:34.850 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":475,"stamp":"2026-02-24T08:33:32.797827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3021447712,"num_objects":46097,"num_object_clones":0,"num_object_copies":138291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46097,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":370836,"num_write_kb":2966030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160900,"ondisk_log_size":160900,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12540060,"kb_used_data":8897484,"kb_used_omap":35,"kb_used_meta":3642460,"kb_avail":2923472740,"statfs":{"total":3006477107200,"available":2993636085760,"internally_reserved":0,"allocated":9111023616,"data_stored":9108197536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36294,"internal_metadata":3729879610},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,7,6,4,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":226566144,"num_objects":3454,"num_object_clones":0,"num_object_copies":10362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3454,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29601,"num_write_kb":235080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.922996"},"pg_stats":[{"pgid":"8.f","version":"106'22776","reported_seq":22830,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.963548+0000","last_change":"2026-02-24T08:33:12.558481+0000","last_active":"2026-02-24T08:33:30.963548+0000","last_peered":"2026-02-24T08:33:30.963548+0000","last_clean":"2026-02-24T08:33:30.963548+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:33:30.963548+0000","last_undegraded":"2026-02-24T08:33:30.963548+0000","last_fullsized":"2026-02-24T08:33:30.963548+0000","mapping_epoch":100,"log_start":"102'12700","ondisk_log_start":"102'12700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18952","last_scrub_stamp":"2026-02-24T08:33:12.558422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.558422+0000","objects_scrubbed":2367,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:14.407330+0000","scrub_duration":724,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186580992,"num_objects":2847,"num_object_clones":0,"num_object_copies":8541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2847,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22776,"num_write_kb":182208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"106'23352","reported_seq":23410,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.983709+0000","last_change":"2026-02-24T08:33:30.414558+0000","last_active":"2026-02-24T08:33:30.983709+0000","last_peered":"2026-02-24T08:33:30.983709+0000","last_clean":"2026-02-24T08:33:30.983709+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:33:30.983709+0000","last_undegraded":"2026-02-24T08:33:30.983709+0000","last_fullsized":"2026-02-24T08:33:30.983709+0000","mapping_epoch":100,"log_start":"102'13300","ondisk_log_start":"102'13300","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'23216","last_scrub_stamp":"2026-02-24T08:33:30.414475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:30.414475+0000","objects_scrubbed":2895,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:47.156829+0000","scrub_duration":894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191299584,"num_objects":2919,"num_object_clones":0,"num_object_copies":8757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2919,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23352,"num_write_kb":186816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"106'22696","reported_seq":22747,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.925202+0000","last_change":"2026-02-24T08:33:05.192827+0000","last_active":"2026-02-24T08:33:30.925202+0000","last_peered":"2026-02-24T08:33:30.925202+0000","last_clean":"2026-02-24T08:33:30.925202+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:33:30.925202+0000","last_undegraded":"2026-02-24T08:33:30.925202+0000","last_fullsized":"2026-02-24T08:33:30.925202+0000","mapping_epoch":100,"log_start":"102'12600","ondisk_log_start":"102'12600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17536","last_scrub_stamp":"2026-02-24T08:33:05.192724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:05.192724+0000","objects_scrubbed":2178,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:18.812981+0000","scrub_duration":1000,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185925632,"num_objects":2837,"num_object_clones":0,"num_object_copies":8511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22696,"num_write_kb":181568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"106'22896","reported_seq":22953,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.966177+0000","last_change":"2026-02-24T08:33:22.777449+0000","last_active":"2026-02-24T08:33:30.966177+0000","last_peered":"2026-02-24T08:33:30.966177+0000","last_clean":"2026-02-24T08:33:30.966177+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:33:30.966177+0000","last_undegraded":"2026-02-24T08:33:30.966177+0000","last_fullsized":"2026-02-24T08:33:30.966177+0000","mapping_epoch":100,"log_start":"102'12800","ondisk_log_start":"102'12800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21224","last_scrub_stamp":"2026-02-24T08:33:22.777398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:22.777398+0000","objects_scrubbed":2638,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:49.901561+0000","scrub_duration":805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187564032,"num_objects":2862,"num_object_clones":0,"num_object_copies":8586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22896,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"106'23616","reported_seq":23670,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.958526+0000","last_change":"2026-02-24T08:33:08.865575+0000","last_active":"2026-02-24T08:33:30.958526+0000","last_peered":"2026-02-24T08:33:30.958526+0000","last_clean":"2026-02-24T08:33:30.958526+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:33:30.958526+0000","last_undegraded":"2026-02-24T08:33:30.958526+0000","last_fullsized":"2026-02-24T08:33:30.958526+0000","mapping_epoch":100,"log_start":"102'13600","ondisk_log_start":"102'13600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19384","last_scrub_stamp":"2026-02-24T08:33:08.865516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:08.865516+0000","objects_scrubbed":2420,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:25.957973+0000","scrub_duration":1087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193462272,"num_objects":2952,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2952,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23616,"num_write_kb":188928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"106'23635","reported_seq":23687,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:32.187883+0000","last_change":"2026-02-24T08:33:14.065578+0000","last_active":"2026-02-24T08:33:32.187883+0000","last_peered":"2026-02-24T08:33:32.187883+0000","last_clean":"2026-02-24T08:33:32.187883+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:33:32.187883+0000","last_undegraded":"2026-02-24T08:33:32.187883+0000","last_fullsized":"2026-02-24T08:33:32.187883+0000","mapping_epoch":100,"log_start":"102'13600","ondisk_log_start":"102'13600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20176","last_scrub_stamp":"2026-02-24T08:33:14.065505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:14.065505+0000","objects_scrubbed":2513,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.447959+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190447616,"num_objects":2906,"num_object_clones":0,"num_object_copies":8718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23635,"num_write_kb":188736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"106'22872","reported_seq":22930,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.942847+0000","last_change":"2026-02-24T08:33:29.008483+0000","last_active":"2026-02-24T08:33:30.942847+0000","last_peered":"2026-02-24T08:33:30.942847+0000","last_clean":"2026-02-24T08:33:30.942847+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:33:30.942847+0000","last_undegraded":"2026-02-24T08:33:30.942847+0000","last_fullsized":"2026-02-24T08:33:30.942847+0000","mapping_epoch":100,"log_start":"102'12800","ondisk_log_start":"102'12800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'22488","last_scrub_stamp":"2026-02-24T08:33:29.008447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:29.008447+0000","objects_scrubbed":2808,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:30.116262+0000","scrub_duration":280,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187367424,"num_objects":2859,"num_object_clones":0,"num_object_copies":8577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2859,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22872,"num_write_kb":182976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'22763","reported_seq":22819,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:32.188613+0000","last_change":"2026-02-24T08:33:20.588017+0000","last_active":"2026-02-24T08:33:32.188613+0000","last_peered":"2026-02-24T08:33:32.188613+0000","last_clean":"2026-02-24T08:33:32.188613+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:33:32.188613+0000","last_undegraded":"2026-02-24T08:33:32.188613+0000","last_fullsized":"2026-02-24T08:33:32.188613+0000","mapping_epoch":100,"log_start":"102'12700","ondisk_log_start":"102'12700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20704","last_scrub_stamp":"2026-02-24T08:33:20.587976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:20.587976+0000","objects_scrubbed":2557,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:27.431033+0000","scrub_duration":2005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182714368,"num_objects":2788,"num_object_clones":0,"num_object_copies":8364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2788,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22763,"num_write_kb":181696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"106'23808","reported_seq":23867,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.990613+0000","last_change":"2026-02-24T08:33:27.037988+0000","last_active":"2026-02-24T08:33:30.990613+0000","last_peered":"2026-02-24T08:33:30.990613+0000","last_clean":"2026-02-24T08:33:30.990613+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:33:30.990613+0000","last_undegraded":"2026-02-24T08:33:30.990613+0000","last_fullsized":"2026-02-24T08:33:30.990613+0000","mapping_epoch":100,"log_start":"102'13800","ondisk_log_start":"102'13800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'22968","last_scrub_stamp":"2026-02-24T08:33:27.037847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:27.037847+0000","objects_scrubbed":2853,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:56.792907+0000","scrub_duration":1966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195035136,"num_objects":2976,"num_object_clones":0,"num_object_copies":8928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2976,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23808,"num_write_kb":190464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"106'23520","reported_seq":23574,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.945695+0000","last_change":"2026-02-24T08:33:06.806177+0000","last_active":"2026-02-24T08:33:30.945695+0000","last_peered":"2026-02-24T08:33:30.945695+0000","last_clean":"2026-02-24T08:33:30.945695+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:33:30.945695+0000","last_undegraded":"2026-02-24T08:33:30.945695+0000","last_fullsized":"2026-02-24T08:33:30.945695+0000","mapping_epoch":100,"log_start":"102'13500","ondisk_log_start":"102'13500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18536","last_scrub_stamp":"2026-02-24T08:33:06.806078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:06.806078+0000","objects_scrubbed":2313,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:19.273551+0000","scrub_duration":761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192675840,"num_objects":2940,"num_object_clones":0,"num_object_copies":8820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23520,"num_write_kb":188160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"106'23517","reported_seq":23571,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.964528+0000","last_change":"2026-02-24T08:33:12.060340+0000","last_active":"2026-02-24T08:33:30.964528+0000","last_peered":"2026-02-24T08:33:30.964528+0000","last_clean":"2026-02-24T08:33:30.964528+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:33:30.964528+0000","last_undegraded":"2026-02-24T08:33:30.964528+0000","last_fullsized":"2026-02-24T08:33:30.964528+0000","mapping_epoch":100,"log_start":"102'13500","ondisk_log_start":"102'13500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19736","last_scrub_stamp":"2026-02-24T08:33:12.060280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.060280+0000","objects_scrubbed":2462,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:16.715777+0000","scrub_duration":662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192651264,"num_objects":2940,"num_object_clones":0,"num_object_copies":8820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2940,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23517,"num_write_kb":188136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"106'23084","reported_seq":23141,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:32.194523+0000","last_change":"2026-02-24T08:33:22.779095+0000","last_active":"2026-02-24T08:33:32.194523+0000","last_peered":"2026-02-24T08:33:32.194523+0000","last_clean":"2026-02-24T08:33:32.194523+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:33:32.194523+0000","last_undegraded":"2026-02-24T08:33:32.194523+0000","last_fullsized":"2026-02-24T08:33:32.194523+0000","mapping_epoch":100,"log_start":"102'13000","ondisk_log_start":"102'13000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21608","last_scrub_stamp":"2026-02-24T08:33:22.779039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:22.779039+0000","objects_scrubbed":2685,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:26.743296+0000","scrub_duration":1207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187039744,"num_objects":2854,"num_object_clones":0,"num_object_copies":8562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2854,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23084,"num_write_kb":184448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"106'23032","reported_seq":23089,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.918744+0000","last_change":"2026-02-24T08:33:21.899212+0000","last_active":"2026-02-24T08:33:30.918744+0000","last_peered":"2026-02-24T08:33:30.918744+0000","last_clean":"2026-02-24T08:33:30.918744+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:33:30.918744+0000","last_undegraded":"2026-02-24T08:33:30.918744+0000","last_fullsized":"2026-02-24T08:33:30.918744+0000","mapping_epoch":100,"log_start":"102'13000","ondisk_log_start":"102'13000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21392","last_scrub_stamp":"2026-02-24T08:33:21.899145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.899145+0000","objects_scrubbed":2668,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:43.261018+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188678144,"num_objects":2879,"num_object_clones":0,"num_object_copies":8637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2879,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23032,"num_write_kb":184256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"106'22941","reported_seq":22989,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:32.187469+0000","last_change":"2026-02-24T08:33:02.502815+0000","last_active":"2026-02-24T08:33:32.187469+0000","last_peered":"2026-02-24T08:33:32.187469+0000","last_clean":"2026-02-24T08:33:32.187469+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:33:32.187469+0000","last_undegraded":"2026-02-24T08:33:32.187469+0000","last_fullsized":"2026-02-24T08:33:32.187469+0000","mapping_epoch":100,"log_start":"102'12900","ondisk_log_start":"102'12900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17136","last_scrub_stamp":"2026-02-24T08:33:02.502774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:02.502774+0000","objects_scrubbed":2130,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.676850+0000","scrub_duration":986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184614912,"num_objects":2817,"num_object_clones":0,"num_object_copies":8451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2817,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22941,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"106'23137","reported_seq":23194,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:32.164702+0000","last_change":"2026-02-24T08:33:21.507517+0000","last_active":"2026-02-24T08:33:32.164702+0000","last_peered":"2026-02-24T08:33:32.164702+0000","last_clean":"2026-02-24T08:33:32.164702+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:33:32.164702+0000","last_undegraded":"2026-02-24T08:33:32.164702+0000","last_fullsized":"2026-02-24T08:33:32.164702+0000","mapping_epoch":100,"log_start":"102'13100","ondisk_log_start":"102'13100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21274","last_scrub_stamp":"2026-02-24T08:33:21.507423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.507423+0000","objects_scrubbed":2641,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:40.355136+0000","scrub_duration":933,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185925632,"num_objects":2837,"num_object_clones":0,"num_object_copies":8511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23137,"num_write_kb":184704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"106'23056","reported_seq":23107,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:30.946676+0000","last_change":"2026-02-24T08:33:00.610675+0000","last_active":"2026-02-24T08:33:30.946676+0000","last_peered":"2026-02-24T08:33:30.946676+0000","last_clean":"2026-02-24T08:33:30.946676+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:33:30.946676+0000","last_undegraded":"2026-02-24T08:33:30.946676+0000","last_fullsized":"2026-02-24T08:33:30.946676+0000","mapping_epoch":100,"log_start":"102'13000","ondisk_log_start":"102'13000","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'16512","last_scrub_stamp":"2026-02-24T08:33:00.610606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:00.610606+0000","objects_scrubbed":2041,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:28.134694+0000","scrub_duration":1365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188874752,"num_objects":2882,"num_object_clones":0,"num_object_copies":8646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2882,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23056,"num_write_kb":184448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":289,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.883262+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:26.883262+0000","last_peered":"2026-02-24T08:33:26.883262+0000","last_clean":"2026-02-24T08:33:26.883262+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:26.883262+0000","last_undegraded":"2026-02-24T08:33:26.883262+0000","last_fullsized":"2026-02-24T08:33:26.883262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":3020857344,"num_objects":46095,"num_object_clones":0,"num_object_copies":138285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370701,"num_write_kb":2963880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9072074752,"data_stored":9072074752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160801,"ondisk_log_size":160801,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247968,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3133384,"kb_used_data":2225844,"kb_used_omap":9,"kb_used_meta":907510,"kb_avail":730869816,"statfs":{"total":751619276800,"available":748410691584,"internally_reserved":0,"allocated":2279264256,"data_stored":2278556848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9417,"internal_metadata":929291063},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444194,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3163336,"kb_used_data":2226100,"kb_used_omap":8,"kb_used_meta":937207,"kb_avail":730839864,"statfs":{"total":751619276800,"available":748380020736,"internally_reserved":0,"allocated":2279526400,"data_stored":2278818992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8739,"internal_metadata":959700445},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2785988,"kb_used_data":2037552,"kb_used_omap":8,"kb_used_meta":748407,"kb_avail":731217212,"statfs":{"total":751619276800,"available":748766425088,"internally_reserved":0,"allocated":2086453248,"data_stored":2085749392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8736,"internal_metadata":766369248},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,7,6,4,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705830,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3457352,"kb_used_data":2407988,"kb_used_omap":9,"kb_used_meta":1049334,"kb_avail":730545848,"statfs":{"total":751619276800,"available":748078948352,"internally_reserved":0,"allocated":2465779712,"data_stored":2465072304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9402,"internal_metadata":1074518854},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2464350208,"data_stored":2464350208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2052366336,"data_stored":2052366336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2277810176,"data_stored":2277810176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2277548032,"data_stored":2277548032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:33:34.852 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:33:34.852 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_6 pg_num 66 2026-02-24T08:33:35.006 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:35.150 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:35.146+0000 7fb55f891640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:35.150 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:35.146+0000 7fb55f891640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:35.167 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:35.295 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:33:35.326 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:35.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:33:35.461 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:35.459+0000 7fe93be2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:35.461 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:35.459+0000 7fe93be2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:35.482 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:35.482 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:35.499 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:35.499 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:35.514 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:35.514 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:35.533 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:35.533 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:35 trial105 ceph-mon[39442]: from='client.15624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:35 trial105 ceph-mon[39442]: pgmap v476: 17 pgs: 17 active+clean; 2.8 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.32k op/s 2026-02-24T08:33:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3300311520' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pg_num", "val": "66"} : dispatch 2026-02-24T08:33:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1778390845' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:37.578 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:37.718 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:38.060 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:38.058+0000 7f8734966640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:38.064 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:38.062+0000 7f8734966640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:38.088 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:38.088 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:38.112 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:38.112 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:38.113 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:37 trial105 ceph-mon[39442]: pgmap v477: 17 pgs: 17 active+clean; 2.5 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s rd, 18 MiB/s wr, 2.92k op/s 2026-02-24T08:33:38.126 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:38.127 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:38.143 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:38.143 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:39.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:38 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4040862893' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:39.842 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:33:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:33:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:33:39.854 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:33:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:33:39] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-24T08:33:40.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:39 trial105 ceph-mon[39442]: pgmap v478: 17 pgs: 17 active+clean; 1.8 GiB data, 9.4 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 12 MiB/s wr, 2.88k op/s 2026-02-24T08:33:40.379 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:33:40.379 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:33:40.380 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:33:40.380 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:40.539 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:40.551 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:40.691 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:40.686+0000 7fce14f6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:40.691 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:40.689+0000 7fce14f6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:40.705 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:40.848 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:33:40.849 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:33:40.850 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:40.845+0000 7fd4a83ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:40.851 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:40.846+0000 7fd4a83ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:40.875 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:40.875 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:40.900 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:40.900 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:40.913 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:33:40.913 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:33:40.913 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:33:40.913 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:33:40.913 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:33:40.913 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3758475371' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:40.913 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:40.913 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:40.914 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":479,"stamp":"2026-02-24T08:33:40.800815+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1971757624,"num_objects":30081,"num_object_clones":0,"num_object_copies":90243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30081,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":386854,"num_write_kb":2966031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160918,"ondisk_log_size":160918,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9866176,"kb_used_data":6187440,"kb_used_omap":35,"kb_used_meta":3678556,"kb_avail":2926146624,"statfs":{"total":3006477107200,"available":2996374142976,"internally_reserved":0,"allocated":6335938560,"data_stored":6333100264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36294,"internal_metadata":3766841914},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,6,17,22,38,17,31,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-956080104,"num_objects":-14589,"num_object_clones":0,"num_object_copies":-43767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14589,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29389,"num_write_kb":105241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003536"},"pg_stats":[{"pgid":"8.f","version":"106'23809","reported_seq":23856,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.894884+0000","last_change":"2026-02-24T08:33:12.558481+0000","last_active":"2026-02-24T08:33:36.894884+0000","last_peered":"2026-02-24T08:33:36.894884+0000","last_clean":"2026-02-24T08:33:36.894884+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:33:36.894884+0000","last_undegraded":"2026-02-24T08:33:36.894884+0000","last_fullsized":"2026-02-24T08:33:36.894884+0000","mapping_epoch":100,"log_start":"102'13800","ondisk_log_start":"102'13800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18952","last_scrub_stamp":"2026-02-24T08:33:12.558422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.558422+0000","objects_scrubbed":2367,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:14.407330+0000","scrub_duration":724,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118882304,"num_objects":1814,"num_object_clones":0,"num_object_copies":5442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1814,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23809,"num_write_kb":182208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"106'24403","reported_seq":24460,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.886058+0000","last_change":"2026-02-24T08:33:30.414558+0000","last_active":"2026-02-24T08:33:36.886058+0000","last_peered":"2026-02-24T08:33:36.886058+0000","last_clean":"2026-02-24T08:33:36.886058+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:33:36.886058+0000","last_undegraded":"2026-02-24T08:33:36.886058+0000","last_fullsized":"2026-02-24T08:33:36.886058+0000","mapping_epoch":100,"log_start":"102'14400","ondisk_log_start":"102'14400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'23216","last_scrub_stamp":"2026-02-24T08:33:30.414475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:30.414475+0000","objects_scrubbed":2895,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:47.156829+0000","scrub_duration":894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122421248,"num_objects":1868,"num_object_clones":0,"num_object_copies":5604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24403,"num_write_kb":186816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"106'23561","reported_seq":23608,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.448092+0000","last_change":"2026-02-24T08:33:05.192827+0000","last_active":"2026-02-24T08:33:36.448092+0000","last_peered":"2026-02-24T08:33:36.448092+0000","last_clean":"2026-02-24T08:33:36.448092+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:33:36.448092+0000","last_undegraded":"2026-02-24T08:33:36.448092+0000","last_fullsized":"2026-02-24T08:33:36.448092+0000","mapping_epoch":100,"log_start":"102'13500","ondisk_log_start":"102'13500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17536","last_scrub_stamp":"2026-02-24T08:33:05.192724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:05.192724+0000","objects_scrubbed":2178,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:18.812981+0000","scrub_duration":1000,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129302552,"num_objects":1974,"num_object_clones":0,"num_object_copies":5922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1974,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23561,"num_write_kb":181569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"106'23952","reported_seq":24008,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.891197+0000","last_change":"2026-02-24T08:33:22.777449+0000","last_active":"2026-02-24T08:33:36.891197+0000","last_peered":"2026-02-24T08:33:36.891197+0000","last_clean":"2026-02-24T08:33:36.891197+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:33:36.891197+0000","last_undegraded":"2026-02-24T08:33:36.891197+0000","last_fullsized":"2026-02-24T08:33:36.891197+0000","mapping_epoch":100,"log_start":"102'13900","ondisk_log_start":"102'13900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21224","last_scrub_stamp":"2026-02-24T08:33:22.777398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:22.777398+0000","objects_scrubbed":2638,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:49.901561+0000","scrub_duration":805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118358016,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1806,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23952,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"106'24679","reported_seq":24733,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.885157+0000","last_change":"2026-02-24T08:33:08.865575+0000","last_active":"2026-02-24T08:33:36.885157+0000","last_peered":"2026-02-24T08:33:36.885157+0000","last_clean":"2026-02-24T08:33:36.885157+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:33:36.885157+0000","last_undegraded":"2026-02-24T08:33:36.885157+0000","last_fullsized":"2026-02-24T08:33:36.885157+0000","mapping_epoch":100,"log_start":"102'14600","ondisk_log_start":"102'14600","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19384","last_scrub_stamp":"2026-02-24T08:33:08.865516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:08.865516+0000","objects_scrubbed":2420,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:25.957973+0000","scrub_duration":1087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123797504,"num_objects":1889,"num_object_clones":0,"num_object_copies":5667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1889,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24679,"num_write_kb":188928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"106'24726","reported_seq":24779,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:37.210281+0000","last_change":"2026-02-24T08:33:14.065578+0000","last_active":"2026-02-24T08:33:37.210281+0000","last_peered":"2026-02-24T08:33:37.210281+0000","last_clean":"2026-02-24T08:33:37.210281+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:33:37.210281+0000","last_undegraded":"2026-02-24T08:33:37.210281+0000","last_fullsized":"2026-02-24T08:33:37.210281+0000","mapping_epoch":100,"log_start":"102'14700","ondisk_log_start":"102'14700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20176","last_scrub_stamp":"2026-02-24T08:33:14.065505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:14.065505+0000","objects_scrubbed":2513,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.447959+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118947840,"num_objects":1815,"num_object_clones":0,"num_object_copies":5445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1815,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24726,"num_write_kb":188736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"106'23813","reported_seq":23868,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.456830+0000","last_change":"2026-02-24T08:33:29.008483+0000","last_active":"2026-02-24T08:33:36.456830+0000","last_peered":"2026-02-24T08:33:36.456830+0000","last_clean":"2026-02-24T08:33:36.456830+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:33:36.456830+0000","last_undegraded":"2026-02-24T08:33:36.456830+0000","last_fullsized":"2026-02-24T08:33:36.456830+0000","mapping_epoch":100,"log_start":"102'13800","ondisk_log_start":"102'13800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'22488","last_scrub_stamp":"2026-02-24T08:33:29.008447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:29.008447+0000","objects_scrubbed":2808,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:30.116262+0000","scrub_duration":280,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125698048,"num_objects":1918,"num_object_clones":0,"num_object_copies":5754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1918,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23813,"num_write_kb":182976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'23809","reported_seq":23855,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:37.218160+0000","last_change":"2026-02-24T08:33:20.588017+0000","last_active":"2026-02-24T08:33:37.218160+0000","last_peered":"2026-02-24T08:33:37.218160+0000","last_clean":"2026-02-24T08:33:37.218160+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:33:37.218160+0000","last_undegraded":"2026-02-24T08:33:37.218160+0000","last_fullsized":"2026-02-24T08:33:37.218160+0000","mapping_epoch":100,"log_start":"102'13800","ondisk_log_start":"102'13800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20704","last_scrub_stamp":"2026-02-24T08:33:20.587976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:20.587976+0000","objects_scrubbed":2557,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:27.431033+0000","scrub_duration":2005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114163712,"num_objects":1742,"num_object_clones":0,"num_object_copies":5226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1742,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23809,"num_write_kb":181696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"106'24799","reported_seq":24856,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.888193+0000","last_change":"2026-02-24T08:33:27.037988+0000","last_active":"2026-02-24T08:33:36.888193+0000","last_peered":"2026-02-24T08:33:36.888193+0000","last_clean":"2026-02-24T08:33:36.888193+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:33:36.888193+0000","last_undegraded":"2026-02-24T08:33:36.888193+0000","last_fullsized":"2026-02-24T08:33:36.888193+0000","mapping_epoch":100,"log_start":"102'14700","ondisk_log_start":"102'14700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'22968","last_scrub_stamp":"2026-02-24T08:33:27.037847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:27.037847+0000","objects_scrubbed":2853,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:56.792907+0000","scrub_duration":1966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130088960,"num_objects":1985,"num_object_clones":0,"num_object_copies":5955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24799,"num_write_kb":190464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"106'24479","reported_seq":24533,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.358133+0000","last_change":"2026-02-24T08:33:06.806177+0000","last_active":"2026-02-24T08:33:36.358133+0000","last_peered":"2026-02-24T08:33:36.358133+0000","last_clean":"2026-02-24T08:33:36.358133+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:33:36.358133+0000","last_undegraded":"2026-02-24T08:33:36.358133+0000","last_fullsized":"2026-02-24T08:33:36.358133+0000","mapping_epoch":100,"log_start":"102'14400","ondisk_log_start":"102'14400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18536","last_scrub_stamp":"2026-02-24T08:33:06.806078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:06.806078+0000","objects_scrubbed":2313,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:19.273551+0000","scrub_duration":761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129826816,"num_objects":1981,"num_object_clones":0,"num_object_copies":5943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1981,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24479,"num_write_kb":188160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"106'24490","reported_seq":24544,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.447673+0000","last_change":"2026-02-24T08:33:12.060340+0000","last_active":"2026-02-24T08:33:36.447673+0000","last_peered":"2026-02-24T08:33:36.447673+0000","last_clean":"2026-02-24T08:33:36.447673+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:33:36.447673+0000","last_undegraded":"2026-02-24T08:33:36.447673+0000","last_fullsized":"2026-02-24T08:33:36.447673+0000","mapping_epoch":100,"log_start":"102'14400","ondisk_log_start":"102'14400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19736","last_scrub_stamp":"2026-02-24T08:33:12.060280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.060280+0000","objects_scrubbed":2462,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:16.715777+0000","scrub_duration":662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128884736,"num_objects":1967,"num_object_clones":0,"num_object_copies":5901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1967,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24490,"num_write_kb":188136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"106'24116","reported_seq":24173,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:37.217701+0000","last_change":"2026-02-24T08:33:22.779095+0000","last_active":"2026-02-24T08:33:37.217701+0000","last_peered":"2026-02-24T08:33:37.217701+0000","last_clean":"2026-02-24T08:33:37.217701+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:33:37.217701+0000","last_undegraded":"2026-02-24T08:33:37.217701+0000","last_fullsized":"2026-02-24T08:33:37.217701+0000","mapping_epoch":100,"log_start":"102'14100","ondisk_log_start":"102'14100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21608","last_scrub_stamp":"2026-02-24T08:33:22.779039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:22.779039+0000","objects_scrubbed":2685,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:26.743296+0000","scrub_duration":1207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119406592,"num_objects":1822,"num_object_clones":0,"num_object_copies":5466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1822,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24116,"num_write_kb":184448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"106'23955","reported_seq":24010,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.454023+0000","last_change":"2026-02-24T08:33:21.899212+0000","last_active":"2026-02-24T08:33:36.454023+0000","last_peered":"2026-02-24T08:33:36.454023+0000","last_clean":"2026-02-24T08:33:36.454023+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:33:36.454023+0000","last_undegraded":"2026-02-24T08:33:36.454023+0000","last_fullsized":"2026-02-24T08:33:36.454023+0000","mapping_epoch":100,"log_start":"102'13900","ondisk_log_start":"102'13900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21392","last_scrub_stamp":"2026-02-24T08:33:21.899145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.899145+0000","objects_scrubbed":2668,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:43.261018+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128188416,"num_objects":1956,"num_object_clones":0,"num_object_copies":5868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1956,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23955,"num_write_kb":184256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"106'23981","reported_seq":24031,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:37.201293+0000","last_change":"2026-02-24T08:33:02.502815+0000","last_active":"2026-02-24T08:33:37.201293+0000","last_peered":"2026-02-24T08:33:37.201293+0000","last_clean":"2026-02-24T08:33:37.201293+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:33:37.201293+0000","last_undegraded":"2026-02-24T08:33:37.201293+0000","last_fullsized":"2026-02-24T08:33:37.201293+0000","mapping_epoch":100,"log_start":"102'13900","ondisk_log_start":"102'13900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17136","last_scrub_stamp":"2026-02-24T08:33:02.502774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:02.502774+0000","objects_scrubbed":2130,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.676850+0000","scrub_duration":986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116457472,"num_objects":1777,"num_object_clones":0,"num_object_copies":5331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23981,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"106'24197","reported_seq":24251,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:37.192945+0000","last_change":"2026-02-24T08:33:21.507517+0000","last_active":"2026-02-24T08:33:37.192945+0000","last_peered":"2026-02-24T08:33:37.192945+0000","last_clean":"2026-02-24T08:33:37.192945+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:33:37.192945+0000","last_undegraded":"2026-02-24T08:33:37.192945+0000","last_fullsized":"2026-02-24T08:33:37.192945+0000","mapping_epoch":100,"log_start":"102'14100","ondisk_log_start":"102'14100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21274","last_scrub_stamp":"2026-02-24T08:33:21.507423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.507423+0000","objects_scrubbed":2641,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:40.355136+0000","scrub_duration":933,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116457472,"num_objects":1777,"num_object_clones":0,"num_object_copies":5331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1777,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24197,"num_write_kb":184704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"106'23950","reported_seq":24000,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:36.452661+0000","last_change":"2026-02-24T08:33:00.610675+0000","last_active":"2026-02-24T08:33:36.452661+0000","last_peered":"2026-02-24T08:33:36.452661+0000","last_clean":"2026-02-24T08:33:36.452661+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:33:36.452661+0000","last_undegraded":"2026-02-24T08:33:36.452661+0000","last_fullsized":"2026-02-24T08:33:36.452661+0000","mapping_epoch":100,"log_start":"102'13900","ondisk_log_start":"102'13900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'16512","last_scrub_stamp":"2026-02-24T08:33:00.610606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:00.610606+0000","objects_scrubbed":2041,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:28.134694+0000","scrub_duration":1365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130285568,"num_objects":1988,"num_object_clones":0,"num_object_copies":5964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1988,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23950,"num_write_kb":184448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":289,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.883262+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:26.883262+0000","last_peered":"2026-02-24T08:33:26.883262+0000","last_clean":"2026-02-24T08:33:26.883262+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:26.883262+0000","last_undegraded":"2026-02-24T08:33:26.883262+0000","last_fullsized":"2026-02-24T08:33:26.883262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":1971167256,"num_objects":30079,"num_object_clones":0,"num_object_copies":90237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30079,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":386719,"num_write_kb":2963881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5976887296,"data_stored":5976875080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160819,"ondisk_log_size":160819,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247969,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2498828,"kb_used_data":1573240,"kb_used_omap":9,"kb_used_meta":925558,"kb_avail":731504372,"statfs":{"total":751619276800,"available":749060476928,"internally_reserved":0,"allocated":1610997760,"data_stored":1610286280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9417,"internal_metadata":947772215},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,7,5,13,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444195,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2459084,"kb_used_data":1521848,"kb_used_omap":8,"kb_used_meta":937207,"kb_avail":731544116,"statfs":{"total":751619276800,"available":749101174784,"internally_reserved":0,"allocated":1558372352,"data_stored":1557660872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8739,"internal_metadata":959700445},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,7,9,13,12,21],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575013,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2113348,"kb_used_data":1364848,"kb_used_omap":8,"kb_used_meta":748407,"kb_avail":731889852,"statfs":{"total":751619276800,"available":749455208448,"internally_reserved":0,"allocated":1397604352,"data_stored":1396900496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8736,"internal_metadata":766369248},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,4,3,8,12,3,10,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705831,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2794916,"kb_used_data":1727504,"kb_used_omap":9,"kb_used_meta":1067382,"kb_avail":731208284,"statfs":{"total":751619276800,"available":748757282816,"internally_reserved":0,"allocated":1768964096,"data_stored":1768252616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9402,"internal_metadata":1093000006},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1587875840,"data_stored":1587871768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1288019968,"data_stored":1288019968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1544531968,"data_stored":1544527896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1556459520,"data_stored":1556455448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:33:40.914 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:33:40.915 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 291 2026-02-24T08:33:40.928 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:40.928 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:41.056 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:41.200 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:41.198+0000 7fc8aaf85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:41.201 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:41.199+0000 7fc8aaf85640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:41.366 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:33:41.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:33:42.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:41 trial105 ceph-mon[39442]: pgmap v479: 17 pgs: 17 active+clean; 1.8 GiB data, 9.4 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 8.6 MiB/s wr, 2.45k op/s 2026-02-24T08:33:42.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:41 trial105 ceph-mon[39442]: from='client.15632 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:42.190 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:41 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1262955151' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "291"} : dispatch 2026-02-24T08:33:42.979 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:43.135 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:43.278 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:43 trial105 ceph-mon[39442]: pgmap v480: 17 pgs: 17 active+clean; 883 MiB data, 6.4 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 8.6 MiB/s wr, 3.78k op/s 2026-02-24T08:33:43.346 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:43.328+0000 7f54ac901640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:43.347 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:43.328+0000 7f54ac901640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:43.352 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:43.352 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:43.370 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:43.370 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:43.382 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:43.383 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:43.406 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:43.407 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:44.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2829565928' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:44.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:33:45.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:45 trial105 ceph-mon[39442]: pgmap v481: 17 pgs: 17 active+clean; 883 MiB data, 6.4 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 85 B/s wr, 2.66k op/s 2026-02-24T08:33:45.622 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:45.765 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:45.872 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:45.868+0000 7f4071de5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:45.872 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:45.868+0000 7f4071de5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:45.899 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:45.899 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:45.915 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:45.915 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:45.929 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:45.929 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:45.942 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:45.943 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:46.150 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Removed 46311 objects 2026-02-24T08:33:46.150 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Clean up completed and total clean up time :14.1919 2026-02-24T08:33:46.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:46 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/239308772' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:46.443 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:33:46.443 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:33:46.443 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_6 2026-02-24T08:33:46.444 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:46.562 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:46.664 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:46.661+0000 7f685aa26640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:46.665 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:46.661+0000 7f685aa26640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:46.772 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:33:46.773 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:33:46.807 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2026-02-24T08:33:44.801383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":925409848,"num_objects":14115,"num_object_clones":0,"num_object_copies":42345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14115,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":402820,"num_write_kb":2966031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160984,"ondisk_log_size":160984,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6677312,"kb_used_data":2962544,"kb_used_omap":35,"kb_used_meta":3714652,"kb_avail":2929335488,"statfs":{"total":3006477107200,"available":2999639539712,"internally_reserved":0,"allocated":3033645056,"data_stored":3030806760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36294,"internal_metadata":3803804218},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,23,21,35,30,21,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2096037864,"num_objects":-31982,"num_object_clones":0,"num_object_copies":-95946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31982,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":31984,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003555"},"pg_stats":[{"pgid":"8.f","version":"106'24738","reported_seq":24791,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.900824+0000","last_change":"2026-02-24T08:33:12.558481+0000","last_active":"2026-02-24T08:33:41.900824+0000","last_peered":"2026-02-24T08:33:41.900824+0000","last_clean":"2026-02-24T08:33:41.900824+0000","last_became_active":"2026-02-24T08:31:59.852173+0000","last_became_peered":"2026-02-24T08:31:59.852173+0000","last_unstale":"2026-02-24T08:33:41.900824+0000","last_undegraded":"2026-02-24T08:33:41.900824+0000","last_fullsized":"2026-02-24T08:33:41.900824+0000","mapping_epoch":100,"log_start":"102'14700","ondisk_log_start":"102'14700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18952","last_scrub_stamp":"2026-02-24T08:33:12.558422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.558422+0000","objects_scrubbed":2367,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:14.407330+0000","scrub_duration":724,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57999360,"num_objects":885,"num_object_clones":0,"num_object_copies":2655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":885,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24738,"num_write_kb":182208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"106'25414","reported_seq":25471,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.909419+0000","last_change":"2026-02-24T08:33:30.414558+0000","last_active":"2026-02-24T08:33:41.909419+0000","last_peered":"2026-02-24T08:33:41.909419+0000","last_clean":"2026-02-24T08:33:41.909419+0000","last_became_active":"2026-02-24T08:31:59.851703+0000","last_became_peered":"2026-02-24T08:31:59.851703+0000","last_unstale":"2026-02-24T08:33:41.909419+0000","last_undegraded":"2026-02-24T08:33:41.909419+0000","last_fullsized":"2026-02-24T08:33:41.909419+0000","mapping_epoch":100,"log_start":"102'15400","ondisk_log_start":"102'15400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'23216","last_scrub_stamp":"2026-02-24T08:33:30.414475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:30.414475+0000","objects_scrubbed":2895,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:47.156829+0000","scrub_duration":894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164352,"num_objects":857,"num_object_clones":0,"num_object_copies":2571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25414,"num_write_kb":186816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"106'24570","reported_seq":24617,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.474382+0000","last_change":"2026-02-24T08:33:05.192827+0000","last_active":"2026-02-24T08:33:41.474382+0000","last_peered":"2026-02-24T08:33:41.474382+0000","last_clean":"2026-02-24T08:33:41.474382+0000","last_became_active":"2026-02-24T08:31:59.856463+0000","last_became_peered":"2026-02-24T08:31:59.856463+0000","last_unstale":"2026-02-24T08:33:41.474382+0000","last_undegraded":"2026-02-24T08:33:41.474382+0000","last_fullsized":"2026-02-24T08:33:41.474382+0000","mapping_epoch":100,"log_start":"102'14500","ondisk_log_start":"102'14500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17536","last_scrub_stamp":"2026-02-24T08:33:05.192724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:05.192724+0000","objects_scrubbed":2178,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:18.812981+0000","scrub_duration":1000,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63176728,"num_objects":965,"num_object_clones":0,"num_object_copies":2895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":965,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24570,"num_write_kb":181569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"106'24883","reported_seq":24938,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.899980+0000","last_change":"2026-02-24T08:33:22.777449+0000","last_active":"2026-02-24T08:33:41.899980+0000","last_peered":"2026-02-24T08:33:41.899980+0000","last_clean":"2026-02-24T08:33:41.899980+0000","last_became_active":"2026-02-24T08:31:59.853801+0000","last_became_peered":"2026-02-24T08:31:59.853801+0000","last_unstale":"2026-02-24T08:33:41.899980+0000","last_undegraded":"2026-02-24T08:33:41.899980+0000","last_fullsized":"2026-02-24T08:33:41.899980+0000","mapping_epoch":100,"log_start":"102'14800","ondisk_log_start":"102'14800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21224","last_scrub_stamp":"2026-02-24T08:33:22.777398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:22.777398+0000","objects_scrubbed":2638,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:49.901561+0000","scrub_duration":805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57344000,"num_objects":875,"num_object_clones":0,"num_object_copies":2625,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":875,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24883,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"106'25759","reported_seq":25805,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.902405+0000","last_change":"2026-02-24T08:33:08.865575+0000","last_active":"2026-02-24T08:33:41.902405+0000","last_peered":"2026-02-24T08:33:41.902405+0000","last_clean":"2026-02-24T08:33:41.902405+0000","last_became_active":"2026-02-24T08:31:59.855240+0000","last_became_peered":"2026-02-24T08:31:59.855240+0000","last_unstale":"2026-02-24T08:33:41.902405+0000","last_undegraded":"2026-02-24T08:33:41.902405+0000","last_fullsized":"2026-02-24T08:33:41.902405+0000","mapping_epoch":100,"log_start":"102'15700","ondisk_log_start":"102'15700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19384","last_scrub_stamp":"2026-02-24T08:33:08.865516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:08.865516+0000","objects_scrubbed":2420,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:25.957973+0000","scrub_duration":1087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53018624,"num_objects":809,"num_object_clones":0,"num_object_copies":2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":809,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25759,"num_write_kb":188928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"106'25731","reported_seq":25784,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:42.236091+0000","last_change":"2026-02-24T08:33:14.065578+0000","last_active":"2026-02-24T08:33:42.236091+0000","last_peered":"2026-02-24T08:33:42.236091+0000","last_clean":"2026-02-24T08:33:42.236091+0000","last_became_active":"2026-02-24T08:31:59.852153+0000","last_became_peered":"2026-02-24T08:31:59.852153+0000","last_unstale":"2026-02-24T08:33:42.236091+0000","last_undegraded":"2026-02-24T08:33:42.236091+0000","last_fullsized":"2026-02-24T08:33:42.236091+0000","mapping_epoch":100,"log_start":"102'15700","ondisk_log_start":"102'15700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20176","last_scrub_stamp":"2026-02-24T08:33:14.065505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:14.065505+0000","objects_scrubbed":2513,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.447959+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53084160,"num_objects":810,"num_object_clones":0,"num_object_copies":2430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":810,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25731,"num_write_kb":188736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"106'24761","reported_seq":24817,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.459696+0000","last_change":"2026-02-24T08:33:29.008483+0000","last_active":"2026-02-24T08:33:41.459696+0000","last_peered":"2026-02-24T08:33:41.459696+0000","last_clean":"2026-02-24T08:33:41.459696+0000","last_became_active":"2026-02-24T08:31:59.856124+0000","last_became_peered":"2026-02-24T08:31:59.856124+0000","last_unstale":"2026-02-24T08:33:41.459696+0000","last_undegraded":"2026-02-24T08:33:41.459696+0000","last_fullsized":"2026-02-24T08:33:41.459696+0000","mapping_epoch":100,"log_start":"102'14700","ondisk_log_start":"102'14700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'22488","last_scrub_stamp":"2026-02-24T08:33:29.008447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:29.008447+0000","objects_scrubbed":2808,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:30.116262+0000","scrub_duration":280,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63569920,"num_objects":970,"num_object_clones":0,"num_object_copies":2910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24761,"num_write_kb":182976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"106'24796","reported_seq":24851,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:42.244242+0000","last_change":"2026-02-24T08:33:20.588017+0000","last_active":"2026-02-24T08:33:42.244242+0000","last_peered":"2026-02-24T08:33:42.244242+0000","last_clean":"2026-02-24T08:33:42.244242+0000","last_became_active":"2026-02-24T08:31:59.852517+0000","last_became_peered":"2026-02-24T08:31:59.852517+0000","last_unstale":"2026-02-24T08:33:42.244242+0000","last_undegraded":"2026-02-24T08:33:42.244242+0000","last_fullsized":"2026-02-24T08:33:42.244242+0000","mapping_epoch":100,"log_start":"102'14700","ondisk_log_start":"102'14700","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'20704","last_scrub_stamp":"2026-02-24T08:33:20.587976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:20.587976+0000","objects_scrubbed":2557,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:27.431033+0000","scrub_duration":2005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49479680,"num_objects":755,"num_object_clones":0,"num_object_copies":2265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":755,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24796,"num_write_kb":181696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"106'25851","reported_seq":25907,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.909823+0000","last_change":"2026-02-24T08:33:27.037988+0000","last_active":"2026-02-24T08:33:41.909823+0000","last_peered":"2026-02-24T08:33:41.909823+0000","last_clean":"2026-02-24T08:33:41.909823+0000","last_became_active":"2026-02-24T08:31:59.854021+0000","last_became_peered":"2026-02-24T08:31:59.854021+0000","last_unstale":"2026-02-24T08:33:41.909823+0000","last_undegraded":"2026-02-24T08:33:41.909823+0000","last_fullsized":"2026-02-24T08:33:41.909823+0000","mapping_epoch":100,"log_start":"102'15800","ondisk_log_start":"102'15800","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'22968","last_scrub_stamp":"2026-02-24T08:33:27.037847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:27.037847+0000","objects_scrubbed":2853,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:56.792907+0000","scrub_duration":1966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":933,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25851,"num_write_kb":190464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"106'25455","reported_seq":25509,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.386555+0000","last_change":"2026-02-24T08:33:06.806177+0000","last_active":"2026-02-24T08:33:41.386555+0000","last_peered":"2026-02-24T08:33:41.386555+0000","last_clean":"2026-02-24T08:33:41.386555+0000","last_became_active":"2026-02-24T08:31:59.855090+0000","last_became_peered":"2026-02-24T08:31:59.855090+0000","last_unstale":"2026-02-24T08:33:41.386555+0000","last_undegraded":"2026-02-24T08:33:41.386555+0000","last_fullsized":"2026-02-24T08:33:41.386555+0000","mapping_epoch":100,"log_start":"102'15400","ondisk_log_start":"102'15400","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'18536","last_scrub_stamp":"2026-02-24T08:33:06.806078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:06.806078+0000","objects_scrubbed":2313,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:19.273551+0000","scrub_duration":761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65863680,"num_objects":1005,"num_object_clones":0,"num_object_copies":3015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1005,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25455,"num_write_kb":188160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"106'25516","reported_seq":25568,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.485040+0000","last_change":"2026-02-24T08:33:12.060340+0000","last_active":"2026-02-24T08:33:41.485040+0000","last_peered":"2026-02-24T08:33:41.485040+0000","last_clean":"2026-02-24T08:33:41.485040+0000","last_became_active":"2026-02-24T08:31:59.856245+0000","last_became_peered":"2026-02-24T08:31:59.856245+0000","last_unstale":"2026-02-24T08:33:41.485040+0000","last_undegraded":"2026-02-24T08:33:41.485040+0000","last_fullsized":"2026-02-24T08:33:41.485040+0000","mapping_epoch":100,"log_start":"102'15500","ondisk_log_start":"102'15500","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'19736","last_scrub_stamp":"2026-02-24T08:33:12.060280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:12.060280+0000","objects_scrubbed":2462,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:16.715777+0000","scrub_duration":662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61644800,"num_objects":941,"num_object_clones":0,"num_object_copies":2823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":941,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25516,"num_write_kb":188136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"106'25141","reported_seq":25199,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:42.241143+0000","last_change":"2026-02-24T08:33:22.779095+0000","last_active":"2026-02-24T08:33:42.241143+0000","last_peered":"2026-02-24T08:33:42.241143+0000","last_clean":"2026-02-24T08:33:42.241143+0000","last_became_active":"2026-02-24T08:31:59.854361+0000","last_became_peered":"2026-02-24T08:31:59.854361+0000","last_unstale":"2026-02-24T08:33:42.241143+0000","last_undegraded":"2026-02-24T08:33:42.241143+0000","last_fullsized":"2026-02-24T08:33:42.241143+0000","mapping_epoch":100,"log_start":"102'15100","ondisk_log_start":"102'15100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21608","last_scrub_stamp":"2026-02-24T08:33:22.779039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:22.779039+0000","objects_scrubbed":2685,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:26.743296+0000","scrub_duration":1207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232192,"num_objects":797,"num_object_clones":0,"num_object_copies":2391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":797,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25141,"num_write_kb":184448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"106'24988","reported_seq":25045,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.474564+0000","last_change":"2026-02-24T08:33:21.899212+0000","last_active":"2026-02-24T08:33:41.474564+0000","last_peered":"2026-02-24T08:33:41.474564+0000","last_clean":"2026-02-24T08:33:41.474564+0000","last_became_active":"2026-02-24T08:31:59.854856+0000","last_became_peered":"2026-02-24T08:31:59.854856+0000","last_unstale":"2026-02-24T08:33:41.474564+0000","last_undegraded":"2026-02-24T08:33:41.474564+0000","last_fullsized":"2026-02-24T08:33:41.474564+0000","mapping_epoch":100,"log_start":"102'14900","ondisk_log_start":"102'14900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21392","last_scrub_stamp":"2026-02-24T08:33:21.899145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.899145+0000","objects_scrubbed":2668,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:43.261018+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60489728,"num_objects":923,"num_object_clones":0,"num_object_copies":2769,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24988,"num_write_kb":184256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"106'24966","reported_seq":25018,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:42.228472+0000","last_change":"2026-02-24T08:33:02.502815+0000","last_active":"2026-02-24T08:33:42.228472+0000","last_peered":"2026-02-24T08:33:42.228472+0000","last_clean":"2026-02-24T08:33:42.228472+0000","last_became_active":"2026-02-24T08:31:59.854322+0000","last_became_peered":"2026-02-24T08:31:59.854322+0000","last_unstale":"2026-02-24T08:33:42.228472+0000","last_undegraded":"2026-02-24T08:33:42.228472+0000","last_fullsized":"2026-02-24T08:33:42.228472+0000","mapping_epoch":100,"log_start":"102'14900","ondisk_log_start":"102'14900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'17136","last_scrub_stamp":"2026-02-24T08:33:02.502774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:02.502774+0000","objects_scrubbed":2130,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:21.676850+0000","scrub_duration":986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51904512,"num_objects":792,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24966,"num_write_kb":183168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"106'25187","reported_seq":25242,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:42.236167+0000","last_change":"2026-02-24T08:33:21.507517+0000","last_active":"2026-02-24T08:33:42.236167+0000","last_peered":"2026-02-24T08:33:42.236167+0000","last_clean":"2026-02-24T08:33:42.236167+0000","last_became_active":"2026-02-24T08:31:59.853999+0000","last_became_peered":"2026-02-24T08:31:59.853999+0000","last_unstale":"2026-02-24T08:33:42.236167+0000","last_undegraded":"2026-02-24T08:33:42.236167+0000","last_fullsized":"2026-02-24T08:33:42.236167+0000","mapping_epoch":100,"log_start":"102'15100","ondisk_log_start":"102'15100","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'21274","last_scrub_stamp":"2026-02-24T08:33:21.507423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:21.507423+0000","objects_scrubbed":2641,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:40.355136+0000","scrub_duration":933,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51576832,"num_objects":787,"num_object_clones":0,"num_object_copies":2361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25187,"num_write_kb":184704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"106'24929","reported_seq":24976,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:41.472497+0000","last_change":"2026-02-24T08:33:00.610675+0000","last_active":"2026-02-24T08:33:41.472497+0000","last_peered":"2026-02-24T08:33:41.472497+0000","last_clean":"2026-02-24T08:33:41.472497+0000","last_became_active":"2026-02-24T08:31:59.855488+0000","last_became_peered":"2026-02-24T08:31:59.855488+0000","last_unstale":"2026-02-24T08:33:41.472497+0000","last_undegraded":"2026-02-24T08:33:41.472497+0000","last_fullsized":"2026-02-24T08:33:41.472497+0000","mapping_epoch":100,"log_start":"102'14900","ondisk_log_start":"102'14900","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'16512","last_scrub_stamp":"2026-02-24T08:33:00.610606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:31:58.841840+0000","last_clean_scrub_stamp":"2026-02-24T08:33:00.610606+0000","objects_scrubbed":2041,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:28.134694+0000","scrub_duration":1365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66125824,"num_objects":1009,"num_object_clones":0,"num_object_copies":3027,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1009,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24929,"num_write_kb":184448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":289,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.883262+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:26.883262+0000","last_peered":"2026-02-24T08:33:26.883262+0000","last_clean":"2026-02-24T08:33:26.883262+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:26.883262+0000","last_undegraded":"2026-02-24T08:33:26.883262+0000","last_fullsized":"2026-02-24T08:33:26.883262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":924819480,"num_objects":14113,"num_object_clones":0,"num_object_copies":42339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14113,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":402685,"num_write_kb":2963881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2839482368,"data_stored":2839470152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160885,"ondisk_log_size":160885,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247970,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1733836,"kb_used_data":808248,"kb_used_omap":9,"kb_used_meta":925558,"kb_avail":732269364,"statfs":{"total":751619276800,"available":749843828736,"internally_reserved":0,"allocated":827645952,"data_stored":826934472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9417,"internal_metadata":947772215},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,9,9,12,16,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444196,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1728524,"kb_used_data":755192,"kb_used_omap":8,"kb_used_meta":973303,"kb_avail":732274676,"statfs":{"total":751619276800,"available":749849268224,"internally_reserved":0,"allocated":773316608,"data_stored":772605128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8739,"internal_metadata":996662749},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,9,3,11,7,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575014,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1404804,"kb_used_data":656368,"kb_used_omap":8,"kb_used_meta":748407,"kb_avail":732598396,"statfs":{"total":751619276800,"available":750180757504,"internally_reserved":0,"allocated":672120832,"data_stored":671416976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8736,"internal_metadata":766369248},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,4,5,9,12,7,14,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705832,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1810148,"kb_used_data":742736,"kb_used_omap":9,"kb_used_meta":1067382,"kb_avail":732193052,"statfs":{"total":751619276800,"available":749765685248,"internally_reserved":0,"allocated":760561664,"data_stored":759850184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9402,"internal_metadata":1093000006},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":740888576,"data_stored":740884504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":570662912,"data_stored":570662912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":758624256,"data_stored":758620184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":769306624,"data_stored":769302552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:33:46.809 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_6 pgp_num 66 2026-02-24T08:33:46.925 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:47.025 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:47.021+0000 7f688ccc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:47.025 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:47.022+0000 7f688ccc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:47.135 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:33:47.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:33:47.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:47 trial105 ceph-mon[39442]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:47.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:47 trial105 ceph-mon[39442]: pgmap v482: 17 pgs: 17 active+clean; 519 MiB data, 4.9 GiB used, 2.7 TiB / 2.7 TiB avail; 85 B/s rd, 85 B/s wr, 3.15k op/s 2026-02-24T08:33:47.987 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:48.107 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:48.200 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:48.197+0000 7f211b9e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:48.200 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:48.197+0000 7f211b9e2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:48.213 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:48.213 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:48.223 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:48.223 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:48.234 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:48.234 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:48.245 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:48.245 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:48.271 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:48 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/160221017' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_6", "var": "pgp_num", "val": "66"} : dispatch 2026-02-24T08:33:48.271 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:48 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:33:48.272 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:48 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:33:49.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2385715673' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:49.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:49 trial105 ceph-mon[39442]: pgmap v483: 17 pgs: 17 active+clean; 577 KiB data, 3.6 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 3.38k op/s 2026-02-24T08:33:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:33:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:33:49.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:33:49.939 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:33:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:33:49] "GET /metrics HTTP/1.1" 200 4223 "" "Prometheus/3.6.0" 2026-02-24T08:33:50.300 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:50.419 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:50.516 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:50.512+0000 7f69709c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:50.516 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:50.513+0000 7f69709c5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:50.528 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:50.529 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:50.539 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:50.539 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:50.550 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:50.551 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:50.561 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:50.561 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:50.574 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3729796792' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:50.718 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_6 2026-02-24T08:33:50.718 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2026-02-24T08:33:50.834 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:50.935 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:50.932+0000 7f0e54c89640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:50.935 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:50.932+0000 7f0e54c89640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:51.570 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_6' removed 2026-02-24T08:33:51.621 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-24T08:33:51.621 INFO:tasks.radosbench:Beginning radosbench... 2026-02-24T08:33:51.622 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_7 2026-02-24T08:33:51.622 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool create unique_pool_7 16 2026-02-24T08:33:51.738 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:51.846 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:51.842+0000 7f9d8bce7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:51.846 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:51.843+0000 7f9d8bce7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:51.846 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:51 trial105 ceph-mon[39442]: pgmap v484: 17 pgs: 17 active+clean; 577 KiB data, 3.6 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.50k op/s 2026-02-24T08:33:51.847 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1531738365' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:33:52.109 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_7' created 2026-02-24T08:33:52.150 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2026-02-24T08:33:52.167 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:33:52.167 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:33:52.264 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:52.366 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:52.362+0000 7fec24333640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:52.366 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:52.363+0000 7fec24333640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:52.597 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:52.621 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1531738365' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_6", "pool2": "unique_pool_6", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:33:52.621 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:52 trial105 ceph-mon[39442]: osdmap e107: 4 total, 4 up, 4 in 2026-02-24T08:33:52.621 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4229129110' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16} : dispatch 2026-02-24T08:33:52.621 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4229129110' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_7", "pg_num": 16}]': finished 2026-02-24T08:33:52.621 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:52 trial105 ceph-mon[39442]: osdmap e108: 4 total, 4 up, 4 in 2026-02-24T08:33:52.621 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3291516670' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true} : dispatch 2026-02-24T08:33:52.714 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:52.816 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:52.812+0000 7feb6fc38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:52.816 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:52.813+0000 7feb6fc38640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:52.829 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:52.829 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:52.839 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:52.840 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:52.850 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:52.850 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:52.861 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:52.861 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:53.115 INFO:teuthology.orchestra.run.trial105.stderr:enabled application 'rados' on pool 'unique_pool_7' 2026-02-24T08:33:53.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:53 trial105 ceph-mon[39442]: pgmap v487: 17 pgs: 5 creating+peering, 11 unknown, 1 active+clean; 577 KiB data, 3.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:33:53.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:53 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/882757666' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:53.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:53 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3291516670' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_7", "app": "rados", "yes_i_really_mean_it": true}]': finished 2026-02-24T08:33:53.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:53 trial105 ceph-mon[39442]: osdmap e109: 4 total, 4 up, 4 in 2026-02-24T08:33:54.158 DEBUG:teuthology.orchestra.run.trial105:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 128 -b 8192 --object-size 65536 -p unique_pool_7 bench 90 write' 2026-02-24T08:33:54.158 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:33:54.158 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:54.160 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-24T08:33:54.160 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-24T08:33:54.207 INFO:tasks.radosbench.radosbench.0.trial105.stdout:hints = 1 2026-02-24T08:33:54.207 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Maintaining 128 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-24T08:33:54.207 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object prefix: benchmark_data_trial105_148140 2026-02-24T08:33:54.208 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:33:54.208 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 0 0 0 0 0 0 - 0 2026-02-24T08:33:54.302 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:54.433 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:54.430+0000 7fdc01a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:54.434 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:54.430+0000 7fdc01a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:54.588 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:33:54.589 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:33:54.635 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":489,"stamp":"2026-02-24T08:33:54.113846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":3793108,"kb_used_data":6148,"kb_used_omap":37,"kb_used_meta":3786842,"kb_avail":2932219692,"statfs":{"total":3006477107200,"available":3002592964608,"internally_reserved":0,"allocated":6295552,"data_stored":3453714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38250,"internal_metadata":3877726870},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-416798,"num_write_kb":-2963881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.311890"},"pg_stats":[{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2026-02-24T08:33:52.114444+0000","last_change":"2026-02-24T08:33:52.114444+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.114444+0000","last_undegraded":"2026-02-24T08:33:52.114444+0000","last_fullsized":"2026-02-24T08:33:52.114444+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2026-02-24T08:33:52.113950+0000","last_change":"2026-02-24T08:33:52.113950+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.113950+0000","last_undegraded":"2026-02-24T08:33:52.113950+0000","last_fullsized":"2026-02-24T08:33:52.113950+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2026-02-24T08:33:52.113986+0000","last_change":"2026-02-24T08:33:52.113986+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.113986+0000","last_undegraded":"2026-02-24T08:33:52.113986+0000","last_fullsized":"2026-02-24T08:33:52.113986+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T08:33:52.107047+0000","last_change":"2026-02-24T08:33:52.107047+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.107047+0000","last_undegraded":"2026-02-24T08:33:52.107047+0000","last_fullsized":"2026-02-24T08:33:52.107047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2026-02-24T08:33:52.114008+0000","last_change":"2026-02-24T08:33:52.114008+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.114008+0000","last_undegraded":"2026-02-24T08:33:52.114008+0000","last_fullsized":"2026-02-24T08:33:52.114008+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2026-02-24T08:33:52.114363+0000","last_change":"2026-02-24T08:33:52.114363+0000","last_active":"2026-02-24T08:33:52.107047+0000","last_peered":"2026-02-24T08:33:52.107047+0000","last_clean":"2026-02-24T08:33:52.107047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T08:33:52.114363+0000","last_undegraded":"2026-02-24T08:33:52.114363+0000","last_fullsized":"2026-02-24T08:33:52.114363+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":289,"reported_epoch":106,"state":"active+clean","last_fresh":"2026-02-24T08:33:26.883262+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:26.883262+0000","last_peered":"2026-02-24T08:33:26.883262+0000","last_clean":"2026-02-24T08:33:26.883262+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:26.883262+0000","last_undegraded":"2026-02-24T08:33:26.883262+0000","last_fullsized":"2026-02-24T08:33:26.883262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":15,"acting":15,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247972,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":945312,"kb_used_data":1676,"kb_used_omap":9,"kb_used_meta":943606,"kb_avail":733057888,"statfs":{"total":751619276800,"available":750651277312,"internally_reserved":0,"allocated":1716224,"data_stored":1008816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9417,"internal_metadata":966253367},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444198,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":975008,"kb_used_data":1676,"kb_used_omap":9,"kb_used_meta":973302,"kb_avail":733028192,"statfs":{"total":751619276800,"available":750620868608,"internally_reserved":0,"allocated":1716224,"data_stored":1008816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9391,"internal_metadata":996662097},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":785640,"kb_used_data":1108,"kb_used_omap":9,"kb_used_meta":784502,"kb_avail":733217560,"statfs":{"total":751619276800,"available":750814781440,"internally_reserved":0,"allocated":1134592,"data_stored":422857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9388,"internal_metadata":803330900},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705834,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1087148,"kb_used_data":1688,"kb_used_omap":9,"kb_used_meta":1085430,"kb_avail":732916052,"statfs":{"total":751619276800,"available":750506037248,"internally_reserved":0,"allocated":1728512,"data_stored":1013225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10054,"internal_metadata":1111480506},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:33:54.897 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:55.047 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:55.171 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:55.167+0000 7fb450742640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:55.171 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:55.168+0000 7fb450742640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:55.187 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:55.187 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:55.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:55 trial105 ceph-mon[39442]: osdmap e110: 4 total, 4 up, 4 in 2026-02-24T08:33:55.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:55 trial105 ceph-mon[39442]: from='client.15661 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:33:55.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:55 trial105 ceph-mon[39442]: pgmap v490: 17 pgs: 5 creating+peering, 11 unknown, 1 active+clean; 577 KiB data, 3.6 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:33:55.201 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:55.201 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:55.208 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 1 127 10229 10102 78.9154 78.9219 0.0111891 0.0125812 2026-02-24T08:33:55.219 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:55.219 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:55.235 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:55.236 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:56.208 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 2 128 20474 20346 79.4703 80.0312 0.0110966 0.0124962 2026-02-24T08:33:56.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1741544431' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:57.208 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 3 128 30407 30279 78.8455 77.6016 0.0151468 0.0126444 2026-02-24T08:33:57.289 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:33:57.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:57 trial105 ceph-mon[39442]: pgmap v491: 17 pgs: 8 active+clean, 5 creating+peering, 4 unknown; 78 MiB data, 3.8 GiB used, 2.7 TiB / 2.7 TiB avail; 15 MiB/s wr, 1.89k op/s 2026-02-24T08:33:57.444 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:57.581 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:57.578+0000 7f3158baf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:57.581 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:57.579+0000 7f3158baf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:57.603 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:33:57.603 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:33:57.620 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:33:57.620 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:33:57.635 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:33:57.635 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:33:57.649 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:33:57.650 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:33:58.208 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 4 128 39591 39463 77.0692 71.75 0.0120713 0.0129448 2026-02-24T08:33:58.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3907017897' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:33:59.208 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 5 127 48336 48209 75.3199 68.3281 0.0119728 0.0132281 2026-02-24T08:33:59.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:59 trial105 ceph-mon[39442]: pgmap v492: 17 pgs: 17 active+clean; 208 MiB data, 4.2 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 3.96k op/s 2026-02-24T08:33:59.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:33:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:33:59.637 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:33:59.637 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:33:59.638 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_7 2026-02-24T08:33:59.638 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:33:59.699 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:33:59.806 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:59.834 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:33:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:33:59] "GET /metrics HTTP/1.1" 200 4206 "" "Prometheus/3.6.0" 2026-02-24T08:33:59.871 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:33:59.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:33:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:33:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:33:59.943 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:59.941+0000 7f875f59e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:33:59.944 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:33:59.941+0000 7f875f59e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:00.007 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:00.005+0000 7f094e5d0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:00.007 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:00.005+0000 7f094e5d0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:00.030 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:00.030 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:00.044 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:00.044 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:00.059 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:00.059 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:00.074 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:00.075 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:00.111 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:34:00.112 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:34:00.209 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 6 128 56055 55927 72.8063 60.2969 0.0303789 0.0137076 2026-02-24T08:34:00.216 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":492,"stamp":"2026-02-24T08:33:58.803353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":218047008,"num_objects":3324,"num_object_clones":0,"num_object_copies":9972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3324,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":26680,"num_write_kb":214510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26644,"ondisk_log_size":26644,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":4390532,"kb_used_data":513324,"kb_used_omap":44,"kb_used_meta":3877075,"kb_avail":2931622268,"statfs":{"total":3006477107200,"available":3001981202432,"internally_reserved":0,"allocated":525643776,"data_stored":522695856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46074,"internal_metadata":3970124806},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":217456640,"num_objects":3322,"num_object_clones":0,"num_object_copies":9966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3322,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26545,"num_write_kb":212360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.694400"},"pg_stats":[{"pgid":"9.f","version":"110'1484","reported_seq":1494,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.489249+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:33:56.489249+0000","last_peered":"2026-02-24T08:33:56.489249+0000","last_clean":"2026-02-24T08:33:56.489249+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:33:56.489249+0000","last_undegraded":"2026-02-24T08:33:56.489249+0000","last_fullsized":"2026-02-24T08:33:56.489249+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1484,"log_dups_size":0,"ondisk_log_size":1484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12156928,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":11872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"110'1272","reported_seq":1285,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.489157+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:33:56.489157+0000","last_peered":"2026-02-24T08:33:56.489157+0000","last_clean":"2026-02-24T08:33:56.489157+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:33:56.489157+0000","last_undegraded":"2026-02-24T08:33:56.489157+0000","last_fullsized":"2026-02-24T08:33:56.489157+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"110'1369","reported_seq":1382,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.405267+0000","last_change":"2026-02-24T08:33:53.121638+0000","last_active":"2026-02-24T08:33:56.405267+0000","last_peered":"2026-02-24T08:33:56.405267+0000","last_clean":"2026-02-24T08:33:56.405267+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:33:56.405267+0000","last_undegraded":"2026-02-24T08:33:56.405267+0000","last_fullsized":"2026-02-24T08:33:56.405267+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1369,"log_dups_size":0,"ondisk_log_size":1369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:57.022482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11214848,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1369,"num_write_kb":10952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"110'1760","reported_seq":1774,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:57.224253+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:33:57.224253+0000","last_peered":"2026-02-24T08:33:57.224253+0000","last_clean":"2026-02-24T08:33:57.224253+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:33:57.224253+0000","last_undegraded":"2026-02-24T08:33:57.224253+0000","last_fullsized":"2026-02-24T08:33:57.224253+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:58.438348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1760,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"110'1686","reported_seq":1696,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.918243+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:33:56.918243+0000","last_peered":"2026-02-24T08:33:56.918243+0000","last_clean":"2026-02-24T08:33:56.918243+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:33:56.918243+0000","last_undegraded":"2026-02-24T08:33:56.918243+0000","last_fullsized":"2026-02-24T08:33:56.918243+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13811712,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1686,"num_write_kb":13488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"110'1504","reported_seq":1518,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.478259+0000","last_change":"2026-02-24T08:33:53.122546+0000","last_active":"2026-02-24T08:33:56.478259+0000","last_peered":"2026-02-24T08:33:56.478259+0000","last_clean":"2026-02-24T08:33:56.478259+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:33:56.478259+0000","last_undegraded":"2026-02-24T08:33:56.478259+0000","last_fullsized":"2026-02-24T08:33:56.478259+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.480819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1504,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"110'1969","reported_seq":1982,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.903622+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:33:56.903622+0000","last_peered":"2026-02-24T08:33:56.903622+0000","last_clean":"2026-02-24T08:33:56.903622+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:33:56.903622+0000","last_undegraded":"2026-02-24T08:33:56.903622+0000","last_fullsized":"2026-02-24T08:33:56.903622+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1969,"log_dups_size":0,"ondisk_log_size":1969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16130048,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1969,"num_write_kb":15752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"110'1368","reported_seq":1382,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.490368+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:33:56.490368+0000","last_peered":"2026-02-24T08:33:56.490368+0000","last_clean":"2026-02-24T08:33:56.490368+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:33:56.490368+0000","last_undegraded":"2026-02-24T08:33:56.490368+0000","last_fullsized":"2026-02-24T08:33:56.490368+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1368,"log_dups_size":0,"ondisk_log_size":1368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.898614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1368,"num_write_kb":10944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"110'1550","reported_seq":1558,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.478344+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:33:56.478344+0000","last_peered":"2026-02-24T08:33:56.478344+0000","last_clean":"2026-02-24T08:33:56.478344+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:33:56.478344+0000","last_undegraded":"2026-02-24T08:33:56.478344+0000","last_fullsized":"2026-02-24T08:33:56.478344+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12697600,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1550,"num_write_kb":12400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"110'1648","reported_seq":1662,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.919338+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:33:56.919338+0000","last_peered":"2026-02-24T08:33:56.919338+0000","last_clean":"2026-02-24T08:33:56.919338+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:33:56.919338+0000","last_undegraded":"2026-02-24T08:33:56.919338+0000","last_fullsized":"2026-02-24T08:33:56.919338+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1648,"num_write_kb":13184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"110'1996","reported_seq":2006,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:57.255351+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:33:57.255351+0000","last_peered":"2026-02-24T08:33:57.255351+0000","last_clean":"2026-02-24T08:33:57.255351+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:33:57.255351+0000","last_undegraded":"2026-02-24T08:33:57.255351+0000","last_fullsized":"2026-02-24T08:33:57.255351+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1996,"log_dups_size":0,"ondisk_log_size":1996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16351232,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":250,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1996,"num_write_kb":15968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"110'1368","reported_seq":1381,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.406102+0000","last_change":"2026-02-24T08:33:53.120976+0000","last_active":"2026-02-24T08:33:56.406102+0000","last_peered":"2026-02-24T08:33:56.406102+0000","last_clean":"2026-02-24T08:33:56.406102+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:33:56.406102+0000","last_undegraded":"2026-02-24T08:33:56.406102+0000","last_fullsized":"2026-02-24T08:33:56.406102+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1368,"log_dups_size":0,"ondisk_log_size":1368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:02.945733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1368,"num_write_kb":10944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"110'1872","reported_seq":1886,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:57.214215+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:33:57.214215+0000","last_peered":"2026-02-24T08:33:57.214215+0000","last_clean":"2026-02-24T08:33:57.214215+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:33:57.214215+0000","last_undegraded":"2026-02-24T08:33:57.214215+0000","last_fullsized":"2026-02-24T08:33:57.214215+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1872,"log_dups_size":0,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15335424,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1872,"num_write_kb":14976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"110'1880","reported_seq":1889,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:56.917314+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:33:56.917314+0000","last_peered":"2026-02-24T08:33:56.917314+0000","last_clean":"2026-02-24T08:33:56.917314+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:33:56.917314+0000","last_undegraded":"2026-02-24T08:33:56.917314+0000","last_fullsized":"2026-02-24T08:33:56.917314+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1880,"log_dups_size":0,"ondisk_log_size":1880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1880,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"110'1755","reported_seq":1762,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:57.257268+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:33:57.257268+0000","last_peered":"2026-02-24T08:33:57.257268+0000","last_clean":"2026-02-24T08:33:57.257268+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:33:57.257268+0000","last_undegraded":"2026-02-24T08:33:57.257268+0000","last_fullsized":"2026-02-24T08:33:57.257268+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":1755,"log_dups_size":0,"ondisk_log_size":1755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14376960,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1755,"num_write_kb":14040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"110'2064","reported_seq":2078,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:57.251962+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:33:57.251962+0000","last_peered":"2026-02-24T08:33:57.251962+0000","last_clean":"2026-02-24T08:33:57.251962+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:33:57.251962+0000","last_undegraded":"2026-02-24T08:33:57.251962+0000","last_fullsized":"2026-02-24T08:33:57.251962+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":2064,"log_dups_size":0,"ondisk_log_size":2064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:01.943572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":258,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2064,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":297,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:54.210292+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:54.210292+0000","last_peered":"2026-02-24T08:33:54.210292+0000","last_clean":"2026-02-24T08:33:54.210292+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:54.210292+0000","last_undegraded":"2026-02-24T08:33:54.210292+0000","last_fullsized":"2026-02-24T08:33:54.210292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":217456640,"num_objects":3322,"num_object_clones":0,"num_object_copies":9966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3322,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26545,"num_write_kb":212360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":642801664,"data_stored":642801664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26545,"ondisk_log_size":26545,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247973,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1081256,"kb_used_data":119572,"kb_used_omap":11,"kb_used_meta":961652,"kb_avail":732921944,"statfs":{"total":751619276800,"available":750512070656,"internally_reserved":0,"allocated":122441728,"data_stored":121703860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12025,"internal_metadata":984731911},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444199,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1066304,"kb_used_data":74924,"kb_used_omap":10,"kb_used_meta":991349,"kb_avail":732936896,"statfs":{"total":751619276800,"available":750527381504,"internally_reserved":0,"allocated":76722176,"data_stored":75984308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1015141945},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575017,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":984908,"kb_used_data":182328,"kb_used_omap":11,"kb_used_meta":802548,"kb_avail":733018292,"statfs":{"total":751619276800,"available":750610731008,"internally_reserved":0,"allocated":186703872,"data_stored":185969556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11344,"internal_metadata":821810096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705835,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1258064,"kb_used_data":136500,"kb_used_omap":11,"kb_used_meta":1121524,"kb_avail":732745136,"statfs":{"total":751619276800,"available":750331019264,"internally_reserved":0,"allocated":139776000,"data_stored":139038132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010,"internal_metadata":1148440854},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":144662528,"data_stored":144662528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":219471872,"data_stored":219471872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":128876544,"data_stored":128876544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":149790720,"data_stored":149790720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:34:00.219 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:34:00.220 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_7 pg_num 26 2026-02-24T08:34:00.424 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:00.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3628842905' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:00.548 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:00.545+0000 7fcab7160640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:00.549 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:00.546+0000 7fcab7160640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:00.713 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:34:00.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:34:01.209 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 7 128 63787 63659 71.0344 60.4062 0.00875205 0.0140533 2026-02-24T08:34:01.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:01 trial105 ceph-mon[39442]: from='client.15667 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:34:01.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2709901293' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_7", "var": "pg_num", "val": "26"} : dispatch 2026-02-24T08:34:01.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:01 trial105 ceph-mon[39442]: pgmap v493: 17 pgs: 17 active+clean; 208 MiB data, 4.2 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.32k op/s 2026-02-24T08:34:02.187 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:02.209 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 8 127 71154 71027 69.35 57.5625 0.0146628 0.0143958 2026-02-24T08:34:02.349 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:02.486 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:02.484+0000 7fbd6a64d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:02.486 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:02.484+0000 7fbd6a64d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:02.503 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:02.504 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:02.518 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:02.518 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:02.533 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:02.534 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:02.547 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:02.548 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:02.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2876220555' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:03.209 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 9 128 77952 77824 67.5444 53.1016 0.0186381 0.0147794 2026-02-24T08:34:03.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:03 trial105 ceph-mon[39442]: pgmap v494: 17 pgs: 17 active+clean; 533 MiB data, 5.4 GiB used, 2.7 TiB / 2.7 TiB avail; 55 MiB/s wr, 7.03k op/s 2026-02-24T08:34:04.209 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 10 127 84550 84423 65.9451 51.5547 0.0181774 0.0151424 2026-02-24T08:34:04.594 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:04.755 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:04.882 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:04.879+0000 7ff4a5cbf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:04.883 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:04.879+0000 7ff4a5cbf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:04.898 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:04.899 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:04.922 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:04.923 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:04.940 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:04.940 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:04.955 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:04.956 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:05.209 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 11 128 90718 90590 64.3299 48.1797 0.0131127 0.0155271 2026-02-24T08:34:05.758 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:34:05.759 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:34:05.759 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_7 2026-02-24T08:34:05.759 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:34:05.916 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:06.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:05 trial105 ceph-mon[39442]: pgmap v495: 17 pgs: 17 active+clean; 533 MiB data, 5.4 GiB used, 2.7 TiB / 2.7 TiB avail; 50 MiB/s wr, 6.38k op/s 2026-02-24T08:34:06.042 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:05 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4174952910' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:06.209 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 12 128 96148 96020 62.5041 42.4219 0.0364565 0.0159548 2026-02-24T08:34:06.331 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:06.275+0000 7f18b7707640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:06.331 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:06.275+0000 7f18b7707640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:06.430 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:34:06.431 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:34:07.011 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:07.117 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":495,"stamp":"2026-02-24T08:34:04.804274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":558998048,"num_objects":8525,"num_object_clones":0,"num_object_copies":25575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8525,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":68300,"num_write_kb":547470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68264,"ondisk_log_size":68264,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":5651588,"kb_used_data":1557812,"kb_used_omap":44,"kb_used_meta":4093651,"kb_avail":2930361212,"statfs":{"total":3006477107200,"available":3000689881088,"internally_reserved":0,"allocated":1595199488,"data_stored":1592251568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46074,"internal_metadata":4191898630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[18,0,0,8,14],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":558407680,"num_objects":8523,"num_object_clones":0,"num_object_copies":25569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8523,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68165,"num_write_kb":545320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.690428"},"pg_stats":[{"pgid":"9.f","version":"110'4128","reported_seq":4142,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.466457+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:34:01.466457+0000","last_peered":"2026-02-24T08:34:01.466457+0000","last_clean":"2026-02-24T08:34:01.466457+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:34:01.466457+0000","last_undegraded":"2026-02-24T08:34:01.466457+0000","last_fullsized":"2026-02-24T08:34:01.466457+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"110'3920","reported_seq":3934,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.492554+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:34:01.492554+0000","last_peered":"2026-02-24T08:34:01.492554+0000","last_clean":"2026-02-24T08:34:01.492554+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:34:01.492554+0000","last_undegraded":"2026-02-24T08:34:01.492554+0000","last_fullsized":"2026-02-24T08:34:01.492554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":3920,"log_dups_size":0,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3920,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"110'3753","reported_seq":3766,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.408407+0000","last_change":"2026-02-24T08:33:53.121638+0000","last_active":"2026-02-24T08:34:01.408407+0000","last_peered":"2026-02-24T08:34:01.408407+0000","last_clean":"2026-02-24T08:34:01.408407+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:34:01.408407+0000","last_undegraded":"2026-02-24T08:34:01.408407+0000","last_fullsized":"2026-02-24T08:34:01.408407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":3753,"log_dups_size":0,"ondisk_log_size":3753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:57.022482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30744576,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3753,"num_write_kb":30024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"110'4256","reported_seq":4270,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:02.261147+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:34:02.261147+0000","last_peered":"2026-02-24T08:34:02.261147+0000","last_clean":"2026-02-24T08:34:02.261147+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:34:02.261147+0000","last_undegraded":"2026-02-24T08:34:02.261147+0000","last_fullsized":"2026-02-24T08:34:02.261147+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:58.438348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34865152,"num_objects":532,"num_object_clones":0,"num_object_copies":1596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4256,"num_write_kb":34048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"110'4370","reported_seq":4380,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.922266+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:34:01.922266+0000","last_peered":"2026-02-24T08:34:01.922266+0000","last_clean":"2026-02-24T08:34:01.922266+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:34:01.922266+0000","last_undegraded":"2026-02-24T08:34:01.922266+0000","last_fullsized":"2026-02-24T08:34:01.922266+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4370,"log_dups_size":0,"ondisk_log_size":4370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35799040,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4370,"num_write_kb":34960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"110'4288","reported_seq":4297,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.492191+0000","last_change":"2026-02-24T08:33:53.122546+0000","last_active":"2026-02-24T08:34:01.492191+0000","last_peered":"2026-02-24T08:34:01.492191+0000","last_clean":"2026-02-24T08:34:01.492191+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:34:01.492191+0000","last_undegraded":"2026-02-24T08:34:01.492191+0000","last_fullsized":"2026-02-24T08:34:01.492191+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.480819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4288,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"110'4664","reported_seq":4678,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.906481+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:34:01.906481+0000","last_peered":"2026-02-24T08:34:01.906481+0000","last_clean":"2026-02-24T08:34:01.906481+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:34:01.906481+0000","last_undegraded":"2026-02-24T08:34:01.906481+0000","last_fullsized":"2026-02-24T08:34:01.906481+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38207488,"num_objects":583,"num_object_clones":0,"num_object_copies":1749,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4664,"num_write_kb":37312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"110'3936","reported_seq":3946,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.492567+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:34:01.492567+0000","last_peered":"2026-02-24T08:34:01.492567+0000","last_clean":"2026-02-24T08:34:01.492567+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:34:01.492567+0000","last_undegraded":"2026-02-24T08:34:01.492567+0000","last_fullsized":"2026-02-24T08:34:01.492567+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":3936,"log_dups_size":0,"ondisk_log_size":3936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.898614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32243712,"num_objects":492,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3936,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"110'4448","reported_seq":4462,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.461152+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:34:01.461152+0000","last_peered":"2026-02-24T08:34:01.461152+0000","last_clean":"2026-02-24T08:34:01.461152+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:34:01.461152+0000","last_undegraded":"2026-02-24T08:34:01.461152+0000","last_fullsized":"2026-02-24T08:34:01.461152+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36438016,"num_objects":556,"num_object_clones":0,"num_object_copies":1668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4448,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"110'4608","reported_seq":4620,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.922685+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:34:01.922685+0000","last_peered":"2026-02-24T08:34:01.922685+0000","last_clean":"2026-02-24T08:34:01.922685+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:34:01.922685+0000","last_undegraded":"2026-02-24T08:34:01.922685+0000","last_fullsized":"2026-02-24T08:34:01.922685+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4608,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"110'4504","reported_seq":4518,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:02.252895+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:34:02.252895+0000","last_peered":"2026-02-24T08:34:02.252895+0000","last_clean":"2026-02-24T08:34:02.252895+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:34:02.252895+0000","last_undegraded":"2026-02-24T08:34:02.252895+0000","last_fullsized":"2026-02-24T08:34:02.252895+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4504,"log_dups_size":0,"ondisk_log_size":4504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36896768,"num_objects":563,"num_object_clones":0,"num_object_copies":1689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4504,"num_write_kb":36032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"110'4024","reported_seq":4038,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.364793+0000","last_change":"2026-02-24T08:33:53.120976+0000","last_active":"2026-02-24T08:34:01.364793+0000","last_peered":"2026-02-24T08:34:01.364793+0000","last_clean":"2026-02-24T08:34:01.364793+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:34:01.364793+0000","last_undegraded":"2026-02-24T08:34:01.364793+0000","last_fullsized":"2026-02-24T08:34:01.364793+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4024,"log_dups_size":0,"ondisk_log_size":4024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:02.945733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32964608,"num_objects":503,"num_object_clones":0,"num_object_copies":1509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4024,"num_write_kb":32192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"110'4214","reported_seq":4228,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:02.263764+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:34:02.263764+0000","last_peered":"2026-02-24T08:34:02.263764+0000","last_clean":"2026-02-24T08:34:02.263764+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:34:02.263764+0000","last_undegraded":"2026-02-24T08:34:02.263764+0000","last_fullsized":"2026-02-24T08:34:02.263764+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34521088,"num_objects":527,"num_object_clones":0,"num_object_copies":1581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4214,"num_write_kb":33712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"110'4408","reported_seq":4422,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:01.922176+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:34:01.922176+0000","last_peered":"2026-02-24T08:34:01.922176+0000","last_clean":"2026-02-24T08:34:01.922176+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:34:01.922176+0000","last_undegraded":"2026-02-24T08:34:01.922176+0000","last_fullsized":"2026-02-24T08:34:01.922176+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4408,"log_dups_size":0,"ondisk_log_size":4408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36110336,"num_objects":551,"num_object_clones":0,"num_object_copies":1653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4408,"num_write_kb":35264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"110'4196","reported_seq":4208,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:02.263172+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:34:02.263172+0000","last_peered":"2026-02-24T08:34:02.263172+0000","last_clean":"2026-02-24T08:34:02.263172+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:34:02.263172+0000","last_undegraded":"2026-02-24T08:34:02.263172+0000","last_fullsized":"2026-02-24T08:34:02.263172+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4196,"log_dups_size":0,"ondisk_log_size":4196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34373632,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4196,"num_write_kb":33568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"110'4448","reported_seq":4462,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:02.260881+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:34:02.260881+0000","last_peered":"2026-02-24T08:34:02.260881+0000","last_clean":"2026-02-24T08:34:02.260881+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:34:02.260881+0000","last_undegraded":"2026-02-24T08:34:02.260881+0000","last_fullsized":"2026-02-24T08:34:02.260881+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:01.943572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36438016,"num_objects":556,"num_object_clones":0,"num_object_copies":1668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4448,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":297,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:54.210292+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:54.210292+0000","last_peered":"2026-02-24T08:33:54.210292+0000","last_clean":"2026-02-24T08:33:54.210292+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:54.210292+0000","last_undegraded":"2026-02-24T08:33:54.210292+0000","last_fullsized":"2026-02-24T08:33:54.210292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":558407680,"num_objects":8523,"num_object_clones":0,"num_object_copies":25569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8523,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68165,"num_write_kb":545320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1670963200,"data_stored":1670963200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68165,"ondisk_log_size":68165,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247974,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1422608,"kb_used_data":406780,"kb_used_omap":11,"kb_used_meta":1015796,"kb_avail":732580592,"statfs":{"total":751619276800,"available":750162526208,"internally_reserved":0,"allocated":416542720,"data_stored":415804852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12025,"internal_metadata":1040175367},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444200,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1353280,"kb_used_data":325804,"kb_used_omap":10,"kb_used_meta":1027445,"kb_avail":732649920,"statfs":{"total":751619276800,"available":750233518080,"internally_reserved":0,"allocated":333623296,"data_stored":332885428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1052104249},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,0,0,8,14],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575018,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1366700,"kb_used_data":473880,"kb_used_omap":11,"kb_used_meta":892788,"kb_avail":732636500,"statfs":{"total":751619276800,"available":750219776000,"internally_reserved":0,"allocated":485253120,"data_stored":484518804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11344,"internal_metadata":914215856},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705836,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1509000,"kb_used_data":351348,"kb_used_omap":11,"kb_used_meta":1157620,"kb_avail":732494200,"statfs":{"total":751619276800,"available":750074060800,"internally_reserved":0,"allocated":359780352,"data_stored":359042484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010,"internal_metadata":1185403158},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":361029632,"data_stored":361029632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":507166720,"data_stored":507166720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":369287168,"data_stored":369287168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":433479680,"data_stored":433479680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:34:07.119 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:34:07.119 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_7 pg_num 36 2026-02-24T08:34:07.170 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:07.209 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 13 128 100261 100133 60.1674 32.1328 0.0126772 0.0165933 2026-02-24T08:34:07.371 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:07.638 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:07.584+0000 7f0db3906640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:07.639 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:07.585+0000 7f0db3906640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:07.639 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:07.639 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:07.639 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:07.640 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:07.640 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:07.640 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:07.653 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:07.653 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:07.877 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:07.875+0000 7f297cda8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:07.878 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:07.876+0000 7f297cda8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:08.047 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:34:08.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:34:08.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:07 trial105 ceph-mon[39442]: from='client.15677 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:34:08.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:07 trial105 ceph-mon[39442]: pgmap v496: 17 pgs: 17 active+clean; 641 MiB data, 5.9 GiB used, 2.7 TiB / 2.7 TiB avail; 53 MiB/s wr, 6.83k op/s 2026-02-24T08:34:08.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/352130875' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:08.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 14 128 104577 104449 58.2781 33.7188 0.0137194 0.0171327 2026-02-24T08:34:09.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:08 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2072316847' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_7", "var": "pg_num", "val": "36"} : dispatch 2026-02-24T08:34:09.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 15 128 109982 109854 57.2078 42.2266 0.0126991 0.0174577 2026-02-24T08:34:09.751 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:09.840 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:34:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:34:09.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:34:09.860 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:34:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:34:09] "GET /metrics HTTP/1.1" 200 4206 "" "Prometheus/3.6.0" 2026-02-24T08:34:09.914 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:10.047 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:10.044+0000 7f98345d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:10.047 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:10.044+0000 7f98345d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:10.065 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:10.065 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:10.082 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:10.082 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:10.098 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:10.099 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:10.113 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:10.113 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:10.113 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:09 trial105 ceph-mon[39442]: pgmap v497: 17 pgs: 17 active+clean; 771 MiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 58 MiB/s wr, 7.39k op/s 2026-02-24T08:34:10.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 16 128 115082 114954 56.1225 39.8438 0.0200294 0.0177949 2026-02-24T08:34:11.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:10 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/767237011' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:11.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 17 128 120052 119924 55.105 38.8281 0.0199937 0.0181275 2026-02-24T08:34:12.165 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:11 trial105 ceph-mon[39442]: pgmap v498: 17 pgs: 17 active+clean; 771 MiB data, 6.3 GiB used, 2.7 TiB / 2.7 TiB avail; 47 MiB/s wr, 6.01k op/s 2026-02-24T08:34:12.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 18 128 124703 124575 54.0622 36.3359 0.0094729 0.0184738 2026-02-24T08:34:12.319 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:12.709 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:12.661+0000 7f7be5141640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:12.709 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:12.661+0000 7f7be5141640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:12.709 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:12.709 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:12.709 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:12.709 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:12.712 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:12.712 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:12.728 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:12.728 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:13.095 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:34:13.095 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:34:13.095 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_7 2026-02-24T08:34:13.095 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:34:13.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 19 128 128096 127968 52.6119 26.5078 0.0150033 0.0189796 2026-02-24T08:34:13.247 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:13.318 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1888568668' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:13.318 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:13 trial105 ceph-mon[39442]: pgmap v499: 17 pgs: 17 active+clean; 961 MiB data, 7.0 GiB used, 2.7 TiB / 2.7 TiB avail; 63 MiB/s wr, 8.03k op/s 2026-02-24T08:34:13.457 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:13.454+0000 7f42242e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:13.457 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:13.454+0000 7f42242e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:13.603 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:34:13.604 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:34:13.650 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":499,"stamp":"2026-02-24T08:34:12.805349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1008017952,"num_objects":15378,"num_object_clones":0,"num_object_copies":46134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15378,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":123112,"num_write_kb":985966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123076,"ondisk_log_size":123076,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7339556,"kb_used_data":2902604,"kb_used_omap":44,"kb_used_meta":4436819,"kb_avail":2928673244,"statfs":{"total":3006477107200,"available":2998961401856,"internally_reserved":0,"allocated":2972266496,"data_stored":2969318576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46074,"internal_metadata":4543302662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,10,9,15,0,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":789970944,"num_objects":12054,"num_object_clones":0,"num_object_copies":36162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12054,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96432,"num_write_kb":771456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001708"},"pg_stats":[{"pgid":"9.f","version":"110'7592","reported_seq":7606,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.455999+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:34:11.455999+0000","last_peered":"2026-02-24T08:34:11.455999+0000","last_clean":"2026-02-24T08:34:11.455999+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:34:11.455999+0000","last_undegraded":"2026-02-24T08:34:11.455999+0000","last_fullsized":"2026-02-24T08:34:11.455999+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7592,"log_dups_size":0,"ondisk_log_size":7592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62193664,"num_objects":949,"num_object_clones":0,"num_object_copies":2847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":949,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7592,"num_write_kb":60736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"110'7245","reported_seq":7256,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.498221+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:34:11.498221+0000","last_peered":"2026-02-24T08:34:11.498221+0000","last_clean":"2026-02-24T08:34:11.498221+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:34:11.498221+0000","last_undegraded":"2026-02-24T08:34:11.498221+0000","last_fullsized":"2026-02-24T08:34:11.498221+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7245,"log_dups_size":0,"ondisk_log_size":7245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59351040,"num_objects":906,"num_object_clones":0,"num_object_copies":2718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7245,"num_write_kb":57960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"110'7327","reported_seq":7338,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.423023+0000","last_change":"2026-02-24T08:33:53.121638+0000","last_active":"2026-02-24T08:34:11.423023+0000","last_peered":"2026-02-24T08:34:11.423023+0000","last_clean":"2026-02-24T08:34:11.423023+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:34:11.423023+0000","last_undegraded":"2026-02-24T08:34:11.423023+0000","last_fullsized":"2026-02-24T08:34:11.423023+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7327,"log_dups_size":0,"ondisk_log_size":7327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:57.022482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60022784,"num_objects":916,"num_object_clones":0,"num_object_copies":2748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":916,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7327,"num_write_kb":58616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"110'7635","reported_seq":7649,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:12.324979+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:34:12.324979+0000","last_peered":"2026-02-24T08:34:12.324979+0000","last_clean":"2026-02-24T08:34:12.324979+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:34:12.324979+0000","last_undegraded":"2026-02-24T08:34:12.324979+0000","last_fullsized":"2026-02-24T08:34:12.324979+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7635,"log_dups_size":0,"ondisk_log_size":7635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:58.438348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62545920,"num_objects":955,"num_object_clones":0,"num_object_copies":2865,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":955,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7635,"num_write_kb":61080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"110'7866","reported_seq":7878,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.934516+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:34:11.934516+0000","last_peered":"2026-02-24T08:34:11.934516+0000","last_clean":"2026-02-24T08:34:11.934516+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:34:11.934516+0000","last_undegraded":"2026-02-24T08:34:11.934516+0000","last_fullsized":"2026-02-24T08:34:11.934516+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7866,"log_dups_size":0,"ondisk_log_size":7866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64438272,"num_objects":984,"num_object_clones":0,"num_object_copies":2952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":984,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7866,"num_write_kb":62928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"110'7961","reported_seq":7974,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.493088+0000","last_change":"2026-02-24T08:33:53.122546+0000","last_active":"2026-02-24T08:34:11.493088+0000","last_peered":"2026-02-24T08:34:11.493088+0000","last_clean":"2026-02-24T08:34:11.493088+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:34:11.493088+0000","last_undegraded":"2026-02-24T08:34:11.493088+0000","last_fullsized":"2026-02-24T08:34:11.493088+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7961,"log_dups_size":0,"ondisk_log_size":7961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.480819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65216512,"num_objects":996,"num_object_clones":0,"num_object_copies":2988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":996,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7961,"num_write_kb":63688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"110'8456","reported_seq":8470,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.931725+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:34:11.931725+0000","last_peered":"2026-02-24T08:34:11.931725+0000","last_clean":"2026-02-24T08:34:11.931725+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:34:11.931725+0000","last_undegraded":"2026-02-24T08:34:11.931725+0000","last_fullsized":"2026-02-24T08:34:11.931725+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8456,"log_dups_size":0,"ondisk_log_size":8456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69271552,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1057,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8456,"num_write_kb":67648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"110'7371","reported_seq":7384,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.498822+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:34:11.498822+0000","last_peered":"2026-02-24T08:34:11.498822+0000","last_clean":"2026-02-24T08:34:11.498822+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:34:11.498822+0000","last_undegraded":"2026-02-24T08:34:11.498822+0000","last_fullsized":"2026-02-24T08:34:11.498822+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7371,"log_dups_size":0,"ondisk_log_size":7371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.898614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60383232,"num_objects":922,"num_object_clones":0,"num_object_copies":2766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":922,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7371,"num_write_kb":58968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"110'7944","reported_seq":7958,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.493153+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:34:11.493153+0000","last_peered":"2026-02-24T08:34:11.493153+0000","last_clean":"2026-02-24T08:34:11.493153+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:34:11.493153+0000","last_undegraded":"2026-02-24T08:34:11.493153+0000","last_fullsized":"2026-02-24T08:34:11.493153+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7944,"log_dups_size":0,"ondisk_log_size":7944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":2979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":993,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7944,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"110'8064","reported_seq":8078,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.877641+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:34:11.877641+0000","last_peered":"2026-02-24T08:34:11.877641+0000","last_clean":"2026-02-24T08:34:11.877641+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:34:11.877641+0000","last_undegraded":"2026-02-24T08:34:11.877641+0000","last_fullsized":"2026-02-24T08:34:11.877641+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8064,"log_dups_size":0,"ondisk_log_size":8064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66060288,"num_objects":1008,"num_object_clones":0,"num_object_copies":3024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8064,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"110'7544","reported_seq":7558,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:12.306662+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:34:12.306662+0000","last_peered":"2026-02-24T08:34:12.306662+0000","last_clean":"2026-02-24T08:34:12.306662+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:34:12.306662+0000","last_undegraded":"2026-02-24T08:34:12.306662+0000","last_fullsized":"2026-02-24T08:34:12.306662+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7544,"log_dups_size":0,"ondisk_log_size":7544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61800448,"num_objects":943,"num_object_clones":0,"num_object_copies":2829,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":943,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7544,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"110'7304","reported_seq":7318,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.377595+0000","last_change":"2026-02-24T08:33:53.120976+0000","last_active":"2026-02-24T08:34:11.377595+0000","last_peered":"2026-02-24T08:34:11.377595+0000","last_clean":"2026-02-24T08:34:11.377595+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:34:11.377595+0000","last_undegraded":"2026-02-24T08:34:11.377595+0000","last_fullsized":"2026-02-24T08:34:11.377595+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7304,"log_dups_size":0,"ondisk_log_size":7304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:02.945733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59834368,"num_objects":913,"num_object_clones":0,"num_object_copies":2739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":913,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7304,"num_write_kb":58432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"110'7640","reported_seq":7653,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:12.326800+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:34:12.326800+0000","last_peered":"2026-02-24T08:34:12.326800+0000","last_clean":"2026-02-24T08:34:12.326800+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:34:12.326800+0000","last_undegraded":"2026-02-24T08:34:12.326800+0000","last_fullsized":"2026-02-24T08:34:12.326800+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7640,"log_dups_size":0,"ondisk_log_size":7640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62586880,"num_objects":955,"num_object_clones":0,"num_object_copies":2865,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":955,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7640,"num_write_kb":61120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"110'7880","reported_seq":7892,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:11.937617+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:34:11.937617+0000","last_peered":"2026-02-24T08:34:11.937617+0000","last_clean":"2026-02-24T08:34:11.937617+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:34:11.937617+0000","last_undegraded":"2026-02-24T08:34:11.937617+0000","last_fullsized":"2026-02-24T08:34:11.937617+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7880,"log_dups_size":0,"ondisk_log_size":7880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64552960,"num_objects":985,"num_object_clones":0,"num_object_copies":2955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7880,"num_write_kb":63040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"110'7472","reported_seq":7486,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:12.286568+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:34:12.286568+0000","last_peered":"2026-02-24T08:34:12.286568+0000","last_clean":"2026-02-24T08:34:12.286568+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:34:12.286568+0000","last_undegraded":"2026-02-24T08:34:12.286568+0000","last_fullsized":"2026-02-24T08:34:12.286568+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7472,"log_dups_size":0,"ondisk_log_size":7472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61210624,"num_objects":934,"num_object_clones":0,"num_object_copies":2802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":934,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7472,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"110'7676","reported_seq":7686,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:12.324944+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:34:12.324944+0000","last_peered":"2026-02-24T08:34:12.324944+0000","last_clean":"2026-02-24T08:34:12.324944+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:34:12.324944+0000","last_undegraded":"2026-02-24T08:34:12.324944+0000","last_fullsized":"2026-02-24T08:34:12.324944+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":7676,"log_dups_size":0,"ondisk_log_size":7676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:01.943572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62881792,"num_objects":960,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":960,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7676,"num_write_kb":61408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":297,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:33:54.210292+0000","last_change":"2026-02-24T08:32:51.098242+0000","last_active":"2026-02-24T08:33:54.210292+0000","last_peered":"2026-02-24T08:33:54.210292+0000","last_clean":"2026-02-24T08:33:54.210292+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:33:54.210292+0000","last_undegraded":"2026-02-24T08:33:54.210292+0000","last_fullsized":"2026-02-24T08:33:54.210292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:32:51.098206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:32:51.098206+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:12.367210+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1007427584,"num_objects":15376,"num_object_clones":0,"num_object_copies":46128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122977,"num_write_kb":983816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3017203712,"data_stored":3017203712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122977,"ondisk_log_size":122977,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247976,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1880776,"kb_used_data":774708,"kb_used_omap":11,"kb_used_meta":1106036,"kb_avail":732122424,"statfs":{"total":751619276800,"available":749693362176,"internally_reserved":0,"allocated":793300992,"data_stored":792563124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12025,"internal_metadata":1132581127},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444202,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1784016,"kb_used_data":648252,"kb_used_omap":10,"kb_used_meta":1135733,"kb_avail":732219184,"statfs":{"total":751619276800,"available":749792444416,"internally_reserved":0,"allocated":663810048,"data_stored":663072180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1162991161},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1807548,"kb_used_data":856416,"kb_used_omap":11,"kb_used_meta":951092,"kb_avail":732195652,"statfs":{"total":751619276800,"available":749768347648,"internally_reserved":0,"allocated":876969984,"data_stored":876235668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11344,"internal_metadata":973919152},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705838,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1867216,"kb_used_data":623228,"kb_used_omap":11,"kb_used_meta":1243956,"kb_avail":732135984,"statfs":{"total":751619276800,"available":749707247616,"internally_reserved":0,"allocated":638185472,"data_stored":637447604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010,"internal_metadata":1273811222},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,10,9,15,0,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3384,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":637779968,"data_stored":637779968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":888119296,"data_stored":888119296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":685703168,"data_stored":685703168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":805601280,"data_stored":805601280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:34:13.653 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:34:13.653 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_7 pg_num 46 2026-02-24T08:34:13.800 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:13.941 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:13.939+0000 7f9c2f78f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:13.942 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:13.939+0000 7f9c2f78f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:14.102 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:34:14.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:34:14.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:34:14.209230+0000 min lat: 0.00075283 max lat: 0.166455 avg lat: 0.0193617 2026-02-24T08:34:14.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:34:14.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 20 127 132168 132041 51.5722 31.8203 0.0151398 0.0193617 2026-02-24T08:34:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:14 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:34:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:14 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:34:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:14 trial105 ceph-mon[39442]: from='client.15687 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:34:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:34:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:14 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/24251218' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_7", "var": "pg_num", "val": "46"} : dispatch 2026-02-24T08:34:15.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 21 128 136255 136127 50.6364 31.9219 0.0873788 0.0197214 2026-02-24T08:34:15.345 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:15.371 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:15 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:34:15.371 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:15 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:34:15.371 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:15 trial105 ceph-mon[39442]: pgmap v500: 17 pgs: 17 active+clean; 961 MiB data, 7.0 GiB used, 2.7 TiB / 2.7 TiB avail; 36 MiB/s wr, 4.57k op/s 2026-02-24T08:34:15.500 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:15.623 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:15.621+0000 7fa9c014d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:15.624 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:15.621+0000 7fa9c014d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:15.642 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:15.643 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:15.658 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:15.658 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:15.674 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:15.674 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:15.687 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:15.688 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:16.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 22 128 140206 140078 49.7377 30.8672 0.0213578 0.0200887 2026-02-24T08:34:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/130594717' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:17.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 23 128 144103 143975 48.8988 30.4453 0.093237 0.0204228 2026-02-24T08:34:17.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:17 trial105 ceph-mon[39442]: pgmap v501: 17 pgs: 17 active+clean; 1.0 GiB data, 7.3 GiB used, 2.7 TiB / 2.7 TiB avail; 41 MiB/s wr, 5.28k op/s 2026-02-24T08:34:17.732 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:17.887 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:18.021 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:18.018+0000 7f637bcbf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:18.021 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:18.019+0000 7f637bcbf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:18.040 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:18.040 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:18.054 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:18.054 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:18.068 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:18.068 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:18.083 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:18.083 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:18.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 24 128 147934 147806 48.1084 29.9297 0.0640907 0.0207595 2026-02-24T08:34:18.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1350728972' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:19.146 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:34:19.146 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:34:19.147 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:34:19.210 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 25 128 151595 151467 47.3281 28.6016 0.0665479 0.0210956 2026-02-24T08:34:19.286 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:19.405 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:19 trial105 ceph-mon[39442]: pgmap v502: 17 pgs: 17 active+clean; 1.1 GiB data, 7.5 GiB used, 2.7 TiB / 2.7 TiB avail; 40 MiB/s wr, 5.06k op/s 2026-02-24T08:34:19.418 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:19.415+0000 7f61a2761640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:19.418 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:19.416+0000 7f61a2761640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:19.571 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:34:19.571 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:34:19.618 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":502,"stamp":"2026-02-24T08:34:18.806216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1169924640,"num_objects":17848,"num_object_clones":0,"num_object_copies":53544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17848,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":142876,"num_write_kb":1144078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142840,"ondisk_log_size":142840,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":7870780,"kb_used_data":3379692,"kb_used_omap":45,"kb_used_meta":4490962,"kb_avail":2928142020,"statfs":{"total":3006477107200,"available":2998417428480,"internally_reserved":0,"allocated":3460804608,"data_stored":3457856688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46787,"internal_metadata":4598745405},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,5,10,14,28,75,28,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":497729536,"num_objects":7596,"num_object_clones":0,"num_object_copies":22788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60758,"num_write_kb":486064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001692"},"pg_stats":[{"pgid":"9.f","version":"110'8808","reported_seq":8822,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.419228+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:34:16.419228+0000","last_peered":"2026-02-24T08:34:16.419228+0000","last_clean":"2026-02-24T08:34:16.419228+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:34:16.419228+0000","last_undegraded":"2026-02-24T08:34:16.419228+0000","last_fullsized":"2026-02-24T08:34:16.419228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8808,"log_dups_size":0,"ondisk_log_size":8808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72155136,"num_objects":1101,"num_object_clones":0,"num_object_copies":3303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8808,"num_write_kb":70464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"110'8448","reported_seq":8462,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.417385+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:34:16.417385+0000","last_peered":"2026-02-24T08:34:16.417385+0000","last_clean":"2026-02-24T08:34:16.417385+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:34:16.417385+0000","last_undegraded":"2026-02-24T08:34:16.417385+0000","last_fullsized":"2026-02-24T08:34:16.417385+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8448,"log_dups_size":0,"ondisk_log_size":8448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69206016,"num_objects":1056,"num_object_clones":0,"num_object_copies":3168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1056,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8448,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"110'8458","reported_seq":8471,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.434281+0000","last_change":"2026-02-24T08:33:53.121638+0000","last_active":"2026-02-24T08:34:16.434281+0000","last_peered":"2026-02-24T08:34:16.434281+0000","last_clean":"2026-02-24T08:34:16.434281+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:34:16.434281+0000","last_undegraded":"2026-02-24T08:34:16.434281+0000","last_fullsized":"2026-02-24T08:34:16.434281+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8458,"log_dups_size":0,"ondisk_log_size":8458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:57.022482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69287936,"num_objects":1058,"num_object_clones":0,"num_object_copies":3174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1058,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8458,"num_write_kb":67664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"110'8960","reported_seq":8974,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:17.331758+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:34:17.331758+0000","last_peered":"2026-02-24T08:34:17.331758+0000","last_clean":"2026-02-24T08:34:17.331758+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:34:17.331758+0000","last_undegraded":"2026-02-24T08:34:17.331758+0000","last_fullsized":"2026-02-24T08:34:17.331758+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8960,"log_dups_size":0,"ondisk_log_size":8960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:58.438348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73400320,"num_objects":1120,"num_object_clones":0,"num_object_copies":3360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8960,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"110'9248","reported_seq":9262,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.863831+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:34:16.863831+0000","last_peered":"2026-02-24T08:34:16.863831+0000","last_clean":"2026-02-24T08:34:16.863831+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:34:16.863831+0000","last_undegraded":"2026-02-24T08:34:16.863831+0000","last_fullsized":"2026-02-24T08:34:16.863831+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9248,"log_dups_size":0,"ondisk_log_size":9248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75759616,"num_objects":1156,"num_object_clones":0,"num_object_copies":3468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1156,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9248,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"110'9314","reported_seq":9323,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.504265+0000","last_change":"2026-02-24T08:33:53.122546+0000","last_active":"2026-02-24T08:34:16.504265+0000","last_peered":"2026-02-24T08:34:16.504265+0000","last_clean":"2026-02-24T08:34:16.504265+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:34:16.504265+0000","last_undegraded":"2026-02-24T08:34:16.504265+0000","last_fullsized":"2026-02-24T08:34:16.504265+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9314,"log_dups_size":0,"ondisk_log_size":9314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.480819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76300288,"num_objects":1165,"num_object_clones":0,"num_object_copies":3495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1165,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9314,"num_write_kb":74512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"110'9748","reported_seq":9761,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.943156+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:34:16.943156+0000","last_peered":"2026-02-24T08:34:16.943156+0000","last_clean":"2026-02-24T08:34:16.943156+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:34:16.943156+0000","last_undegraded":"2026-02-24T08:34:16.943156+0000","last_fullsized":"2026-02-24T08:34:16.943156+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9748,"log_dups_size":0,"ondisk_log_size":9748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79855616,"num_objects":1219,"num_object_clones":0,"num_object_copies":3657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9748,"num_write_kb":77984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"110'8648","reported_seq":8662,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.499484+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:34:16.499484+0000","last_peered":"2026-02-24T08:34:16.499484+0000","last_clean":"2026-02-24T08:34:16.499484+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:34:16.499484+0000","last_undegraded":"2026-02-24T08:34:16.499484+0000","last_fullsized":"2026-02-24T08:34:16.499484+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8648,"log_dups_size":0,"ondisk_log_size":8648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.898614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70844416,"num_objects":1081,"num_object_clones":0,"num_object_copies":3243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1081,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8648,"num_write_kb":69184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"110'9096","reported_seq":9110,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.505878+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:34:16.505878+0000","last_peered":"2026-02-24T08:34:16.505878+0000","last_clean":"2026-02-24T08:34:16.505878+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:34:16.505878+0000","last_undegraded":"2026-02-24T08:34:16.505878+0000","last_fullsized":"2026-02-24T08:34:16.505878+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9096,"log_dups_size":0,"ondisk_log_size":9096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74514432,"num_objects":1137,"num_object_clones":0,"num_object_copies":3411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9096,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"110'9195","reported_seq":9208,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.945509+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:34:16.945509+0000","last_peered":"2026-02-24T08:34:16.945509+0000","last_clean":"2026-02-24T08:34:16.945509+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:34:16.945509+0000","last_undegraded":"2026-02-24T08:34:16.945509+0000","last_fullsized":"2026-02-24T08:34:16.945509+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9195,"log_dups_size":0,"ondisk_log_size":9195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75325440,"num_objects":1150,"num_object_clones":0,"num_object_copies":3450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9195,"num_write_kb":73560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"110'8757","reported_seq":8769,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:17.336319+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:34:17.336319+0000","last_peered":"2026-02-24T08:34:17.336319+0000","last_clean":"2026-02-24T08:34:17.336319+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:34:17.336319+0000","last_undegraded":"2026-02-24T08:34:17.336319+0000","last_fullsized":"2026-02-24T08:34:17.336319+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8757,"log_dups_size":0,"ondisk_log_size":8757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71737344,"num_objects":1095,"num_object_clones":0,"num_object_copies":3285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8757,"num_write_kb":70056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"110'8560","reported_seq":8574,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.387161+0000","last_change":"2026-02-24T08:33:53.120976+0000","last_active":"2026-02-24T08:34:16.387161+0000","last_peered":"2026-02-24T08:34:16.387161+0000","last_clean":"2026-02-24T08:34:16.387161+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:34:16.387161+0000","last_undegraded":"2026-02-24T08:34:16.387161+0000","last_fullsized":"2026-02-24T08:34:16.387161+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8560,"log_dups_size":0,"ondisk_log_size":8560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:02.945733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70123520,"num_objects":1070,"num_object_clones":0,"num_object_copies":3210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8560,"num_write_kb":68480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"110'8928","reported_seq":8942,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:17.296455+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:34:17.296455+0000","last_peered":"2026-02-24T08:34:17.296455+0000","last_clean":"2026-02-24T08:34:17.296455+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:34:17.296455+0000","last_undegraded":"2026-02-24T08:34:17.296455+0000","last_fullsized":"2026-02-24T08:34:17.296455+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8928,"log_dups_size":0,"ondisk_log_size":8928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73138176,"num_objects":1116,"num_object_clones":0,"num_object_copies":3348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1116,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8928,"num_write_kb":71424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"110'9144","reported_seq":9158,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:16.853827+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:34:16.853827+0000","last_peered":"2026-02-24T08:34:16.853827+0000","last_clean":"2026-02-24T08:34:16.853827+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:34:16.853827+0000","last_undegraded":"2026-02-24T08:34:16.853827+0000","last_fullsized":"2026-02-24T08:34:16.853827+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9144,"log_dups_size":0,"ondisk_log_size":9144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74907648,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1143,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9144,"num_write_kb":73152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"110'8533","reported_seq":8545,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:17.328339+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:34:17.328339+0000","last_peered":"2026-02-24T08:34:17.328339+0000","last_clean":"2026-02-24T08:34:17.328339+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:34:17.328339+0000","last_undegraded":"2026-02-24T08:34:17.328339+0000","last_fullsized":"2026-02-24T08:34:17.328339+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8533,"log_dups_size":0,"ondisk_log_size":8533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69902336,"num_objects":1067,"num_object_clones":0,"num_object_copies":3201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1067,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8533,"num_write_kb":68264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"110'8896","reported_seq":8910,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:17.229366+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:34:17.229366+0000","last_peered":"2026-02-24T08:34:17.229366+0000","last_clean":"2026-02-24T08:34:17.229366+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:34:17.229366+0000","last_undegraded":"2026-02-24T08:34:17.229366+0000","last_fullsized":"2026-02-24T08:34:17.229366+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":8896,"log_dups_size":0,"ondisk_log_size":8896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:01.943572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72876032,"num_objects":1112,"num_object_clones":0,"num_object_copies":3336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8896,"num_write_kb":71168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":305,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:13.944667+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:34:13.944667+0000","last_peered":"2026-02-24T08:34:13.944667+0000","last_clean":"2026-02-24T08:34:13.944667+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:34:13.944667+0000","last_undegraded":"2026-02-24T08:34:13.944667+0000","last_fullsized":"2026-02-24T08:34:13.944667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1169334272,"num_objects":17846,"num_object_clones":0,"num_object_copies":53538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17846,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142741,"num_write_kb":1141928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3502186496,"data_stored":3502186496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142741,"ondisk_log_size":142741,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4462,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247977,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2031952,"kb_used_data":907836,"kb_used_omap":11,"kb_used_meta":1124084,"kb_avail":731971248,"statfs":{"total":751619276800,"available":749538557952,"internally_reserved":0,"allocated":929624064,"data_stored":928886196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12086,"internal_metadata":1151062218},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,5,0,9,9],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444203,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1912968,"kb_used_data":759156,"kb_used_omap":10,"kb_used_meta":1153781,"kb_avail":732090232,"statfs":{"total":751619276800,"available":749660397568,"internally_reserved":0,"allocated":777375744,"data_stored":776637876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1181472313},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,13,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575021,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1961532,"kb_used_data":992360,"kb_used_omap":11,"kb_used_meta":969140,"kb_avail":732041668,"statfs":{"total":751619276800,"available":749610668032,"internally_reserved":0,"allocated":1016176640,"data_stored":1015442324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11996,"internal_metadata":992399652},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,4,14,8,40,17],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705839,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1964328,"kb_used_data":720340,"kb_used_omap":11,"kb_used_meta":1243956,"kb_avail":732038872,"statfs":{"total":751619276800,"available":749607804928,"internally_reserved":0,"allocated":737628160,"data_stored":736890292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010,"internal_metadata":1273811222},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,0,8,13,8,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4462,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":737427456,"data_stored":737427456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1026973696,"data_stored":1026973696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":797024256,"data_stored":797024256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":940761088,"data_stored":940761088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:34:19.688 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:34:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:34:19] "GET /metrics HTTP/1.1" 200 4221 "" "Prometheus/3.6.0" 2026-02-24T08:34:19.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:34:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:34:19.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:34:20.129 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:20.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 26 128 154979 154851 46.5245 26.4375 0.039336 0.0214723 2026-02-24T08:34:20.271 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:20.388 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:20 trial105 ceph-mon[39442]: from='client.15695 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:34:20.398 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:20.395+0000 7f3edf501640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:20.398 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:20.396+0000 7f3edf501640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:20.413 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:20.413 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:20.425 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:20.425 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:20.440 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:20.440 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:20.454 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:20.454 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:21.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 27 127 158612 158485 45.8529 28.3906 0.0437579 0.0217895 2026-02-24T08:34:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:21 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1277080525' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:21 trial105 ceph-mon[39442]: pgmap v503: 17 pgs: 17 active+clean; 1.1 GiB data, 7.5 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.67k op/s 2026-02-24T08:34:22.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 28 128 162130 162002 45.1965 27.4766 0.0416318 0.0221098 2026-02-24T08:34:22.499 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:22.643 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:22.791 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:22.788+0000 7fd67299d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:22.791 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:22.788+0000 7fd67299d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:22.809 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:22.810 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:22.821 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:22.822 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:22.836 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:22.837 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:22.855 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:22.856 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:23.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:22 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/867608589' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:23.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 29 128 165457 165329 44.5343 25.9922 0.0640404 0.0224382 2026-02-24T08:34:24.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:23 trial105 ceph-mon[39442]: pgmap v504: 17 pgs: 17 active+clean; 1.2 GiB data, 8.0 GiB used, 2.7 TiB / 2.7 TiB avail; 40 MiB/s wr, 5.18k op/s 2026-02-24T08:34:24.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 30 128 168880 168752 43.9411 26.7422 0.0598852 0.0227373 2026-02-24T08:34:24.619 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:34:24.619 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:34:24.619 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:34:24.619 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:34:24.771 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:24.902 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:24.899+0000 7f4ee24bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:24.902 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:24.899+0000 7f4ee24bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:24.904 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:25.051 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:25.051 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:34:25.052 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:34:25.109 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2026-02-24T08:34:24.807087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1318429216,"num_objects":20115,"num_object_clones":0,"num_object_copies":60345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20115,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":161004,"num_write_kb":1289102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158368,"ondisk_log_size":158368,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8396212,"kb_used_data":3814884,"kb_used_omap":45,"kb_used_meta":4581202,"kb_avail":2927616588,"statfs":{"total":3006477107200,"available":2997879386112,"internally_reserved":0,"allocated":3906441216,"data_stored":3903493296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46787,"internal_metadata":4691151165},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,11,6,2,6,13,34,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":310411264,"num_objects":4737,"num_object_clones":0,"num_object_copies":14211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37892,"num_write_kb":303136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001738"},"pg_stats":[{"pgid":"9.f","version":"110'9947","reported_seq":9954,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.517541+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:34:21.517541+0000","last_peered":"2026-02-24T08:34:21.517541+0000","last_clean":"2026-02-24T08:34:21.517541+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:34:21.517541+0000","last_undegraded":"2026-02-24T08:34:21.517541+0000","last_fullsized":"2026-02-24T08:34:21.517541+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9947,"log_dups_size":0,"ondisk_log_size":9947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81485824,"num_objects":1244,"num_object_clones":0,"num_object_copies":3732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1244,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9947,"num_write_kb":79576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"110'9424","reported_seq":9436,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.504472+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:34:21.504472+0000","last_peered":"2026-02-24T08:34:21.504472+0000","last_clean":"2026-02-24T08:34:21.504472+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:34:21.504472+0000","last_undegraded":"2026-02-24T08:34:21.504472+0000","last_fullsized":"2026-02-24T08:34:21.504472+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9424,"log_dups_size":0,"ondisk_log_size":9424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77201408,"num_objects":1178,"num_object_clones":0,"num_object_copies":3534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1178,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9424,"num_write_kb":75392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"110'9473","reported_seq":9486,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.450405+0000","last_change":"2026-02-24T08:33:53.121638+0000","last_active":"2026-02-24T08:34:21.450405+0000","last_peered":"2026-02-24T08:34:21.450405+0000","last_clean":"2026-02-24T08:34:21.450405+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:34:21.450405+0000","last_undegraded":"2026-02-24T08:34:21.450405+0000","last_fullsized":"2026-02-24T08:34:21.450405+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9473,"log_dups_size":0,"ondisk_log_size":9473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:57.022482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77602816,"num_objects":1185,"num_object_clones":0,"num_object_copies":3555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9473,"num_write_kb":75784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"110'10008","reported_seq":10022,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:22.338466+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:34:22.338466+0000","last_peered":"2026-02-24T08:34:22.338466+0000","last_clean":"2026-02-24T08:34:22.338466+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:34:22.338466+0000","last_undegraded":"2026-02-24T08:34:22.338466+0000","last_fullsized":"2026-02-24T08:34:22.338466+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:58.438348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81985536,"num_objects":1251,"num_object_clones":0,"num_object_copies":3753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10008,"num_write_kb":80064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"110'10468","reported_seq":10479,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.937467+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:34:21.937467+0000","last_peered":"2026-02-24T08:34:21.937467+0000","last_clean":"2026-02-24T08:34:21.937467+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:34:21.937467+0000","last_undegraded":"2026-02-24T08:34:21.937467+0000","last_fullsized":"2026-02-24T08:34:21.937467+0000","mapping_epoch":108,"log_start":"110'400","ondisk_log_start":"110'400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85753856,"num_objects":1309,"num_object_clones":0,"num_object_copies":3927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10468,"num_write_kb":83744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"110'10656","reported_seq":10670,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.443812+0000","last_change":"2026-02-24T08:33:53.122546+0000","last_active":"2026-02-24T08:34:21.443812+0000","last_peered":"2026-02-24T08:34:21.443812+0000","last_clean":"2026-02-24T08:34:21.443812+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:34:21.443812+0000","last_undegraded":"2026-02-24T08:34:21.443812+0000","last_fullsized":"2026-02-24T08:34:21.443812+0000","mapping_epoch":108,"log_start":"110'600","ondisk_log_start":"110'600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.480819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87293952,"num_objects":1332,"num_object_clones":0,"num_object_copies":3996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10656,"num_write_kb":85248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"110'10808","reported_seq":10814,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.955526+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:34:21.955526+0000","last_peered":"2026-02-24T08:34:21.955526+0000","last_clean":"2026-02-24T08:34:21.955526+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:34:21.955526+0000","last_undegraded":"2026-02-24T08:34:21.955526+0000","last_fullsized":"2026-02-24T08:34:21.955526+0000","mapping_epoch":108,"log_start":"110'800","ondisk_log_start":"110'800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88539136,"num_objects":1351,"num_object_clones":0,"num_object_copies":4053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10808,"num_write_kb":86464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"110'9696","reported_seq":9710,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.455309+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:34:21.455309+0000","last_peered":"2026-02-24T08:34:21.455309+0000","last_clean":"2026-02-24T08:34:21.455309+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:34:21.455309+0000","last_undegraded":"2026-02-24T08:34:21.455309+0000","last_fullsized":"2026-02-24T08:34:21.455309+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9696,"log_dups_size":0,"ondisk_log_size":9696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.898614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79429632,"num_objects":1212,"num_object_clones":0,"num_object_copies":3636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1212,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9696,"num_write_kb":77568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"110'10280","reported_seq":10294,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.463993+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:34:21.463993+0000","last_peered":"2026-02-24T08:34:21.463993+0000","last_clean":"2026-02-24T08:34:21.463993+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:34:21.463993+0000","last_undegraded":"2026-02-24T08:34:21.463993+0000","last_fullsized":"2026-02-24T08:34:21.463993+0000","mapping_epoch":108,"log_start":"110'200","ondisk_log_start":"110'200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84213760,"num_objects":1285,"num_object_clones":0,"num_object_copies":3855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10280,"num_write_kb":82240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"110'10280","reported_seq":10286,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.954626+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:34:21.954626+0000","last_peered":"2026-02-24T08:34:21.954626+0000","last_clean":"2026-02-24T08:34:21.954626+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:34:21.954626+0000","last_undegraded":"2026-02-24T08:34:21.954626+0000","last_fullsized":"2026-02-24T08:34:21.954626+0000","mapping_epoch":108,"log_start":"110'200","ondisk_log_start":"110'200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84213760,"num_objects":1285,"num_object_clones":0,"num_object_copies":3855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10280,"num_write_kb":82240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"110'9727","reported_seq":9738,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:22.350849+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:34:22.350849+0000","last_peered":"2026-02-24T08:34:22.350849+0000","last_clean":"2026-02-24T08:34:22.350849+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:34:22.350849+0000","last_undegraded":"2026-02-24T08:34:22.350849+0000","last_fullsized":"2026-02-24T08:34:22.350849+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9727,"log_dups_size":0,"ondisk_log_size":9727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79683584,"num_objects":1216,"num_object_clones":0,"num_object_copies":3648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1216,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9727,"num_write_kb":77816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"110'9801","reported_seq":9812,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.444920+0000","last_change":"2026-02-24T08:33:53.120976+0000","last_active":"2026-02-24T08:34:21.444920+0000","last_peered":"2026-02-24T08:34:21.444920+0000","last_clean":"2026-02-24T08:34:21.444920+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:34:21.444920+0000","last_undegraded":"2026-02-24T08:34:21.444920+0000","last_fullsized":"2026-02-24T08:34:21.444920+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9801,"log_dups_size":0,"ondisk_log_size":9801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:02.945733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80289792,"num_objects":1226,"num_object_clones":0,"num_object_copies":3678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9801,"num_write_kb":78408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"110'10035","reported_seq":10047,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:22.267948+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:34:22.267948+0000","last_peered":"2026-02-24T08:34:22.267948+0000","last_clean":"2026-02-24T08:34:22.267948+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:34:22.267948+0000","last_undegraded":"2026-02-24T08:34:22.267948+0000","last_fullsized":"2026-02-24T08:34:22.267948+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82206720,"num_objects":1255,"num_object_clones":0,"num_object_copies":3765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1255,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10035,"num_write_kb":80280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"110'10400","reported_seq":10414,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:21.917066+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:34:21.917066+0000","last_peered":"2026-02-24T08:34:21.917066+0000","last_clean":"2026-02-24T08:34:21.917066+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:34:21.917066+0000","last_undegraded":"2026-02-24T08:34:21.917066+0000","last_fullsized":"2026-02-24T08:34:21.917066+0000","mapping_epoch":108,"log_start":"110'300","ondisk_log_start":"110'300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85196800,"num_objects":1300,"num_object_clones":0,"num_object_copies":3900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1300,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10400,"num_write_kb":83200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"110'9680","reported_seq":9694,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:22.327859+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:34:22.327859+0000","last_peered":"2026-02-24T08:34:22.327859+0000","last_clean":"2026-02-24T08:34:22.327859+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:34:22.327859+0000","last_undegraded":"2026-02-24T08:34:22.327859+0000","last_fullsized":"2026-02-24T08:34:22.327859+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":9680,"log_dups_size":0,"ondisk_log_size":9680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79298560,"num_objects":1210,"num_object_clones":0,"num_object_copies":3630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1210,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9680,"num_write_kb":77440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"110'10186","reported_seq":10199,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:22.345054+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:34:22.345054+0000","last_peered":"2026-02-24T08:34:22.345054+0000","last_clean":"2026-02-24T08:34:22.345054+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:34:22.345054+0000","last_undegraded":"2026-02-24T08:34:22.345054+0000","last_fullsized":"2026-02-24T08:34:22.345054+0000","mapping_epoch":108,"log_start":"110'100","ondisk_log_start":"110'100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:01.943572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83443712,"num_objects":1274,"num_object_clones":0,"num_object_copies":3822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10186,"num_write_kb":81488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":305,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:13.944667+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:34:13.944667+0000","last_peered":"2026-02-24T08:34:13.944667+0000","last_clean":"2026-02-24T08:34:13.944667+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:34:13.944667+0000","last_undegraded":"2026-02-24T08:34:13.944667+0000","last_fullsized":"2026-02-24T08:34:13.944667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1317838848,"num_objects":20113,"num_object_clones":0,"num_object_copies":60339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160869,"num_write_kb":1286952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3950829568,"data_stored":3950829568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158269,"ondisk_log_size":158269,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4462,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247978,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2167416,"kb_used_data":1025252,"kb_used_omap":11,"kb_used_meta":1142132,"kb_avail":731835784,"statfs":{"total":751619276800,"available":749399842816,"internally_reserved":0,"allocated":1049858048,"data_stored":1049120180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12086,"internal_metadata":1169543370},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444204,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2012728,"kb_used_data":858916,"kb_used_omap":10,"kb_used_meta":1153781,"kb_avail":731990472,"statfs":{"total":751619276800,"available":749558243328,"internally_reserved":0,"allocated":879529984,"data_stored":878792116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1181472313},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,13,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2142132,"kb_used_data":1118816,"kb_used_omap":11,"kb_used_meta":1023284,"kb_avail":731861068,"statfs":{"total":751619276800,"available":749425733632,"internally_reserved":0,"allocated":1145667584,"data_stored":1144933268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11996,"internal_metadata":1047843108},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,24,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705840,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2073936,"kb_used_data":811900,"kb_used_omap":11,"kb_used_meta":1262004,"kb_avail":731929264,"statfs":{"total":751619276800,"available":749495566336,"internally_reserved":0,"allocated":831385600,"data_stored":830647732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010,"internal_metadata":1292292374},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,11,6,2,3,0,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4462,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":832880640,"data_stored":832880640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1157349376,"data_stored":1157349376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":897810432,"data_stored":897810432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1062789120,"data_stored":1062789120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:34:25.109 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 291 2026-02-24T08:34:25.182 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:25.179+0000 7f5f1b0da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:25.182 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:25.179+0000 7f5f1b0da640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:25.199 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:25.199 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:25.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 31 128 172084 171956 43.3311 25.0312 0.0335681 0.0230509 2026-02-24T08:34:25.213 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:25.213 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:25.232 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:25.232 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:25.241 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:25.242 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:25.259 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:25.397 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:25.395+0000 7f56026f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:25.397 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:25.395+0000 7f56026f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:25.549 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:34:25.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:34:26.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:25 trial105 ceph-mon[39442]: pgmap v505: 17 pgs: 17 active+clean; 1.2 GiB data, 8.0 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.16k op/s 2026-02-24T08:34:26.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2264679335' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:26.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2783731171' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "291"} : dispatch 2026-02-24T08:34:26.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 32 127 175307 175180 42.7641 25.1875 0.0563788 0.0233634 2026-02-24T08:34:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:26 trial105 ceph-mon[39442]: from='client.15701 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:34:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:26 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:34:27.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:26 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:34:27.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 33 128 178581 178453 42.243 25.5703 0.081352 0.0236535 2026-02-24T08:34:27.311 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:27.471 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:27.594 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:27.591+0000 7f2666324640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:27.594 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:27.592+0000 7f2666324640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:27.614 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:27.614 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:27.629 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:27.629 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:27.642 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:27.643 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:27.655 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:27.655 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:27 trial105 ceph-mon[39442]: pgmap v506: 17 pgs: 17 active+clean; 1.3 GiB data, 8.2 GiB used, 2.7 TiB / 2.7 TiB avail; 29 MiB/s wr, 3.77k op/s 2026-02-24T08:34:28.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:27 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2448995402' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:28.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 34 128 181948 181820 41.7742 26.3047 0.0237015 0.0239232 2026-02-24T08:34:29.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 35 128 185295 185167 41.3277 26.1484 0.0424159 0.0241819 2026-02-24T08:34:29.701 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:29.849 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:29.863 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:34:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:34:29] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T08:34:29.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:34:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:34:29.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:34:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:29 trial105 ceph-mon[39442]: pgmap v507: 17 pgs: 17 active+clean; 1.4 GiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.81k op/s 2026-02-24T08:34:30.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:34:30.211 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 36 128 188537 188409 40.8832 25.3281 0.0391766 0.0244349 2026-02-24T08:34:30.302 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:30.239+0000 7f1f1d814640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:30.302 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:30.240+0000 7f1f1d814640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:30.302 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:30.303 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:30.303 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:30.303 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:30.303 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:30.304 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:30.305 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:30.305 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:30.587 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:34:30.587 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:34:30.587 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:34:30.587 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:34:30.733 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:30.862 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:30.860+0000 7fa4c46d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:30.863 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:30.860+0000 7fa4c46d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:30.882 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:34:30.882 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:34:30.882 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:34:30.882 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:34:30.882 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:34:30.882 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:34:30.883 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:34:30.883 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:34:30.883 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:34:30.883 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:34:30.883 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:34:30.883 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:34:30.917 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:34:30.918 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:34:30.918 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:34:31.063 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:31.089 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1798892538' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:31.190 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:31.187+0000 7f4cb0fa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:31.190 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:31.188+0000 7f4cb0fa9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:31.211 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:34:31.212 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:34:31.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 37 128 191552 191424 40.4146 23.5547 0.0511754 0.0247212 2026-02-24T08:34:31.250 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:34:31.250 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:34:31.251 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:34:31.401 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:31.527 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:31.525+0000 7f58c9767640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:31.528 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:31.525+0000 7f58c9767640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:31.560 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:34:31.560 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:34:31.560 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:34:31.560 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:34:31.560 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:34:31.560 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:34:31.560 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:34:31.561 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:34:31.561 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:34:31.561 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:34:31.561 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:34:31.561 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:34:31.600 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:34:31.600 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:34:31.601 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:34:31.750 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:31.879 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:31.876+0000 7f517236f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:31.880 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:31.877+0000 7f517236f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:31.901 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:34:31.901 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:34:31.901 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:34:31.901 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:34:31.902 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:34:31.902 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:34:31.902 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:34:31.902 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:34:31.902 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:34:31.902 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:34:31.902 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:34:31.902 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:34:31.942 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:34:31.943 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:34:32.092 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:31 trial105 ceph-mon[39442]: pgmap v508: 17 pgs: 17 active+clean; 1.4 GiB data, 8.5 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.88k op/s 2026-02-24T08:34:32.212 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 38 128 194908 194780 40.041 26.2188 0.0421863 0.0249595 2026-02-24T08:34:32.539 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:32.684 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:32.806 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:32.802+0000 7f5b287cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:32.806 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:32.803+0000 7f5b287cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:32.822 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:32.822 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:32.836 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:32.837 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:32.850 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:32.850 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:32.863 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:32.864 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:33.212 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 39 128 198161 198033 39.6659 25.4141 0.0180098 0.025189 2026-02-24T08:34:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1286102272' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:33.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:33 trial105 ceph-mon[39442]: pgmap v509: 17 pgs: 17 active+clean; 1.5 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 33 MiB/s wr, 4.25k op/s 2026-02-24T08:34:34.212 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:34:34.211000+0000 min lat: 0.00075283 max lat: 0.302561 avg lat: 0.0253883 2026-02-24T08:34:34.212 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:34:34.212 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 40 128 201656 201528 39.3568 27.3047 0.0189164 0.0253883 2026-02-24T08:34:34.914 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:35.060 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:35.194 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:35.190+0000 7f3a5b6ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:35.194 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:35.191+0000 7f3a5b6ab640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:35.209 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:35.209 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:35.212 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 41 128 205119 204991 39.0567 27.0547 0.0291418 0.0255825 2026-02-24T08:34:35.223 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:35.223 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:35.236 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:35.236 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:35.250 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:35.250 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:35 trial105 ceph-mon[39442]: pgmap v510: 17 pgs: 17 active+clean; 1.5 GiB data, 8.9 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.74k op/s 2026-02-24T08:34:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1452248968' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:36.212 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 42 128 208684 208556 38.7899 27.8516 0.0190711 0.0257632 2026-02-24T08:34:36.944 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:34:36.944 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:34:36.944 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_7 2026-02-24T08:34:36.944 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:34:37.091 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:37.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 43 128 211998 211870 38.4899 25.8906 0.0392072 0.0259631 2026-02-24T08:34:37.216 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:37.213+0000 7fbb4607f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:37.217 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:37.213+0000 7fbb4607f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:37.296 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:37.368 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:34:37.369 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:34:37.419 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2026-02-24T08:34:36.808652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1648402976,"num_objects":25148,"num_object_clones":0,"num_object_copies":75444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25148,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":201284,"num_write_kb":1611342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160948,"ondisk_log_size":160948,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":9595148,"kb_used_data":4815484,"kb_used_omap":46,"kb_used_meta":4779537,"kb_avail":2926417652,"statfs":{"total":3006477107200,"available":2996651675648,"internally_reserved":0,"allocated":4931055616,"data_stored":4928107696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47439,"internal_metadata":4894246577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,5,12,21,4,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":329973760,"num_objects":5033,"num_object_clones":0,"num_object_copies":15099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5033,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40280,"num_write_kb":322240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001565"},"pg_stats":[{"pgid":"9.f","version":"110'13264","reported_seq":13278,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:36.557284+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:34:36.557284+0000","last_peered":"2026-02-24T08:34:36.557284+0000","last_clean":"2026-02-24T08:34:36.557284+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:34:36.557284+0000","last_undegraded":"2026-02-24T08:34:36.557284+0000","last_fullsized":"2026-02-24T08:34:36.557284+0000","mapping_epoch":108,"log_start":"110'3200","ondisk_log_start":"110'3200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108658688,"num_objects":1658,"num_object_clones":0,"num_object_copies":4974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1658,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13264,"num_write_kb":106112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"110'12395","reported_seq":12407,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:36.501279+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:34:36.501279+0000","last_peered":"2026-02-24T08:34:36.501279+0000","last_clean":"2026-02-24T08:34:36.501279+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:34:36.501279+0000","last_undegraded":"2026-02-24T08:34:36.501279+0000","last_fullsized":"2026-02-24T08:34:36.501279+0000","mapping_epoch":108,"log_start":"110'2300","ondisk_log_start":"110'2300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101539840,"num_objects":1550,"num_object_clones":0,"num_object_copies":4650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1550,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12395,"num_write_kb":99160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"110'12776","reported_seq":12790,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:36.496786+0000","last_change":"2026-02-24T08:33:53.121638+0000","last_active":"2026-02-24T08:34:36.496786+0000","last_peered":"2026-02-24T08:34:36.496786+0000","last_clean":"2026-02-24T08:34:36.496786+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:34:36.496786+0000","last_undegraded":"2026-02-24T08:34:36.496786+0000","last_fullsized":"2026-02-24T08:34:36.496786+0000","mapping_epoch":108,"log_start":"110'2700","ondisk_log_start":"110'2700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:57.022482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104660992,"num_objects":1597,"num_object_clones":0,"num_object_copies":4791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12776,"num_write_kb":102208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"110'12112","reported_seq":12117,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:32.389512+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:34:32.389512+0000","last_peered":"2026-02-24T08:34:32.389512+0000","last_clean":"2026-02-24T08:34:32.389512+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:34:32.389512+0000","last_undegraded":"2026-02-24T08:34:32.389512+0000","last_fullsized":"2026-02-24T08:34:32.389512+0000","mapping_epoch":108,"log_start":"110'2100","ondisk_log_start":"110'2100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:58.438348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99221504,"num_objects":1514,"num_object_clones":0,"num_object_copies":4542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12112,"num_write_kb":96896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"110'12391","reported_seq":12396,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:31.977204+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:34:31.977204+0000","last_peered":"2026-02-24T08:34:31.977204+0000","last_clean":"2026-02-24T08:34:31.977204+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:34:31.977204+0000","last_undegraded":"2026-02-24T08:34:31.977204+0000","last_fullsized":"2026-02-24T08:34:31.977204+0000","mapping_epoch":108,"log_start":"110'2300","ondisk_log_start":"110'2300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101507072,"num_objects":1549,"num_object_clones":0,"num_object_copies":4647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1549,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12391,"num_write_kb":99128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"110'13816","reported_seq":13830,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:36.543543+0000","last_change":"2026-02-24T08:33:53.122546+0000","last_active":"2026-02-24T08:34:36.543543+0000","last_peered":"2026-02-24T08:34:36.543543+0000","last_clean":"2026-02-24T08:34:36.543543+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:34:36.543543+0000","last_undegraded":"2026-02-24T08:34:36.543543+0000","last_fullsized":"2026-02-24T08:34:36.543543+0000","mapping_epoch":108,"log_start":"110'3800","ondisk_log_start":"110'3800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.480819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113180672,"num_objects":1727,"num_object_clones":0,"num_object_copies":5181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1727,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13816,"num_write_kb":110528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"110'12628","reported_seq":12642,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:31.972998+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:34:31.972998+0000","last_peered":"2026-02-24T08:34:31.972998+0000","last_clean":"2026-02-24T08:34:31.972998+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:34:31.972998+0000","last_undegraded":"2026-02-24T08:34:31.972998+0000","last_fullsized":"2026-02-24T08:34:31.972998+0000","mapping_epoch":108,"log_start":"110'2600","ondisk_log_start":"110'2600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103448576,"num_objects":1579,"num_object_clones":0,"num_object_copies":4737,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1579,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12628,"num_write_kb":101024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"110'12896","reported_seq":12910,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:36.536201+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:34:36.536201+0000","last_peered":"2026-02-24T08:34:36.536201+0000","last_clean":"2026-02-24T08:34:36.536201+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:34:36.536201+0000","last_undegraded":"2026-02-24T08:34:36.536201+0000","last_fullsized":"2026-02-24T08:34:36.536201+0000","mapping_epoch":108,"log_start":"110'2800","ondisk_log_start":"110'2800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.898614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105644032,"num_objects":1612,"num_object_clones":0,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12896,"num_write_kb":103168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"110'13504","reported_seq":13518,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:36.525468+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:34:36.525468+0000","last_peered":"2026-02-24T08:34:36.525468+0000","last_clean":"2026-02-24T08:34:36.525468+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:34:36.525468+0000","last_undegraded":"2026-02-24T08:34:36.525468+0000","last_fullsized":"2026-02-24T08:34:36.525468+0000","mapping_epoch":108,"log_start":"110'3500","ondisk_log_start":"110'3500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110624768,"num_objects":1688,"num_object_clones":0,"num_object_copies":5064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1688,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13504,"num_write_kb":108032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"110'12264","reported_seq":12272,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:31.974843+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:34:31.974843+0000","last_peered":"2026-02-24T08:34:31.974843+0000","last_clean":"2026-02-24T08:34:31.974843+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:34:31.974843+0000","last_undegraded":"2026-02-24T08:34:31.974843+0000","last_fullsized":"2026-02-24T08:34:31.974843+0000","mapping_epoch":108,"log_start":"110'2200","ondisk_log_start":"110'2200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100466688,"num_objects":1533,"num_object_clones":0,"num_object_copies":4599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12264,"num_write_kb":98112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"110'11640","reported_seq":11654,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:32.381154+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:34:32.381154+0000","last_peered":"2026-02-24T08:34:32.381154+0000","last_clean":"2026-02-24T08:34:32.381154+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:34:32.381154+0000","last_undegraded":"2026-02-24T08:34:32.381154+0000","last_fullsized":"2026-02-24T08:34:32.381154+0000","mapping_epoch":108,"log_start":"110'1600","ondisk_log_start":"110'1600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95354880,"num_objects":1455,"num_object_clones":0,"num_object_copies":4365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11640,"num_write_kb":93120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"110'12725","reported_seq":12737,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:36.491613+0000","last_change":"2026-02-24T08:33:53.120976+0000","last_active":"2026-02-24T08:34:36.491613+0000","last_peered":"2026-02-24T08:34:36.491613+0000","last_clean":"2026-02-24T08:34:36.491613+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:34:36.491613+0000","last_undegraded":"2026-02-24T08:34:36.491613+0000","last_fullsized":"2026-02-24T08:34:36.491613+0000","mapping_epoch":108,"log_start":"110'2700","ondisk_log_start":"110'2700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:02.945733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104243200,"num_objects":1591,"num_object_clones":0,"num_object_copies":4773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1591,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12725,"num_write_kb":101800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"110'12272","reported_seq":12286,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:32.370095+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:34:32.370095+0000","last_peered":"2026-02-24T08:34:32.370095+0000","last_clean":"2026-02-24T08:34:32.370095+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:34:32.370095+0000","last_undegraded":"2026-02-24T08:34:32.370095+0000","last_fullsized":"2026-02-24T08:34:32.370095+0000","mapping_epoch":108,"log_start":"110'2200","ondisk_log_start":"110'2200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100532224,"num_objects":1534,"num_object_clones":0,"num_object_copies":4602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12272,"num_write_kb":98176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"110'12440","reported_seq":12454,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:31.823131+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:34:31.823131+0000","last_peered":"2026-02-24T08:34:31.823131+0000","last_clean":"2026-02-24T08:34:31.823131+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:34:31.823131+0000","last_undegraded":"2026-02-24T08:34:31.823131+0000","last_fullsized":"2026-02-24T08:34:31.823131+0000","mapping_epoch":108,"log_start":"110'2400","ondisk_log_start":"110'2400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101908480,"num_objects":1555,"num_object_clones":0,"num_object_copies":4665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12440,"num_write_kb":99520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"110'11874","reported_seq":11886,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:32.383045+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:34:32.383045+0000","last_peered":"2026-02-24T08:34:32.383045+0000","last_clean":"2026-02-24T08:34:32.383045+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:34:32.383045+0000","last_undegraded":"2026-02-24T08:34:32.383045+0000","last_fullsized":"2026-02-24T08:34:32.383045+0000","mapping_epoch":108,"log_start":"110'1800","ondisk_log_start":"110'1800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97271808,"num_objects":1485,"num_object_clones":0,"num_object_copies":4455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1485,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11874,"num_write_kb":94992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"110'12152","reported_seq":12166,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:32.383290+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:34:32.383290+0000","last_peered":"2026-02-24T08:34:32.383290+0000","last_clean":"2026-02-24T08:34:32.383290+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:34:32.383290+0000","last_undegraded":"2026-02-24T08:34:32.383290+0000","last_fullsized":"2026-02-24T08:34:32.383290+0000","mapping_epoch":108,"log_start":"110'2100","ondisk_log_start":"110'2100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:01.943572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99549184,"num_objects":1519,"num_object_clones":0,"num_object_copies":4557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1519,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12152,"num_write_kb":97216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":306,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:13.944709+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:34:13.944709+0000","last_peered":"2026-02-24T08:34:13.944709+0000","last_clean":"2026-02-24T08:34:13.944709+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:34:13.944709+0000","last_undegraded":"2026-02-24T08:34:13.944709+0000","last_fullsized":"2026-02-24T08:34:13.944709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1647812608,"num_objects":25146,"num_object_clones":0,"num_object_copies":75438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201149,"num_write_kb":1609192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4969193472,"data_stored":4969193472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160849,"ondisk_log_size":160849,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4462,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247981,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2545280,"kb_used_data":1349292,"kb_used_omap":11,"kb_used_meta":1195956,"kb_avail":731457920,"statfs":{"total":751619276800,"available":749012910080,"internally_reserved":0,"allocated":1381675008,"data_stored":1380937140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12086,"internal_metadata":1224659146},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,5,12,21,4,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444207,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2365712,"kb_used_data":1139580,"kb_used_omap":10,"kb_used_meta":1226101,"kb_avail":731637488,"statfs":{"total":751619276800,"available":749196787712,"internally_reserved":0,"allocated":1166929920,"data_stored":1166192052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1255527993},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575024,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2411916,"kb_used_data":1352504,"kb_used_omap":11,"kb_used_meta":1059380,"kb_avail":731591284,"statfs":{"total":751619276800,"available":749149474816,"internally_reserved":0,"allocated":1384964096,"data_stored":1384229780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11996,"internal_metadata":1084805412},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705842,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2272240,"kb_used_data":974108,"kb_used_omap":12,"kb_used_meta":1298099,"kb_avail":731730960,"statfs":{"total":751619276800,"available":749292503040,"internally_reserved":0,"allocated":997486592,"data_stored":996748724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12662,"internal_metadata":1329254026},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4462,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":997892096,"data_stored":997892096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1395441664,"data_stored":1395441664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1183072256,"data_stored":1183072256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1392787456,"data_stored":1392787456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:34:37.421 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_7 pgp_num 46 2026-02-24T08:34:37.453 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:37.573 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:37.584 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:37.580+0000 7efd7a43b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:37.585 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:37.582+0000 7efd7a43b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:37.609 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:37.609 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:37.624 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:37.624 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:37.639 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:37.639 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:37.654 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:37.654 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:37.693 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:37.690+0000 7f4f80820640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:37.693 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:37.690+0000 7f4f80820640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:37.839 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:34:37.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:34:38.123 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:37 trial105 ceph-mon[39442]: pgmap v511: 17 pgs: 17 active+clean; 1.5 GiB data, 9.2 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.36k op/s 2026-02-24T08:34:38.123 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2006260249' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:38.123 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3008182959' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_7", "var": "pgp_num", "val": "46"} : dispatch 2026-02-24T08:34:38.212 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 44 128 215096 214968 38.1648 24.2031 0.0762149 0.0261832 2026-02-24T08:34:39.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:38 trial105 ceph-mon[39442]: from='client.15723 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:34:39.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 45 128 218343 218215 37.8804 25.3672 0.0328752 0.0263842 2026-02-24T08:34:39.703 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:39.840 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:34:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:34:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:34:39.849 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:39.864 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:34:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:34:39] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T08:34:39.977 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:39.974+0000 7ffab82d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:39.977 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:39.974+0000 7ffab82d8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:39.993 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:39.994 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:40.009 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:40.009 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:40.022 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:40.022 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:40.036 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:40.037 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:40.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:39 trial105 ceph-mon[39442]: pgmap v512: 17 pgs: 17 active+clean; 1.6 GiB data, 9.4 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.56k op/s 2026-02-24T08:34:40.212 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 46 128 221585 221457 37.6075 25.3281 0.0513645 0.0265727 2026-02-24T08:34:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:40 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/261772789' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:34:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:34:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:34:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:34:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:34:41.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 47 128 224988 224860 37.373 26.5859 0.0248078 0.0267453 2026-02-24T08:34:42.110 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:42.135 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:41 trial105 ceph-mon[39442]: pgmap v513: 17 pgs: 17 active+clean; 1.6 GiB data, 9.4 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.80k op/s 2026-02-24T08:34:42.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 48 128 228242 228114 37.124 25.4219 0.018681 0.02691 2026-02-24T08:34:42.252 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:42.379 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:42.375+0000 7f929fd8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:42.380 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:42.377+0000 7f929fd8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:42.395 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:42.395 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:42.410 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:42.411 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:42.424 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:42.424 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:42.439 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:42.440 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:42.884 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:34:42.884 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:34:42.884 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:34:42.885 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:34:43.030 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:43.159 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:43.155+0000 7f58a7777640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:43.159 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:43.155+0000 7f58a7777640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:43.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/704212503' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:43.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:43 trial105 ceph-mon[39442]: pgmap v514: 17 pgs: 17 active+clean; 1.7 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.16k op/s 2026-02-24T08:34:43.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 49 128 231401 231273 36.87 24.6797 0.0232058 0.0271036 2026-02-24T08:34:43.316 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:34:43.317 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:34:43.365 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":514,"stamp":"2026-02-24T08:34:42.809503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1861878304,"num_objects":28406,"num_object_clones":0,"num_object_copies":85218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28406,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":227343,"num_write_kb":1819814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160907,"ondisk_log_size":160907,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10392796,"kb_used_data":5414604,"kb_used_omap":46,"kb_used_meta":4978065,"kb_avail":2925620004,"statfs":{"total":3006477107200,"available":2995834884096,"internally_reserved":0,"allocated":5544554496,"data_stored":5541606576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47439,"internal_metadata":5097539249},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":408551424,"num_objects":6236,"num_object_clones":0,"num_object_copies":18708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6236,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49872,"num_write_kb":398976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001621"},"pg_stats":[{"pgid":"9.f","version":"110'14336","reported_seq":14349,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.578811+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:34:41.578811+0000","last_peered":"2026-02-24T08:34:41.578811+0000","last_clean":"2026-02-24T08:34:41.578811+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:34:41.578811+0000","last_undegraded":"2026-02-24T08:34:41.578811+0000","last_fullsized":"2026-02-24T08:34:41.578811+0000","mapping_epoch":108,"log_start":"110'4300","ondisk_log_start":"110'4300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":1792,"num_object_clones":0,"num_object_copies":5376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14336,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"110'13334","reported_seq":13348,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.569818+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:34:41.569818+0000","last_peered":"2026-02-24T08:34:41.569818+0000","last_clean":"2026-02-24T08:34:41.569818+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:34:41.569818+0000","last_undegraded":"2026-02-24T08:34:41.569818+0000","last_fullsized":"2026-02-24T08:34:41.569818+0000","mapping_epoch":108,"log_start":"110'3300","ondisk_log_start":"110'3300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109232128,"num_objects":1667,"num_object_clones":0,"num_object_copies":5001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1667,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13334,"num_write_kb":106672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"110'13690","reported_seq":13704,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.500448+0000","last_change":"2026-02-24T08:33:53.121638+0000","last_active":"2026-02-24T08:34:41.500448+0000","last_peered":"2026-02-24T08:34:41.500448+0000","last_clean":"2026-02-24T08:34:41.500448+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:34:41.500448+0000","last_undegraded":"2026-02-24T08:34:41.500448+0000","last_fullsized":"2026-02-24T08:34:41.500448+0000","mapping_epoch":108,"log_start":"110'3600","ondisk_log_start":"110'3600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:57.022482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112148480,"num_objects":1712,"num_object_clones":0,"num_object_copies":5136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1712,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13690,"num_write_kb":109520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"110'14200","reported_seq":14214,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:42.406169+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:34:42.406169+0000","last_peered":"2026-02-24T08:34:42.406169+0000","last_clean":"2026-02-24T08:34:42.406169+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:34:42.406169+0000","last_undegraded":"2026-02-24T08:34:42.406169+0000","last_fullsized":"2026-02-24T08:34:42.406169+0000","mapping_epoch":108,"log_start":"110'4100","ondisk_log_start":"110'4100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:58.438348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116326400,"num_objects":1775,"num_object_clones":0,"num_object_copies":5325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1775,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14200,"num_write_kb":113600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"110'14347","reported_seq":14359,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.992974+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:34:41.992974+0000","last_peered":"2026-02-24T08:34:41.992974+0000","last_clean":"2026-02-24T08:34:41.992974+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:34:41.992974+0000","last_undegraded":"2026-02-24T08:34:41.992974+0000","last_fullsized":"2026-02-24T08:34:41.992974+0000","mapping_epoch":108,"log_start":"110'4300","ondisk_log_start":"110'4300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117530624,"num_objects":1794,"num_object_clones":0,"num_object_copies":5382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1794,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14347,"num_write_kb":114776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"110'14802","reported_seq":14808,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.567928+0000","last_change":"2026-02-24T08:33:53.122546+0000","last_active":"2026-02-24T08:34:41.567928+0000","last_peered":"2026-02-24T08:34:41.567928+0000","last_clean":"2026-02-24T08:34:41.567928+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:34:41.567928+0000","last_undegraded":"2026-02-24T08:34:41.567928+0000","last_fullsized":"2026-02-24T08:34:41.567928+0000","mapping_epoch":108,"log_start":"110'4800","ondisk_log_start":"110'4800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.480819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121257984,"num_objects":1851,"num_object_clones":0,"num_object_copies":5553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1851,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14802,"num_write_kb":118416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"110'14736","reported_seq":14750,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.991522+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:34:41.991522+0000","last_peered":"2026-02-24T08:34:41.991522+0000","last_clean":"2026-02-24T08:34:41.991522+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:34:41.991522+0000","last_undegraded":"2026-02-24T08:34:41.991522+0000","last_fullsized":"2026-02-24T08:34:41.991522+0000","mapping_epoch":108,"log_start":"110'4700","ondisk_log_start":"110'4700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120717312,"num_objects":1842,"num_object_clones":0,"num_object_copies":5526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14736,"num_write_kb":117888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"110'14096","reported_seq":14110,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.572703+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:34:41.572703+0000","last_peered":"2026-02-24T08:34:41.572703+0000","last_clean":"2026-02-24T08:34:41.572703+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:34:41.572703+0000","last_undegraded":"2026-02-24T08:34:41.572703+0000","last_fullsized":"2026-02-24T08:34:41.572703+0000","mapping_epoch":108,"log_start":"110'4000","ondisk_log_start":"110'4000","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.898614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115474432,"num_objects":1762,"num_object_clones":0,"num_object_copies":5286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14096,"num_write_kb":112768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"110'14616","reported_seq":14630,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.516254+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:34:41.516254+0000","last_peered":"2026-02-24T08:34:41.516254+0000","last_clean":"2026-02-24T08:34:41.516254+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:34:41.516254+0000","last_undegraded":"2026-02-24T08:34:41.516254+0000","last_fullsized":"2026-02-24T08:34:41.516254+0000","mapping_epoch":108,"log_start":"110'4600","ondisk_log_start":"110'4600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119734272,"num_objects":1827,"num_object_clones":0,"num_object_copies":5481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1827,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14616,"num_write_kb":116928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"110'14336","reported_seq":14350,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.979833+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:34:41.979833+0000","last_peered":"2026-02-24T08:34:41.979833+0000","last_clean":"2026-02-24T08:34:41.979833+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:34:41.979833+0000","last_undegraded":"2026-02-24T08:34:41.979833+0000","last_fullsized":"2026-02-24T08:34:41.979833+0000","mapping_epoch":108,"log_start":"110'4300","ondisk_log_start":"110'4300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":1792,"num_object_clones":0,"num_object_copies":5376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1792,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14336,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"110'13760","reported_seq":13774,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:42.444242+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:34:42.444242+0000","last_peered":"2026-02-24T08:34:42.444242+0000","last_clean":"2026-02-24T08:34:42.444242+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:34:42.444242+0000","last_undegraded":"2026-02-24T08:34:42.444242+0000","last_fullsized":"2026-02-24T08:34:42.444242+0000","mapping_epoch":108,"log_start":"110'3700","ondisk_log_start":"110'3700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112721920,"num_objects":1720,"num_object_clones":0,"num_object_copies":5160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13760,"num_write_kb":110080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"110'13664","reported_seq":13678,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.498732+0000","last_change":"2026-02-24T08:33:53.120976+0000","last_active":"2026-02-24T08:34:41.498732+0000","last_peered":"2026-02-24T08:34:41.498732+0000","last_clean":"2026-02-24T08:34:41.498732+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:34:41.498732+0000","last_undegraded":"2026-02-24T08:34:41.498732+0000","last_fullsized":"2026-02-24T08:34:41.498732+0000","mapping_epoch":108,"log_start":"110'3600","ondisk_log_start":"110'3600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:02.945733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111935488,"num_objects":1708,"num_object_clones":0,"num_object_copies":5124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1708,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13664,"num_write_kb":109312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"110'14235","reported_seq":14249,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:42.438552+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:34:42.438552+0000","last_peered":"2026-02-24T08:34:42.438552+0000","last_clean":"2026-02-24T08:34:42.438552+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:34:42.438552+0000","last_undegraded":"2026-02-24T08:34:42.438552+0000","last_fullsized":"2026-02-24T08:34:42.438552+0000","mapping_epoch":108,"log_start":"110'4200","ondisk_log_start":"110'4200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116613120,"num_objects":1780,"num_object_clones":0,"num_object_copies":5340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1780,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14235,"num_write_kb":113880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"110'14608","reported_seq":14613,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:41.999349+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:34:41.999349+0000","last_peered":"2026-02-24T08:34:41.999349+0000","last_clean":"2026-02-24T08:34:41.999349+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:34:41.999349+0000","last_undegraded":"2026-02-24T08:34:41.999349+0000","last_fullsized":"2026-02-24T08:34:41.999349+0000","mapping_epoch":108,"log_start":"110'4600","ondisk_log_start":"110'4600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119668736,"num_objects":1826,"num_object_clones":0,"num_object_copies":5478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1826,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14608,"num_write_kb":116864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"110'14152","reported_seq":14163,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:42.439245+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:34:42.439245+0000","last_peered":"2026-02-24T08:34:42.439245+0000","last_clean":"2026-02-24T08:34:42.439245+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:34:42.439245+0000","last_undegraded":"2026-02-24T08:34:42.439245+0000","last_fullsized":"2026-02-24T08:34:42.439245+0000","mapping_epoch":108,"log_start":"110'4100","ondisk_log_start":"110'4100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115933184,"num_objects":1769,"num_object_clones":0,"num_object_copies":5307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1769,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14152,"num_write_kb":113216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"110'14296","reported_seq":14310,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:42.423423+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:34:42.423423+0000","last_peered":"2026-02-24T08:34:42.423423+0000","last_clean":"2026-02-24T08:34:42.423423+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:34:42.423423+0000","last_undegraded":"2026-02-24T08:34:42.423423+0000","last_fullsized":"2026-02-24T08:34:42.423423+0000","mapping_epoch":108,"log_start":"110'4200","ondisk_log_start":"110'4200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:01.943572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117112832,"num_objects":1787,"num_object_clones":0,"num_object_copies":5361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14296,"num_write_kb":114368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":306,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:13.944709+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:34:13.944709+0000","last_peered":"2026-02-24T08:34:13.944709+0000","last_clean":"2026-02-24T08:34:13.944709+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:34:13.944709+0000","last_undegraded":"2026-02-24T08:34:13.944709+0000","last_fullsized":"2026-02-24T08:34:13.944709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1861287936,"num_objects":28404,"num_object_clones":0,"num_object_copies":85212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227208,"num_write_kb":1817664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5581545472,"data_stored":5581545472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160808,"ondisk_log_size":160808,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4462,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247982,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2702760,"kb_used_data":1453140,"kb_used_omap":11,"kb_used_meta":1249588,"kb_avail":731300440,"statfs":{"total":751619276800,"available":748851650560,"internally_reserved":0,"allocated":1488015360,"data_stored":1487277492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12086,"internal_metadata":1279578314},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444208,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2513504,"kb_used_data":1232716,"kb_used_omap":10,"kb_used_meta":1280757,"kb_avail":731489696,"statfs":{"total":751619276800,"available":749045448704,"internally_reserved":0,"allocated":1262301184,"data_stored":1261563316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1311495737},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2700756,"kb_used_data":1587200,"kb_used_omap":11,"kb_used_meta":1113524,"kb_avail":731302444,"statfs":{"total":751619276800,"available":748853702656,"internally_reserved":0,"allocated":1625292800,"data_stored":1624558484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11996,"internal_metadata":1140248868},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705844,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2475776,"kb_used_data":1141548,"kb_used_omap":12,"kb_used_meta":1334195,"kb_avail":731527424,"statfs":{"total":751619276800,"available":749084082176,"internally_reserved":0,"allocated":1168945152,"data_stored":1168207284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12662,"internal_metadata":1366216330},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4462,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1169891328,"data_stored":1169891328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1635115008,"data_stored":1635115008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1277394944,"data_stored":1277394944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1499144192,"data_stored":1499144192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:34:43.366 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 291 2026-02-24T08:34:43.514 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:43.653 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:43.649+0000 7f784e8a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:43.653 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:43.649+0000 7f784e8a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:43.809 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:34:43.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:34:44.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 50 128 234775 234647 36.6597 26.3594 0.0827092 0.0272609 2026-02-24T08:34:44.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:44 trial105 ceph-mon[39442]: from='client.15733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:34:44.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1095331144' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "291"} : dispatch 2026-02-24T08:34:44.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:34:44.487 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:44.628 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:44.749 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:44.746+0000 7f26bbf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:44.749 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:44.746+0000 7f26bbf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:44.765 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:44.765 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:44.780 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:44.780 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:44.798 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:44.798 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:44.815 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:44.815 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:45.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 51 128 238179 238051 36.4623 26.5938 0.0184297 0.0274123 2026-02-24T08:34:45.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1542931500' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:45.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:45 trial105 ceph-mon[39442]: pgmap v515: 17 pgs: 17 active+clean; 1.7 GiB data, 9.9 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.78k op/s 2026-02-24T08:34:46.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 52 128 241739 241611 36.2959 27.8125 0.0195282 0.0275353 2026-02-24T08:34:46.861 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:46.885 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:46 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:34:46.885 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:46 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:34:47.010 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:47.137 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:47.134+0000 7f98b5459640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:47.137 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:47.135+0000 7f98b5459640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:47.154 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:47.155 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:47.170 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:47.171 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:47.188 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:47.189 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:47.202 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:47.202 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:47.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 53 127 244944 244817 36.0836 25.0469 0.05376 0.0277014 2026-02-24T08:34:47.762 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:47 trial105 ceph-mon[39442]: pgmap v516: 17 pgs: 17 active+clean; 1.8 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.40k op/s 2026-02-24T08:34:47.762 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:47 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1352365227' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:48.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 54 128 247919 247791 35.8457 23.2344 0.0467598 0.0278798 2026-02-24T08:34:48.856 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:34:48.856 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:34:48.857 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:34:48.857 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:34:49.002 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:49.135 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:49.132+0000 7f2e03719640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:49.135 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:49.133+0000 7f2e03719640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:49.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 55 128 251111 250983 35.6473 24.9375 0.0992366 0.0280342 2026-02-24T08:34:49.278 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:34:49.279 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:34:49.325 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":517,"stamp":"2026-02-24T08:34:48.810365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1999700512,"num_objects":30507,"num_object_clones":0,"num_object_copies":91521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30507,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":244167,"num_write_kb":1954406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161131,"ondisk_log_size":161131,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":10871212,"kb_used_data":5820828,"kb_used_omap":46,"kb_used_meta":5050257,"kb_avail":2925141588,"statfs":{"total":3006477107200,"available":2995344986112,"internally_reserved":0,"allocated":5960527872,"data_stored":5957579952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48086,"internal_metadata":5171463210},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":351297536,"num_objects":5359,"num_object_clones":0,"num_object_copies":16077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5359,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42883,"num_write_kb":343064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001713"},"pg_stats":[{"pgid":"9.f","version":"110'15360","reported_seq":15374,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:46.484979+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:34:46.484979+0000","last_peered":"2026-02-24T08:34:46.484979+0000","last_clean":"2026-02-24T08:34:46.484979+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:34:46.484979+0000","last_undegraded":"2026-02-24T08:34:46.484979+0000","last_fullsized":"2026-02-24T08:34:46.484979+0000","mapping_epoch":108,"log_start":"110'5300","ondisk_log_start":"110'5300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":1920,"num_object_clones":0,"num_object_copies":5760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15360,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"110'14254","reported_seq":14268,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:46.585105+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:34:46.585105+0000","last_peered":"2026-02-24T08:34:46.585105+0000","last_clean":"2026-02-24T08:34:46.585105+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:34:46.585105+0000","last_undegraded":"2026-02-24T08:34:46.585105+0000","last_fullsized":"2026-02-24T08:34:46.585105+0000","mapping_epoch":108,"log_start":"110'4200","ondisk_log_start":"110'4200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116768768,"num_objects":1782,"num_object_clones":0,"num_object_copies":5346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1782,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14254,"num_write_kb":114032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"110'14824","reported_seq":14838,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:46.524050+0000","last_change":"2026-02-24T08:33:53.121638+0000","last_active":"2026-02-24T08:34:46.524050+0000","last_peered":"2026-02-24T08:34:46.524050+0000","last_clean":"2026-02-24T08:34:46.524050+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:34:46.524050+0000","last_undegraded":"2026-02-24T08:34:46.524050+0000","last_fullsized":"2026-02-24T08:34:46.524050+0000","mapping_epoch":108,"log_start":"110'4800","ondisk_log_start":"110'4800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:57.022482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121438208,"num_objects":1853,"num_object_clones":0,"num_object_copies":5559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1853,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14824,"num_write_kb":118592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"110'15272","reported_seq":15286,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:47.413103+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:34:47.413103+0000","last_peered":"2026-02-24T08:34:47.413103+0000","last_clean":"2026-02-24T08:34:47.413103+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:34:47.413103+0000","last_undegraded":"2026-02-24T08:34:47.413103+0000","last_fullsized":"2026-02-24T08:34:47.413103+0000","mapping_epoch":108,"log_start":"110'5200","ondisk_log_start":"110'5200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:58.438348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125108224,"num_objects":1909,"num_object_clones":0,"num_object_copies":5727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15272,"num_write_kb":122176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"110'15496","reported_seq":15510,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:46.992039+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:34:46.992039+0000","last_peered":"2026-02-24T08:34:46.992039+0000","last_clean":"2026-02-24T08:34:46.992039+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:34:46.992039+0000","last_undegraded":"2026-02-24T08:34:46.992039+0000","last_fullsized":"2026-02-24T08:34:46.992039+0000","mapping_epoch":108,"log_start":"110'5400","ondisk_log_start":"110'5400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126943232,"num_objects":1937,"num_object_clones":0,"num_object_copies":5811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1937,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15496,"num_write_kb":123968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"110'15688","reported_seq":15702,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:46.534799+0000","last_change":"2026-02-24T08:33:53.122546+0000","last_active":"2026-02-24T08:34:46.534799+0000","last_peered":"2026-02-24T08:34:46.534799+0000","last_clean":"2026-02-24T08:34:46.534799+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:34:46.534799+0000","last_undegraded":"2026-02-24T08:34:46.534799+0000","last_fullsized":"2026-02-24T08:34:46.534799+0000","mapping_epoch":108,"log_start":"110'5600","ondisk_log_start":"110'5600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.480819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128516096,"num_objects":1961,"num_object_clones":0,"num_object_copies":5883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15688,"num_write_kb":125504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"110'15840","reported_seq":15854,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:46.984031+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:34:46.984031+0000","last_peered":"2026-02-24T08:34:46.984031+0000","last_clean":"2026-02-24T08:34:46.984031+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:34:46.984031+0000","last_undegraded":"2026-02-24T08:34:46.984031+0000","last_fullsized":"2026-02-24T08:34:46.984031+0000","mapping_epoch":108,"log_start":"110'5800","ondisk_log_start":"110'5800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129761280,"num_objects":1980,"num_object_clones":0,"num_object_copies":5940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15840,"num_write_kb":126720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"110'15240","reported_seq":15251,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:46.594224+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:34:46.594224+0000","last_peered":"2026-02-24T08:34:46.594224+0000","last_clean":"2026-02-24T08:34:46.594224+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:34:46.594224+0000","last_undegraded":"2026-02-24T08:34:46.594224+0000","last_fullsized":"2026-02-24T08:34:46.594224+0000","mapping_epoch":108,"log_start":"110'5200","ondisk_log_start":"110'5200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.898614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124846080,"num_objects":1905,"num_object_clones":0,"num_object_copies":5715,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15240,"num_write_kb":121920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"110'15776","reported_seq":15790,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:46.523352+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:34:46.523352+0000","last_peered":"2026-02-24T08:34:46.523352+0000","last_clean":"2026-02-24T08:34:46.523352+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:34:46.523352+0000","last_undegraded":"2026-02-24T08:34:46.523352+0000","last_fullsized":"2026-02-24T08:34:46.523352+0000","mapping_epoch":108,"log_start":"110'5700","ondisk_log_start":"110'5700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129236992,"num_objects":1972,"num_object_clones":0,"num_object_copies":5916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1972,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15776,"num_write_kb":126208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"110'15296","reported_seq":15308,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:47.010642+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:34:47.010642+0000","last_peered":"2026-02-24T08:34:47.010642+0000","last_clean":"2026-02-24T08:34:47.010642+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:34:47.010642+0000","last_undegraded":"2026-02-24T08:34:47.010642+0000","last_fullsized":"2026-02-24T08:34:47.010642+0000","mapping_epoch":108,"log_start":"110'5200","ondisk_log_start":"110'5200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125304832,"num_objects":1912,"num_object_clones":0,"num_object_copies":5736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15296,"num_write_kb":122368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"110'14800","reported_seq":14814,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:47.482966+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:34:47.482966+0000","last_peered":"2026-02-24T08:34:47.482966+0000","last_clean":"2026-02-24T08:34:47.482966+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:34:47.482966+0000","last_undegraded":"2026-02-24T08:34:47.482966+0000","last_fullsized":"2026-02-24T08:34:47.482966+0000","mapping_epoch":108,"log_start":"110'4700","ondisk_log_start":"110'4700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121241600,"num_objects":1850,"num_object_clones":0,"num_object_copies":5550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1850,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14800,"num_write_kb":118400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"110'14773","reported_seq":14786,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:46.531258+0000","last_change":"2026-02-24T08:33:53.120976+0000","last_active":"2026-02-24T08:34:46.531258+0000","last_peered":"2026-02-24T08:34:46.531258+0000","last_clean":"2026-02-24T08:34:46.531258+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:34:46.531258+0000","last_undegraded":"2026-02-24T08:34:46.531258+0000","last_fullsized":"2026-02-24T08:34:46.531258+0000","mapping_epoch":108,"log_start":"110'4700","ondisk_log_start":"110'4700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:02.945733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121020416,"num_objects":1847,"num_object_clones":0,"num_object_copies":5541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1847,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14773,"num_write_kb":118184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"110'15280","reported_seq":15294,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:47.421247+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:34:47.421247+0000","last_peered":"2026-02-24T08:34:47.421247+0000","last_clean":"2026-02-24T08:34:47.421247+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:34:47.421247+0000","last_undegraded":"2026-02-24T08:34:47.421247+0000","last_fullsized":"2026-02-24T08:34:47.421247+0000","mapping_epoch":108,"log_start":"110'5200","ondisk_log_start":"110'5200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125173760,"num_objects":1910,"num_object_clones":0,"num_object_copies":5730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1910,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15280,"num_write_kb":122240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"110'15557","reported_seq":15569,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:47.009508+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:34:47.009508+0000","last_peered":"2026-02-24T08:34:47.009508+0000","last_clean":"2026-02-24T08:34:47.009508+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:34:47.009508+0000","last_undegraded":"2026-02-24T08:34:47.009508+0000","last_fullsized":"2026-02-24T08:34:47.009508+0000","mapping_epoch":108,"log_start":"110'5500","ondisk_log_start":"110'5500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127442944,"num_objects":1945,"num_object_clones":0,"num_object_copies":5835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1945,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15557,"num_write_kb":124456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"110'15208","reported_seq":15222,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:47.482348+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:34:47.482348+0000","last_peered":"2026-02-24T08:34:47.482348+0000","last_clean":"2026-02-24T08:34:47.482348+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:34:47.482348+0000","last_undegraded":"2026-02-24T08:34:47.482348+0000","last_fullsized":"2026-02-24T08:34:47.482348+0000","mapping_epoch":108,"log_start":"110'5200","ondisk_log_start":"110'5200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124583936,"num_objects":1901,"num_object_clones":0,"num_object_copies":5703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15208,"num_write_kb":121664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"110'15368","reported_seq":15382,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:47.412422+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:34:47.412422+0000","last_peered":"2026-02-24T08:34:47.412422+0000","last_clean":"2026-02-24T08:34:47.412422+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:34:47.412422+0000","last_undegraded":"2026-02-24T08:34:47.412422+0000","last_fullsized":"2026-02-24T08:34:47.412422+0000","mapping_epoch":108,"log_start":"110'5300","ondisk_log_start":"110'5300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:01.943572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125894656,"num_objects":1921,"num_object_clones":0,"num_object_copies":5763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1921,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15368,"num_write_kb":122944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":306,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:13.944709+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:34:13.944709+0000","last_peered":"2026-02-24T08:34:13.944709+0000","last_clean":"2026-02-24T08:34:13.944709+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:34:13.944709+0000","last_undegraded":"2026-02-24T08:34:13.944709+0000","last_fullsized":"2026-02-24T08:34:13.944709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":1999110144,"num_objects":30505,"num_object_clones":0,"num_object_copies":91515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244032,"num_write_kb":1952256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5993275392,"data_stored":5993275392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161032,"ondisk_log_size":161032,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4480,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247983,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2831584,"kb_used_data":1563916,"kb_used_omap":12,"kb_used_meta":1267635,"kb_avail":731171616,"statfs":{"total":751619276800,"available":748719734784,"internally_reserved":0,"allocated":1601449984,"data_stored":1600712116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12733,"internal_metadata":1298058819},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444209,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2625016,"kb_used_data":1326180,"kb_used_omap":10,"kb_used_meta":1298805,"kb_avail":731378184,"statfs":{"total":751619276800,"available":748931260416,"internally_reserved":0,"allocated":1358008320,"data_stored":1357270452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1329976889},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575027,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2834796,"kb_used_data":1703192,"kb_used_omap":11,"kb_used_meta":1131572,"kb_avail":731168404,"statfs":{"total":751619276800,"available":748716445696,"internally_reserved":0,"allocated":1744068608,"data_stored":1743334292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11996,"internal_metadata":1158730020},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705845,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2579816,"kb_used_data":1227540,"kb_used_omap":12,"kb_used_meta":1352243,"kb_avail":731423384,"statfs":{"total":751619276800,"available":748977545216,"internally_reserved":0,"allocated":1257000960,"data_stored":1256263092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12662,"internal_metadata":1384697482},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4480,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1256964096,"data_stored":1256964096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1755021312,"data_stored":1755021312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1371332608,"data_stored":1371332608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1609957376,"data_stored":1609957376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:34:49.327 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:34:49.328 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 301 2026-02-24T08:34:49.476 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:49.603 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:49.601+0000 7f4605f78640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:49.604 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:49.601+0000 7f4605f78640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:49.712 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:49.738 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:34:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:34:49] "GET /metrics HTTP/1.1" 200 4219 "" "Prometheus/3.6.0" 2026-02-24T08:34:49.758 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:34:49.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:34:49.868 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:49.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:34:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:34:49.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:34:49.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:49.984+0000 7fd3960b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:49.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:49.984+0000 7fd3960b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:50.004 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:50.004 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:49 trial105 ceph-mon[39442]: pgmap v517: 17 pgs: 17 active+clean; 1.9 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 28 MiB/s wr, 3.57k op/s 2026-02-24T08:34:50.004 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3636814055' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "301"} : dispatch 2026-02-24T08:34:50.004 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:50.020 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:50.020 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:50.033 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:50.033 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:50.048 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:50.048 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:50.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 56 128 254240 254112 35.4472 24.4453 0.0554715 0.0281969 2026-02-24T08:34:51.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:50 trial105 ceph-mon[39442]: from='client.15741 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:34:51.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3764320933' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:51.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 57 128 257521 257393 35.275 25.6328 0.070234 0.0283311 2026-02-24T08:34:52.099 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:52.125 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:51 trial105 ceph-mon[39442]: pgmap v518: 17 pgs: 17 active+clean; 1.9 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 22 MiB/s wr, 2.76k op/s 2026-02-24T08:34:52.213 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 58 128 260713 260585 35.0967 24.9375 0.0145356 0.0284753 2026-02-24T08:34:52.243 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:52.372 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:52.369+0000 7fb789c96640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:52.373 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:52.370+0000 7fb789c96640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:52.387 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:52.387 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:52.403 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:52.404 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:52.418 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:52.418 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:52.434 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:52.434 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:53.214 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 59 128 263986 263858 34.9353 25.5703 0.030988 0.0286119 2026-02-24T08:34:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:53 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1410100590' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:53.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:53 trial105 ceph-mon[39442]: pgmap v519: 17 pgs: 17 active+clean; 2.0 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.07k op/s 2026-02-24T08:34:54.214 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:34:54.212903+0000 min lat: 0.00075283 max lat: 0.302561 avg lat: 0.0287338 2026-02-24T08:34:54.214 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:34:54.214 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 60 128 267331 267203 34.7885 26.1328 0.0755324 0.0287338 2026-02-24T08:34:54.481 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:54.627 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:54.756 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:54.754+0000 7f0b877b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:54.759 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:54.757+0000 7f0b877b5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:54.776 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:54.776 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:54.792 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:54.792 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:54.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:34:54.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:34:54.801 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:34:54.801 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:34:54.807 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:54.808 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:54.826 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:54.826 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:54.950 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:55.009 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:54 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3175074998' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:55.068 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:55.066+0000 7fc89116e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:55.068 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:55.066+0000 7fc89116e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:55.090 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:34:55.090 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:34:55.090 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:34:55.090 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:34:55.090 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:34:55.090 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:34:55.091 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:34:55.091 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:34:55.091 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:34:55.091 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:34:55.091 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:34:55.091 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:34:55.123 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:34:55.124 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:34:55.124 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:34:55.214 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 61 128 270542 270414 34.6294 25.0859 0.0261501 0.0288643 2026-02-24T08:34:55.276 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:55.391 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:55.389+0000 7f525442d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:55.391 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:55.389+0000 7f525442d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:55.415 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:34:55.415 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:34:55.415 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:34:55.416 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:34:55.416 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:34:55.416 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:34:55.416 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:34:55.416 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:34:55.416 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:34:55.416 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:34:55.416 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:34:55.416 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:34:55.454 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:34:55.455 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:34:55.455 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:34:55.611 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:55.730 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:55.728+0000 7f7e84a1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:55.730 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:55.728+0000 7f7e84a1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:55.751 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:34:55.751 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:34:55.751 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:34:55.751 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:34:55.751 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:34:55.752 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:34:55.752 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:34:55.752 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:34:55.752 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:34:55.752 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:34:55.752 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:34:55.752 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:34:55.790 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:34:55.791 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:34:55.791 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:34:55.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:55 trial105 ceph-mon[39442]: pgmap v520: 17 pgs: 17 active+clean; 2.0 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 21 MiB/s wr, 2.72k op/s 2026-02-24T08:34:55.952 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:56.086 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:56.084+0000 7ff1dcd8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:56.086 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:56.084+0000 7ff1dcd8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:56.108 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:34:56.108 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:34:56.109 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:34:56.145 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:34:56.146 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:34:56.214 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 62 128 273761 273633 34.4765 25.1484 0.0431078 0.0289927 2026-02-24T08:34:56.880 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:34:57.024 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:57.214 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 63 127 276959 276832 34.3259 24.9922 0.101424 0.0291178 2026-02-24T08:34:57.440 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:57.386+0000 7fe955b63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:57.440 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:57.386+0000 7fe955b63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:57.440 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:57.440 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:57.440 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:57.440 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:57.440 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:57.440 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:57.450 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:57.451 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:34:57.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:57 trial105 ceph-mon[39442]: pgmap v521: 17 pgs: 17 active+clean; 2.0 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 26 MiB/s wr, 3.32k op/s 2026-02-24T08:34:57.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/944837039' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:34:58.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 64 128 280078 279950 34.1699 24.3594 0.0177506 0.0292502 2026-02-24T08:34:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:58 trial105 ceph-mon[39442]: 9.d scrub starts 2026-02-24T08:34:59.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:58 trial105 ceph-mon[39442]: 9.d scrub ok 2026-02-24T08:34:59.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 65 127 283443 283316 34.0487 26.2969 0.0179842 0.0293598 2026-02-24T08:34:59.658 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:34:59.807 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:34:59.817 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:34:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:34:59] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-24T08:34:59.933 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:59.930+0000 7f303548d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:59.933 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:34:59.931+0000 7f303548d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:34:59.934 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:34:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:34:59.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:34:59.948 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:34:59.948 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:34:59.963 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:34:59.963 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:34:59.978 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:34:59.978 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:34:59.993 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:34:59.993 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:00.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:59 trial105 ceph-mon[39442]: pgmap v522: 17 pgs: 17 active+clean; 2.1 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 27 MiB/s wr, 3.46k op/s 2026-02-24T08:35:00.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:34:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:35:00.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 66 128 286754 286626 33.9246 25.8594 0.0129217 0.0294649 2026-02-24T08:35:01.147 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:35:01.147 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:35:01.147 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:35:01.148 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:35:01.172 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:00 trial105 ceph-mon[39442]: osdmap e111: 4 total, 4 up, 4 in 2026-02-24T08:35:01.172 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3993422940' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:01.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 67 127 290080 289953 33.8062 25.9922 0.0475422 0.0295672 2026-02-24T08:35:01.298 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:01.434 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:01.431+0000 7fba94f71640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:01.434 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:01.432+0000 7fba94f71640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:01.572 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:35:01.573 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:35:01.614 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":524,"stamp":"2026-02-24T08:35:00.812099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2262860320,"num_objects":34522,"num_object_clones":0,"num_object_copies":103566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34522,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":276291,"num_write_kb":2211398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160955,"ondisk_log_size":160955,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":11799596,"kb_used_data":6588444,"kb_used_omap":46,"kb_used_meta":5211025,"kb_avail":2924213204,"statfs":{"total":3006477107200,"available":2994394320896,"internally_reserved":0,"allocated":6746566656,"data_stored":6743618736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48086,"internal_metadata":5336089642},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,6,5,7,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":263159808,"num_objects":4015,"num_object_clones":0,"num_object_copies":12045,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4015,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32124,"num_write_kb":256992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001432"},"pg_stats":[{"pgid":"9.f","version":"110'17296","reported_seq":17310,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.605496+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:34:56.605496+0000","last_peered":"2026-02-24T08:34:56.605496+0000","last_clean":"2026-02-24T08:34:56.605496+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:34:56.605496+0000","last_undegraded":"2026-02-24T08:34:56.605496+0000","last_fullsized":"2026-02-24T08:34:56.605496+0000","mapping_epoch":108,"log_start":"110'7200","ondisk_log_start":"110'7200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141688832,"num_objects":2162,"num_object_clones":0,"num_object_copies":6486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17296,"num_write_kb":138368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"110'16384","reported_seq":16396,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.611358+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:34:56.611358+0000","last_peered":"2026-02-24T08:34:56.611358+0000","last_clean":"2026-02-24T08:34:56.611358+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:34:56.611358+0000","last_undegraded":"2026-02-24T08:34:56.611358+0000","last_fullsized":"2026-02-24T08:34:56.611358+0000","mapping_epoch":108,"log_start":"110'6300","ondisk_log_start":"110'6300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":2048,"num_object_clones":0,"num_object_copies":6144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2048,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16384,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"110'16864","reported_seq":16878,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.497281+0000","last_change":"2026-02-24T08:33:53.121638+0000","last_active":"2026-02-24T08:34:56.497281+0000","last_peered":"2026-02-24T08:34:56.497281+0000","last_clean":"2026-02-24T08:34:56.497281+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:34:56.497281+0000","last_undegraded":"2026-02-24T08:34:56.497281+0000","last_fullsized":"2026-02-24T08:34:56.497281+0000","mapping_epoch":108,"log_start":"110'6800","ondisk_log_start":"110'6800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:57.022482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138149888,"num_objects":2108,"num_object_clones":0,"num_object_copies":6324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16864,"num_write_kb":134912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"110'17328","reported_seq":17342,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:57.505169+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:34:57.505169+0000","last_peered":"2026-02-24T08:34:57.505169+0000","last_clean":"2026-02-24T08:34:57.505169+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:34:57.505169+0000","last_undegraded":"2026-02-24T08:34:57.505169+0000","last_fullsized":"2026-02-24T08:34:57.505169+0000","mapping_epoch":108,"log_start":"110'7300","ondisk_log_start":"110'7300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:34:58.438348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141950976,"num_objects":2166,"num_object_clones":0,"num_object_copies":6498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17328,"num_write_kb":138624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"110'17328","reported_seq":17342,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:57.023643+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:34:57.023643+0000","last_peered":"2026-02-24T08:34:57.023643+0000","last_clean":"2026-02-24T08:34:57.023643+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:34:57.023643+0000","last_undegraded":"2026-02-24T08:34:57.023643+0000","last_fullsized":"2026-02-24T08:34:57.023643+0000","mapping_epoch":108,"log_start":"110'7300","ondisk_log_start":"110'7300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141950976,"num_objects":2166,"num_object_clones":0,"num_object_copies":6498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17328,"num_write_kb":138624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"110'17712","reported_seq":17724,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.610801+0000","last_change":"2026-02-24T08:33:53.122546+0000","last_active":"2026-02-24T08:34:56.610801+0000","last_peered":"2026-02-24T08:34:56.610801+0000","last_clean":"2026-02-24T08:34:56.610801+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:34:56.610801+0000","last_undegraded":"2026-02-24T08:34:56.610801+0000","last_fullsized":"2026-02-24T08:34:56.610801+0000","mapping_epoch":108,"log_start":"110'7700","ondisk_log_start":"110'7700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.480819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145096704,"num_objects":2214,"num_object_clones":0,"num_object_copies":6642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2214,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17712,"num_write_kb":141696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"110'17760","reported_seq":17774,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.989107+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:34:56.989107+0000","last_peered":"2026-02-24T08:34:56.989107+0000","last_clean":"2026-02-24T08:34:56.989107+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:34:56.989107+0000","last_undegraded":"2026-02-24T08:34:56.989107+0000","last_fullsized":"2026-02-24T08:34:56.989107+0000","mapping_epoch":108,"log_start":"110'7700","ondisk_log_start":"110'7700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145489920,"num_objects":2220,"num_object_clones":0,"num_object_copies":6660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17760,"num_write_kb":142080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"110'17112","reported_seq":17126,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.506805+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:34:56.506805+0000","last_peered":"2026-02-24T08:34:56.506805+0000","last_clean":"2026-02-24T08:34:56.506805+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:34:56.506805+0000","last_undegraded":"2026-02-24T08:34:56.506805+0000","last_fullsized":"2026-02-24T08:34:56.506805+0000","mapping_epoch":108,"log_start":"110'7100","ondisk_log_start":"110'7100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:04.898614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140181504,"num_objects":2139,"num_object_clones":0,"num_object_copies":6417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17112,"num_write_kb":136896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"110'17752","reported_seq":17766,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.594472+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:34:56.594472+0000","last_peered":"2026-02-24T08:34:56.594472+0000","last_clean":"2026-02-24T08:34:56.594472+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:34:56.594472+0000","last_undegraded":"2026-02-24T08:34:56.594472+0000","last_fullsized":"2026-02-24T08:34:56.594472+0000","mapping_epoch":108,"log_start":"110'7700","ondisk_log_start":"110'7700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145424384,"num_objects":2219,"num_object_clones":0,"num_object_copies":6657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2219,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17752,"num_write_kb":142016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"110'17240","reported_seq":17254,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.999843+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:34:56.999843+0000","last_peered":"2026-02-24T08:34:56.999843+0000","last_clean":"2026-02-24T08:34:56.999843+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:34:56.999843+0000","last_undegraded":"2026-02-24T08:34:56.999843+0000","last_fullsized":"2026-02-24T08:34:56.999843+0000","mapping_epoch":108,"log_start":"110'7200","ondisk_log_start":"110'7200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141230080,"num_objects":2155,"num_object_clones":0,"num_object_copies":6465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2155,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17240,"num_write_kb":137920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"110'16640","reported_seq":16654,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:57.489643+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:34:57.489643+0000","last_peered":"2026-02-24T08:34:57.489643+0000","last_clean":"2026-02-24T08:34:57.489643+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:34:57.489643+0000","last_undegraded":"2026-02-24T08:34:57.489643+0000","last_fullsized":"2026-02-24T08:34:57.489643+0000","mapping_epoch":108,"log_start":"110'6600","ondisk_log_start":"110'6600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136314880,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16640,"num_write_kb":133120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"110'16832","reported_seq":16846,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.480461+0000","last_change":"2026-02-24T08:33:53.120976+0000","last_active":"2026-02-24T08:34:56.480461+0000","last_peered":"2026-02-24T08:34:56.480461+0000","last_clean":"2026-02-24T08:34:56.480461+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:34:56.480461+0000","last_undegraded":"2026-02-24T08:34:56.480461+0000","last_fullsized":"2026-02-24T08:34:56.480461+0000","mapping_epoch":108,"log_start":"110'6800","ondisk_log_start":"110'6800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:02.945733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137887744,"num_objects":2104,"num_object_clones":0,"num_object_copies":6312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16832,"num_write_kb":134656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"110'17296","reported_seq":17298,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:57.509654+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:34:57.509654+0000","last_peered":"2026-02-24T08:34:57.509654+0000","last_clean":"2026-02-24T08:34:57.509654+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:34:57.509654+0000","last_undegraded":"2026-02-24T08:34:57.509654+0000","last_fullsized":"2026-02-24T08:34:57.509654+0000","mapping_epoch":108,"log_start":"110'7200","ondisk_log_start":"110'7200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141688832,"num_objects":2162,"num_object_clones":0,"num_object_copies":6486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2162,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17296,"num_write_kb":138368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"110'17768","reported_seq":17782,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:56.954626+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:34:56.954626+0000","last_peered":"2026-02-24T08:34:56.954626+0000","last_clean":"2026-02-24T08:34:56.954626+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:34:56.954626+0000","last_undegraded":"2026-02-24T08:34:56.954626+0000","last_fullsized":"2026-02-24T08:34:56.954626+0000","mapping_epoch":108,"log_start":"110'7700","ondisk_log_start":"110'7700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145555456,"num_objects":2221,"num_object_clones":0,"num_object_copies":6663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2221,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17768,"num_write_kb":142144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"110'17348","reported_seq":17359,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:57.480058+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:34:57.480058+0000","last_peered":"2026-02-24T08:34:57.480058+0000","last_clean":"2026-02-24T08:34:57.480058+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:34:57.480058+0000","last_undegraded":"2026-02-24T08:34:57.480058+0000","last_fullsized":"2026-02-24T08:34:57.480058+0000","mapping_epoch":108,"log_start":"110'7300","ondisk_log_start":"110'7300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142114816,"num_objects":2169,"num_object_clones":0,"num_object_copies":6507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2169,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17348,"num_write_kb":138784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"110'17496","reported_seq":17510,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:57.470776+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:34:57.470776+0000","last_peered":"2026-02-24T08:34:57.470776+0000","last_clean":"2026-02-24T08:34:57.470776+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:34:57.470776+0000","last_undegraded":"2026-02-24T08:34:57.470776+0000","last_fullsized":"2026-02-24T08:34:57.470776+0000","mapping_epoch":108,"log_start":"110'7400","ondisk_log_start":"110'7400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:01.943572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143327232,"num_objects":2187,"num_object_clones":0,"num_object_copies":6561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2187,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17496,"num_write_kb":139968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":306,"reported_epoch":110,"state":"active+clean","last_fresh":"2026-02-24T08:34:13.944709+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:34:13.944709+0000","last_peered":"2026-02-24T08:34:13.944709+0000","last_clean":"2026-02-24T08:34:13.944709+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:34:13.944709+0000","last_undegraded":"2026-02-24T08:34:13.944709+0000","last_fullsized":"2026-02-24T08:34:13.944709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2262269952,"num_objects":34520,"num_object_clones":0,"num_object_copies":103560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276156,"num_write_kb":2209248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6783737856,"data_stored":6783737856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160856,"ondisk_log_size":160856,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4480,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247985,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3075608,"kb_used_data":1771844,"kb_used_omap":12,"kb_used_meta":1303731,"kb_avail":730927592,"statfs":{"total":751619276800,"available":748469854208,"internally_reserved":0,"allocated":1814368256,"data_stored":1813630388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12733,"internal_metadata":1335021123},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444211,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2817880,"kb_used_data":1500996,"kb_used_omap":10,"kb_used_meta":1316853,"kb_avail":731185320,"statfs":{"total":751619276800,"available":748733767680,"internally_reserved":0,"allocated":1537019904,"data_stored":1536282036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1348458041},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3129836,"kb_used_data":1927704,"kb_used_omap":11,"kb_used_meta":1202100,"kb_avail":730873364,"statfs":{"total":751619276800,"available":748414324736,"internally_reserved":0,"allocated":1973968896,"data_stored":1973234580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11996,"internal_metadata":1230950692},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705847,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2776272,"kb_used_data":1387900,"kb_used_omap":12,"kb_used_meta":1388339,"kb_avail":731226928,"statfs":{"total":751619276800,"available":748776374272,"internally_reserved":0,"allocated":1421209600,"data_stored":1420471732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12662,"internal_metadata":1421659786},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,6,5,7,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4480,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1421459456,"data_stored":1421459456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1986994176,"data_stored":1986994176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1551269888,"data_stored":1551269888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1824014336,"data_stored":1824014336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:35:01.616 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:35:01.617 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 311 2026-02-24T08:35:01.805 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:01.929 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:01.927+0000 7fd0ffe63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:01.930 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:01.927+0000 7fd0ffe63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:02.040 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:35:02.063 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:01 trial105 ceph-mon[39442]: pgmap v524: 17 pgs: 17 active+clean; 2.1 GiB data, 11 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.21k op/s 2026-02-24T08:35:02.087 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:35:02.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:35:02.198 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:02.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 68 128 293301 293173 33.679 25.1562 0.0203465 0.0296783 2026-02-24T08:35:02.317 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:02.315+0000 7fda8326a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:02.317 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:02.315+0000 7fda8326a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:02.333 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:02.333 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:02.347 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:02.347 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:02.361 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:02.361 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:02.375 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:02.376 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:03.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:02 trial105 ceph-mon[39442]: from='client.15763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:35:03.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1860700712' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "311"} : dispatch 2026-02-24T08:35:03.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:02 trial105 ceph-mon[39442]: osdmap e112: 4 total, 4 up, 4 in 2026-02-24T08:35:03.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:02 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3570635659' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:03.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 69 128 296562 296434 33.5601 25.4766 0.0312437 0.0297807 2026-02-24T08:35:04.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:03 trial105 ceph-mon[39442]: pgmap v526: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.08k op/s 2026-02-24T08:35:04.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 70 128 299943 299815 33.458 26.4141 0.0738289 0.0298741 2026-02-24T08:35:04.420 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:35:04.568 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:04.703 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:04.700+0000 7f33ef29f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:04.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:04.701+0000 7f33ef29f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:04.718 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:04.719 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:04.732 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:04.732 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:04.747 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:04.747 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:04.760 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:04.761 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:05.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:04 trial105 ceph-mon[39442]: 9.a scrub starts 2026-02-24T08:35:05.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:04 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/495975735' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:05.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 71 128 303266 303138 33.3523 25.9609 0.0478518 0.0299718 2026-02-24T08:35:06.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:05 trial105 ceph-mon[39442]: pgmap v527: 17 pgs: 17 active+clean; 2.2 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 25 MiB/s wr, 3.18k op/s 2026-02-24T08:35:06.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:05 trial105 ceph-mon[39442]: 9.a scrub ok 2026-02-24T08:35:06.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 72 128 306502 306374 33.2402 25.2812 0.0225216 0.030072 2026-02-24T08:35:06.809 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:35:06.957 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:07.091 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:06 trial105 ceph-mon[39442]: 9.c scrub starts 2026-02-24T08:35:07.092 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:06 trial105 ceph-mon[39442]: 9.3 scrub starts 2026-02-24T08:35:07.092 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:07.087+0000 7fe3f77de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:07.092 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:07.087+0000 7fe3f77de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:07.106 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:07.106 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:07.120 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:07.120 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:07.134 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:35:07.135 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:35:07.135 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:35:07.138 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:07.139 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:07.151 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:07.152 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:07.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 73 128 309669 309541 33.1238 24.7422 0.0181867 0.0301751 2026-02-24T08:35:07.284 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:07.405 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:07.402+0000 7fc49329a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:07.405 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:07.403+0000 7fc49329a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:07.554 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:35:07.555 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:35:07.604 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2026-02-24T08:35:06.812956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2456076832,"num_objects":37472,"num_object_clones":0,"num_object_copies":112416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37472,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":299877,"num_write_kb":2400086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160841,"ondisk_log_size":160841,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12493252,"kb_used_data":7173812,"kb_used_omap":49,"kb_used_meta":5319310,"kb_avail":2923519548,"statfs":{"total":3006477107200,"available":2993684017152,"internally_reserved":0,"allocated":7345983488,"data_stored":7342988446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50696,"internal_metadata":5446973944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,1,1,8,23,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":193216512,"num_objects":2950,"num_object_clones":0,"num_object_copies":8850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2950,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23586,"num_write_kb":188688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001154"},"pg_stats":[{"pgid":"9.f","version":"112'19296","reported_seq":19314,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:06.623396+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:35:06.623396+0000","last_peered":"2026-02-24T08:35:06.623396+0000","last_clean":"2026-02-24T08:35:06.623396+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:35:06.623396+0000","last_undegraded":"2026-02-24T08:35:06.623396+0000","last_fullsized":"2026-02-24T08:35:06.623396+0000","mapping_epoch":108,"log_start":"110'9200","ondisk_log_start":"110'9200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.454999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158072832,"num_objects":2412,"num_object_clones":0,"num_object_copies":7236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19296,"num_write_kb":154368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"112'18392","reported_seq":18410,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:06.531354+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:35:06.531354+0000","last_peered":"2026-02-24T08:35:06.531354+0000","last_clean":"2026-02-24T08:35:06.531354+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:35:06.531354+0000","last_undegraded":"2026-02-24T08:35:06.531354+0000","last_fullsized":"2026-02-24T08:35:06.531354+0000","mapping_epoch":108,"log_start":"110'8300","ondisk_log_start":"110'8300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150667264,"num_objects":2299,"num_object_clones":0,"num_object_copies":6897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18392,"num_write_kb":147136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"112'18866","reported_seq":18911,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:06.551041+0000","last_change":"2026-02-24T08:34:58.389945+0000","last_active":"2026-02-24T08:35:06.551041+0000","last_peered":"2026-02-24T08:35:06.551041+0000","last_clean":"2026-02-24T08:35:06.551041+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:35:06.551041+0000","last_undegraded":"2026-02-24T08:35:06.551041+0000","last_fullsized":"2026-02-24T08:35:06.551041+0000","mapping_epoch":108,"log_start":"110'8800","ondisk_log_start":"110'8800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'17192","last_scrub_stamp":"2026-02-24T08:34:58.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:34:58.389861+0000","objects_scrubbed":2148,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:58.644401+0000","scrub_duration":257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154550272,"num_objects":2359,"num_object_clones":0,"num_object_copies":7077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2359,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18866,"num_write_kb":150928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"112'18455","reported_seq":18472,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:02.529013+0000","last_change":"2026-02-24T08:33:53.120634+0000","last_active":"2026-02-24T08:35:02.529013+0000","last_peered":"2026-02-24T08:35:02.529013+0000","last_clean":"2026-02-24T08:35:02.529013+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:35:02.529013+0000","last_undegraded":"2026-02-24T08:35:02.529013+0000","last_fullsized":"2026-02-24T08:35:02.529013+0000","mapping_epoch":108,"log_start":"110'8400","ondisk_log_start":"110'8400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151183360,"num_objects":2307,"num_object_clones":0,"num_object_copies":6921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18455,"num_write_kb":147640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"111'18280","reported_seq":18296,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-24T08:35:01.998472+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:35:01.998472+0000","last_peered":"2026-02-24T08:35:01.998472+0000","last_clean":"2026-02-24T08:35:01.998472+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:35:01.998472+0000","last_undegraded":"2026-02-24T08:35:01.998472+0000","last_fullsized":"2026-02-24T08:35:01.998472+0000","mapping_epoch":108,"log_start":"110'8200","ondisk_log_start":"110'8200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149749760,"num_objects":2285,"num_object_clones":0,"num_object_copies":6855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18280,"num_write_kb":146240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"112'19664","reported_seq":19714,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:06.607864+0000","last_change":"2026-02-24T08:35:05.676793+0000","last_active":"2026-02-24T08:35:06.607864+0000","last_peered":"2026-02-24T08:35:06.607864+0000","last_clean":"2026-02-24T08:35:06.607864+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:35:06.607864+0000","last_undegraded":"2026-02-24T08:35:06.607864+0000","last_fullsized":"2026-02-24T08:35:06.607864+0000","mapping_epoch":108,"log_start":"110'9600","ondisk_log_start":"110'9600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19544","last_scrub_stamp":"2026-02-24T08:35:05.676747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:05.676747+0000","objects_scrubbed":2422,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:12.644183+0000","scrub_duration":1021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161087488,"num_objects":2458,"num_object_clones":0,"num_object_copies":7374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2458,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19664,"num_write_kb":157312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"111'18704","reported_seq":18720,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-24T08:35:02.039554+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:35:02.039554+0000","last_peered":"2026-02-24T08:35:02.039554+0000","last_clean":"2026-02-24T08:35:02.039554+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:35:02.039554+0000","last_undegraded":"2026-02-24T08:35:02.039554+0000","last_fullsized":"2026-02-24T08:35:02.039554+0000","mapping_epoch":108,"log_start":"110'8700","ondisk_log_start":"110'8700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153223168,"num_objects":2338,"num_object_clones":0,"num_object_copies":7014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2338,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18704,"num_write_kb":149632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"112'19424","reported_seq":19442,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:06.600092+0000","last_change":"2026-02-24T08:33:53.121904+0000","last_active":"2026-02-24T08:35:06.600092+0000","last_peered":"2026-02-24T08:35:06.600092+0000","last_clean":"2026-02-24T08:35:06.600092+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:35:06.600092+0000","last_undegraded":"2026-02-24T08:35:06.600092+0000","last_fullsized":"2026-02-24T08:35:06.600092+0000","mapping_epoch":108,"log_start":"110'9400","ondisk_log_start":"110'9400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159121408,"num_objects":2428,"num_object_clones":0,"num_object_copies":7284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19424,"num_write_kb":155392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"112'19910","reported_seq":19926,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:06.634783+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:35:06.634783+0000","last_peered":"2026-02-24T08:35:06.634783+0000","last_clean":"2026-02-24T08:35:06.634783+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:35:06.634783+0000","last_undegraded":"2026-02-24T08:35:06.634783+0000","last_fullsized":"2026-02-24T08:35:06.634783+0000","mapping_epoch":108,"log_start":"110'9900","ondisk_log_start":"110'9900","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163102720,"num_objects":2489,"num_object_clones":0,"num_object_copies":7467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2489,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19910,"num_write_kb":159280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"111'18304","reported_seq":18320,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-24T08:35:02.032397+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:35:02.032397+0000","last_peered":"2026-02-24T08:35:02.032397+0000","last_clean":"2026-02-24T08:35:02.032397+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:35:02.032397+0000","last_undegraded":"2026-02-24T08:35:02.032397+0000","last_fullsized":"2026-02-24T08:35:02.032397+0000","mapping_epoch":108,"log_start":"110'8300","ondisk_log_start":"110'8300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:11.486113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149946368,"num_objects":2288,"num_object_clones":0,"num_object_copies":6864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18304,"num_write_kb":146432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"112'17648","reported_seq":17666,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:02.510399+0000","last_change":"2026-02-24T08:33:53.120266+0000","last_active":"2026-02-24T08:35:02.510399+0000","last_peered":"2026-02-24T08:35:02.510399+0000","last_clean":"2026-02-24T08:35:02.510399+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:35:02.510399+0000","last_undegraded":"2026-02-24T08:35:02.510399+0000","last_fullsized":"2026-02-24T08:35:02.510399+0000","mapping_epoch":108,"log_start":"110'7600","ondisk_log_start":"110'7600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:10.702320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144572416,"num_objects":2206,"num_object_clones":0,"num_object_copies":6618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2206,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17648,"num_write_kb":141184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"112'18956","reported_seq":18992,"reported_epoch":112,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:35:06.546693+0000","last_change":"2026-02-24T08:35:06.058365+0000","last_active":"2026-02-24T08:35:06.546693+0000","last_peered":"2026-02-24T08:35:06.546693+0000","last_clean":"2026-02-24T08:35:06.546693+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:35:06.546693+0000","last_undegraded":"2026-02-24T08:35:06.546693+0000","last_fullsized":"2026-02-24T08:35:06.546693+0000","mapping_epoch":108,"log_start":"110'8900","ondisk_log_start":"110'8900","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":1799,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155287552,"num_objects":2370,"num_object_clones":0,"num_object_copies":7110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2370,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18956,"num_write_kb":151648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"112'18312","reported_seq":18330,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:02.486291+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:35:02.486291+0000","last_peered":"2026-02-24T08:35:02.486291+0000","last_clean":"2026-02-24T08:35:02.486291+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:35:02.486291+0000","last_undegraded":"2026-02-24T08:35:02.486291+0000","last_fullsized":"2026-02-24T08:35:02.486291+0000","mapping_epoch":108,"log_start":"110'8300","ondisk_log_start":"110'8300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150011904,"num_objects":2289,"num_object_clones":0,"num_object_copies":6867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18312,"num_write_kb":146496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"111'18728","reported_seq":18744,"reported_epoch":111,"state":"active+clean","last_fresh":"2026-02-24T08:35:02.025296+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:35:02.025296+0000","last_peered":"2026-02-24T08:35:02.025296+0000","last_clean":"2026-02-24T08:35:02.025296+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:35:02.025296+0000","last_undegraded":"2026-02-24T08:35:02.025296+0000","last_fullsized":"2026-02-24T08:35:02.025296+0000","mapping_epoch":108,"log_start":"110'8700","ondisk_log_start":"110'8700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153419776,"num_objects":2341,"num_object_clones":0,"num_object_copies":7023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18728,"num_write_kb":149824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"112'18299","reported_seq":18315,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:02.470342+0000","last_change":"2026-02-24T08:33:53.120484+0000","last_active":"2026-02-24T08:35:02.470342+0000","last_peered":"2026-02-24T08:35:02.470342+0000","last_clean":"2026-02-24T08:35:02.470342+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:35:02.470342+0000","last_undegraded":"2026-02-24T08:35:02.470342+0000","last_fullsized":"2026-02-24T08:35:02.470342+0000","mapping_epoch":108,"log_start":"110'8200","ondisk_log_start":"110'8200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:06.844188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149905408,"num_objects":2288,"num_object_clones":0,"num_object_copies":6864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2288,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18299,"num_write_kb":146392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"112'18504","reported_seq":18522,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:02.518053+0000","last_change":"2026-02-24T08:33:53.120473+0000","last_active":"2026-02-24T08:35:02.518053+0000","last_peered":"2026-02-24T08:35:02.518053+0000","last_clean":"2026-02-24T08:35:02.518053+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:35:02.518053+0000","last_undegraded":"2026-02-24T08:35:02.518053+0000","last_fullsized":"2026-02-24T08:35:02.518053+0000","mapping_epoch":108,"log_start":"110'8500","ondisk_log_start":"110'8500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151584768,"num_objects":2313,"num_object_clones":0,"num_object_copies":6939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18504,"num_write_kb":148032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":310,"reported_epoch":112,"state":"active+clean","last_fresh":"2026-02-24T08:35:02.120255+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:35:02.120255+0000","last_peered":"2026-02-24T08:35:02.120255+0000","last_clean":"2026-02-24T08:35:02.120255+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:35:02.120255+0000","last_undegraded":"2026-02-24T08:35:02.120255+0000","last_fullsized":"2026-02-24T08:35:02.120255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2455486464,"num_objects":37470,"num_object_clones":0,"num_object_copies":112410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37470,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299742,"num_write_kb":2397936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7387521024,"data_stored":7387521024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160742,"ondisk_log_size":160742,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4510,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247987,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3325200,"kb_used_data":1985340,"kb_used_omap":13,"kb_used_meta":1339826,"kb_avail":730678000,"statfs":{"total":751619276800,"available":748214272000,"internally_reserved":0,"allocated":2032988160,"data_stored":2032234568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14039,"internal_metadata":1371982121},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444213,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3033992,"kb_used_data":1681012,"kb_used_omap":10,"kb_used_meta":1352949,"kb_avail":730969208,"statfs":{"total":751619276800,"available":748512468992,"internally_reserved":0,"allocated":1721356288,"data_stored":1720602696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1385420345},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3261432,"kb_used_data":2041252,"kb_used_omap":12,"kb_used_meta":1220147,"kb_avail":730741768,"statfs":{"total":751619276800,"available":748279570432,"internally_reserved":0,"allocated":2090242048,"data_stored":2089499895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12648,"internal_metadata":1249431192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705848,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2872628,"kb_used_data":1466208,"kb_used_omap":13,"kb_used_meta":1406386,"kb_avail":731130572,"statfs":{"total":751619276800,"available":748677705728,"internally_reserved":0,"allocated":1501396992,"data_stored":1500651287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13314,"internal_metadata":1440140286},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,1,1,8,23,14],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4510,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1503158272,"data_stored":1503158272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2105540608,"data_stored":2105540608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1736728576,"data_stored":1736728576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2042093568,"data_stored":2042093568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:35:07.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:07 trial105 ceph-mon[39442]: 9.3 scrub ok 2026-02-24T08:35:07.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:07 trial105 ceph-mon[39442]: pgmap v528: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.3 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 23 MiB/s wr, 2.95k op/s 2026-02-24T08:35:07.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:07 trial105 ceph-mon[39442]: 9.8 scrub starts 2026-02-24T08:35:07.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:07 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3615074938' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:07.939 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:07 trial105 ceph-mon[39442]: 9.c scrub ok 2026-02-24T08:35:08.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 74 127 312907 312780 33.0181 25.3047 0.0338391 0.0302741 2026-02-24T08:35:09.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:08 trial105 ceph-mon[39442]: from='client.15773 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:35:09.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:08 trial105 ceph-mon[39442]: 9.8 scrub ok 2026-02-24T08:35:09.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:08 trial105 ceph-mon[39442]: osdmap e113: 4 total, 4 up, 4 in 2026-02-24T08:35:09.203 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:35:09.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 75 128 316351 316223 32.9365 26.8984 0.0274128 0.03035 2026-02-24T08:35:09.351 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:09.758 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:35:09 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:35:09] "GET /metrics HTTP/1.1" 200 4214 "" "Prometheus/3.6.0" 2026-02-24T08:35:09.797 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:09.797 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:09.797 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:09.756+0000 7fac653a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:09.797 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:09.756+0000 7fac653a1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:09.797 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:09.798 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:09.805 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:09.805 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:09.820 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:09.820 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:09.840 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:35:09 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:35:09.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:35:10.097 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:09 trial105 ceph-mon[39442]: pgmap v530: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.4 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 32 MiB/s wr, 4.11k op/s 2026-02-24T08:35:10.097 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:09 trial105 ceph-mon[39442]: 9.7 scrub starts 2026-02-24T08:35:10.097 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:09 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2884622736' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:10.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 76 128 318713 318585 32.7459 18.4531 0.0559898 0.0305214 2026-02-24T08:35:11.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:10 trial105 ceph-mon[39442]: 9.7 scrub ok 2026-02-24T08:35:11.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:10 trial105 ceph-mon[39442]: 9.0 scrub starts 2026-02-24T08:35:11.215 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 77 127 321720 321593 32.6258 23.5 0.0489284 0.0306404 2026-02-24T08:35:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:11 trial105 ceph-mon[39442]: pgmap v531: 17 pgs: 2 active+clean+scrubbing, 15 active+clean; 2.4 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 19 MiB/s wr, 2.49k op/s 2026-02-24T08:35:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:11 trial105 ceph-mon[39442]: 9.0 scrub ok 2026-02-24T08:35:12.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:11 trial105 ceph-mon[39442]: 9.4 scrub starts 2026-02-24T08:35:12.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 78 128 324899 324771 32.5258 24.8281 0.0278695 0.0307345 2026-02-24T08:35:12.445 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:35:12.590 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:12.606 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:35:12.607 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:35:12.607 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:35:12.607 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:35:12.715 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:12.713+0000 7f03cf7ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:12.716 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:12.713+0000 7f03cf7ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:12.731 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:12.731 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:12.743 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:12.744 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:12.757 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:12.758 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:12.764 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:12.769 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:12.770 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:12.893 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:12.891+0000 7f568e827640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:12.893 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:12.891+0000 7f568e827640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:13.043 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:35:13.043 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:35:13.094 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":533,"stamp":"2026-02-24T08:35:12.813760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2656182816,"num_objects":40525,"num_object_clones":0,"num_object_copies":121575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40525,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":324304,"num_write_kb":2595502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160868,"ondisk_log_size":160868,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":13177948,"kb_used_data":7732172,"kb_used_omap":52,"kb_used_meta":5445643,"kb_avail":2922834852,"statfs":{"total":3006477107200,"available":2992982888448,"internally_reserved":0,"allocated":7917744128,"data_stored":7914701964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53957,"internal_metadata":5576338747},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2,5,8,8,0,15],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":259579904,"num_objects":3961,"num_object_clones":0,"num_object_copies":11883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3961,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31687,"num_write_kb":253496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001075"},"pg_stats":[{"pgid":"9.f","version":"113'20304","reported_seq":20324,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:11.622164+0000","last_change":"2026-02-24T08:33:53.122242+0000","last_active":"2026-02-24T08:35:11.622164+0000","last_peered":"2026-02-24T08:35:11.622164+0000","last_clean":"2026-02-24T08:35:11.622164+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:35:11.622164+0000","last_undegraded":"2026-02-24T08:35:11.622164+0000","last_fullsized":"2026-02-24T08:35:11.622164+0000","mapping_epoch":108,"log_start":"110'10300","ondisk_log_start":"110'10300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166330368,"num_objects":2538,"num_object_clones":0,"num_object_copies":7614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20304,"num_write_kb":162432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"113'19416","reported_seq":19435,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:11.655106+0000","last_change":"2026-02-24T08:33:53.121786+0000","last_active":"2026-02-24T08:35:11.655106+0000","last_peered":"2026-02-24T08:35:11.655106+0000","last_clean":"2026-02-24T08:35:11.655106+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:35:11.655106+0000","last_undegraded":"2026-02-24T08:35:11.655106+0000","last_fullsized":"2026-02-24T08:35:11.655106+0000","mapping_epoch":108,"log_start":"110'9400","ondisk_log_start":"110'9400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:16.462675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159055872,"num_objects":2427,"num_object_clones":0,"num_object_copies":7281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2427,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19416,"num_write_kb":155328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"113'19944","reported_seq":19993,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:11.529675+0000","last_change":"2026-02-24T08:34:58.389945+0000","last_active":"2026-02-24T08:35:11.529675+0000","last_peered":"2026-02-24T08:35:11.529675+0000","last_clean":"2026-02-24T08:35:11.529675+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:35:11.529675+0000","last_undegraded":"2026-02-24T08:35:11.529675+0000","last_fullsized":"2026-02-24T08:35:11.529675+0000","mapping_epoch":108,"log_start":"110'9900","ondisk_log_start":"110'9900","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'17192","last_scrub_stamp":"2026-02-24T08:34:58.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:34:58.389861+0000","objects_scrubbed":2148,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:58.644401+0000","scrub_duration":257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163381248,"num_objects":2493,"num_object_clones":0,"num_object_copies":7479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19944,"num_write_kb":159552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"114'20435","reported_seq":20489,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T08:35:12.571598+0000","last_change":"2026-02-24T08:35:07.393024+0000","last_active":"2026-02-24T08:35:12.571598+0000","last_peered":"2026-02-24T08:35:12.571598+0000","last_clean":"2026-02-24T08:35:12.571598+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:35:12.571598+0000","last_undegraded":"2026-02-24T08:35:12.571598+0000","last_fullsized":"2026-02-24T08:35:12.571598+0000","mapping_epoch":108,"log_start":"110'10400","ondisk_log_start":"110'10400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19424","last_scrub_stamp":"2026-02-24T08:35:07.392959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.392959+0000","objects_scrubbed":2411,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:36.340808+0000","scrub_duration":1587,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167403520,"num_objects":2555,"num_object_clones":0,"num_object_copies":7665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20435,"num_write_kb":163480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"113'20296","reported_seq":20316,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:12.078114+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:35:12.078114+0000","last_peered":"2026-02-24T08:35:12.078114+0000","last_clean":"2026-02-24T08:35:12.078114+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:35:12.078114+0000","last_undegraded":"2026-02-24T08:35:12.078114+0000","last_fullsized":"2026-02-24T08:35:12.078114+0000","mapping_epoch":108,"log_start":"110'10200","ondisk_log_start":"110'10200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.812625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166264832,"num_objects":2537,"num_object_clones":0,"num_object_copies":7611,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2537,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20296,"num_write_kb":162368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"113'20506","reported_seq":20557,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:11.646543+0000","last_change":"2026-02-24T08:35:05.676793+0000","last_active":"2026-02-24T08:35:11.646543+0000","last_peered":"2026-02-24T08:35:11.646543+0000","last_clean":"2026-02-24T08:35:11.646543+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:35:11.646543+0000","last_undegraded":"2026-02-24T08:35:11.646543+0000","last_fullsized":"2026-02-24T08:35:11.646543+0000","mapping_epoch":108,"log_start":"110'10500","ondisk_log_start":"110'10500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19544","last_scrub_stamp":"2026-02-24T08:35:05.676747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:05.676747+0000","objects_scrubbed":2422,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:12.644183+0000","scrub_duration":1021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167985152,"num_objects":2564,"num_object_clones":0,"num_object_copies":7692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2564,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20506,"num_write_kb":164048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"113'20568","reported_seq":20588,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:12.083422+0000","last_change":"2026-02-24T08:33:53.119785+0000","last_active":"2026-02-24T08:35:12.083422+0000","last_peered":"2026-02-24T08:35:12.083422+0000","last_clean":"2026-02-24T08:35:12.083422+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:35:12.083422+0000","last_undegraded":"2026-02-24T08:35:12.083422+0000","last_fullsized":"2026-02-24T08:35:12.083422+0000","mapping_epoch":108,"log_start":"110'10500","ondisk_log_start":"110'10500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:13.345690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168493056,"num_objects":2571,"num_object_clones":0,"num_object_copies":7713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2571,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20568,"num_write_kb":164544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"113'20392","reported_seq":20445,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:11.655687+0000","last_change":"2026-02-24T08:35:10.336709+0000","last_active":"2026-02-24T08:35:11.655687+0000","last_peered":"2026-02-24T08:35:11.655687+0000","last_clean":"2026-02-24T08:35:11.655687+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:35:11.655687+0000","last_undegraded":"2026-02-24T08:35:11.655687+0000","last_fullsized":"2026-02-24T08:35:11.655687+0000","mapping_epoch":108,"log_start":"110'10300","ondisk_log_start":"110'10300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20120","last_scrub_stamp":"2026-02-24T08:35:10.336675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:10.336675+0000","objects_scrubbed":2508,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:13.094529+0000","scrub_duration":666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167051264,"num_objects":2549,"num_object_clones":0,"num_object_copies":7647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2549,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20392,"num_write_kb":163136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"113'20760","reported_seq":20780,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:11.631914+0000","last_change":"2026-02-24T08:33:53.121902+0000","last_active":"2026-02-24T08:35:11.631914+0000","last_peered":"2026-02-24T08:35:11.631914+0000","last_clean":"2026-02-24T08:35:11.631914+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:35:11.631914+0000","last_undegraded":"2026-02-24T08:35:11.631914+0000","last_fullsized":"2026-02-24T08:35:11.631914+0000","mapping_epoch":108,"log_start":"110'10700","ondisk_log_start":"110'10700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170065920,"num_objects":2595,"num_object_clones":0,"num_object_copies":7785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2595,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20760,"num_write_kb":166080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"113'20252","reported_seq":20269,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:12.057422+0000","last_change":"2026-02-24T08:33:53.120037+0000","last_active":"2026-02-24T08:35:12.057422+0000","last_peered":"2026-02-24T08:35:12.057422+0000","last_clean":"2026-02-24T08:35:12.057422+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:35:12.057422+0000","last_undegraded":"2026-02-24T08:35:12.057422+0000","last_fullsized":"2026-02-24T08:35:12.057422+0000","mapping_epoch":108,"log_start":"110'10200","ondisk_log_start":"110'10200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165904384,"num_objects":2532,"num_object_clones":0,"num_object_copies":7596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20252,"num_write_kb":162016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"114'19704","reported_seq":19759,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T08:35:12.503082+0000","last_change":"2026-02-24T08:35:12.503082+0000","last_active":"2026-02-24T08:35:12.503082+0000","last_peered":"2026-02-24T08:35:12.503082+0000","last_clean":"2026-02-24T08:35:12.503082+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:35:12.503082+0000","last_undegraded":"2026-02-24T08:35:12.503082+0000","last_fullsized":"2026-02-24T08:35:12.503082+0000","mapping_epoch":108,"log_start":"110'9700","ondisk_log_start":"110'9700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'19704","last_scrub_stamp":"2026-02-24T08:35:12.503048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:12.503048+0000","objects_scrubbed":2454,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.988692+0000","scrub_duration":862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161415168,"num_objects":2463,"num_object_clones":0,"num_object_copies":7389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19704,"num_write_kb":157632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"113'19856","reported_seq":19909,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:11.478293+0000","last_change":"2026-02-24T08:35:06.741209+0000","last_active":"2026-02-24T08:35:11.478293+0000","last_peered":"2026-02-24T08:35:11.478293+0000","last_clean":"2026-02-24T08:35:11.478293+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:35:11.478293+0000","last_undegraded":"2026-02-24T08:35:11.478293+0000","last_fullsized":"2026-02-24T08:35:11.478293+0000","mapping_epoch":108,"log_start":"110'9800","ondisk_log_start":"110'9800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'18984","last_scrub_stamp":"2026-02-24T08:35:06.741175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:06.741175+0000","objects_scrubbed":2361,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:35.489531+0000","scrub_duration":683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162660352,"num_objects":2482,"num_object_clones":0,"num_object_copies":7446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2482,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19856,"num_write_kb":158848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"114'20264","reported_seq":20286,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T08:35:12.551456+0000","last_change":"2026-02-24T08:33:53.120740+0000","last_active":"2026-02-24T08:35:12.551456+0000","last_peered":"2026-02-24T08:35:12.551456+0000","last_clean":"2026-02-24T08:35:12.551456+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:35:12.551456+0000","last_undegraded":"2026-02-24T08:35:12.551456+0000","last_fullsized":"2026-02-24T08:35:12.551456+0000","mapping_epoch":108,"log_start":"110'10200","ondisk_log_start":"110'10200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:12.992768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166002688,"num_objects":2533,"num_object_clones":0,"num_object_copies":7599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2533,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20264,"num_write_kb":162112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"113'20776","reported_seq":20796,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:12.041157+0000","last_change":"2026-02-24T08:33:53.120626+0000","last_active":"2026-02-24T08:35:12.041157+0000","last_peered":"2026-02-24T08:35:12.041157+0000","last_clean":"2026-02-24T08:35:12.041157+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:35:12.041157+0000","last_undegraded":"2026-02-24T08:35:12.041157+0000","last_fullsized":"2026-02-24T08:35:12.041157+0000","mapping_epoch":108,"log_start":"110'10700","ondisk_log_start":"110'10700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:15.749765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170196992,"num_objects":2597,"num_object_clones":0,"num_object_copies":7791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2597,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20776,"num_write_kb":166208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"114'20232","reported_seq":20286,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T08:35:12.567994+0000","last_change":"2026-02-24T08:35:11.523813+0000","last_active":"2026-02-24T08:35:12.567994+0000","last_peered":"2026-02-24T08:35:12.567994+0000","last_clean":"2026-02-24T08:35:12.567994+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:35:12.567994+0000","last_undegraded":"2026-02-24T08:35:12.567994+0000","last_fullsized":"2026-02-24T08:35:12.567994+0000","mapping_epoch":108,"log_start":"110'10200","ondisk_log_start":"110'10200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20024","last_scrub_stamp":"2026-02-24T08:35:11.523763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:11.523763+0000","objects_scrubbed":2497,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:37.362898+0000","scrub_duration":841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165740544,"num_objects":2529,"num_object_clones":0,"num_object_copies":7587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2529,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20232,"num_write_kb":161856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"114'20464","reported_seq":20520,"reported_epoch":114,"state":"active+clean","last_fresh":"2026-02-24T08:35:12.546460+0000","last_change":"2026-02-24T08:35:07.912094+0000","last_active":"2026-02-24T08:35:12.546460+0000","last_peered":"2026-02-24T08:35:12.546460+0000","last_clean":"2026-02-24T08:35:12.546460+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:35:12.546460+0000","last_undegraded":"2026-02-24T08:35:12.546460+0000","last_fullsized":"2026-02-24T08:35:12.546460+0000","mapping_epoch":108,"log_start":"110'10400","ondisk_log_start":"110'10400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19608","last_scrub_stamp":"2026-02-24T08:35:07.912046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.912046+0000","objects_scrubbed":2434,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:34.255028+0000","scrub_duration":1089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167641088,"num_objects":2558,"num_object_clones":0,"num_object_copies":7674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2558,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20464,"num_write_kb":163712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":312,"reported_epoch":113,"state":"active+clean","last_fresh":"2026-02-24T08:35:08.121905+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:35:08.121905+0000","last_peered":"2026-02-24T08:35:08.121905+0000","last_clean":"2026-02-24T08:35:08.121905+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:35:08.121905+0000","last_undegraded":"2026-02-24T08:35:08.121905+0000","last_fullsized":"2026-02-24T08:35:08.121905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2655592448,"num_objects":40523,"num_object_clones":0,"num_object_copies":121569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40523,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324169,"num_write_kb":2593352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7963869184,"data_stored":7963869184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160769,"ondisk_log_size":160769,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4522,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247988,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3478396,"kb_used_data":2084392,"kb_used_omap":14,"kb_used_meta":1393969,"kb_avail":730524804,"statfs":{"total":751619276800,"available":748057399296,"internally_reserved":0,"allocated":2134417408,"data_stored":2133655979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14692,"internal_metadata":1427424924},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444214,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3134364,"kb_used_data":1763336,"kb_used_omap":10,"kb_used_meta":1370997,"kb_avail":730868836,"statfs":{"total":751619276800,"available":748409688064,"internally_reserved":0,"allocated":1805656064,"data_stored":1804894635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1403901497},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3515536,"kb_used_data":2259260,"kb_used_omap":13,"kb_used_meta":1256242,"kb_avail":730487664,"statfs":{"total":751619276800,"available":748019367936,"internally_reserved":0,"allocated":2313482240,"data_stored":2312724363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13952,"internal_metadata":1286392192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,2,5,8,8,0,15],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705850,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3049652,"kb_used_data":1625184,"kb_used_omap":14,"kb_used_meta":1424433,"kb_avail":730953548,"statfs":{"total":751619276800,"available":748496433152,"internally_reserved":0,"allocated":1664188416,"data_stored":1663426987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14618,"internal_metadata":1458620134},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4522,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1664475136,"data_stored":1664475136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2333302784,"data_stored":2333302784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1822171136,"data_stored":1822171136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2143920128,"data_stored":2143920128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:35:13.096 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:35:13.097 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 321 2026-02-24T08:35:13.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 79 128 327680 327552 32.3891 21.7266 0.0305201 0.0308606 2026-02-24T08:35:13.247 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:13.303 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:13 trial105 ceph-mon[39442]: osdmap e114: 4 total, 4 up, 4 in 2026-02-24T08:35:13.303 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:13 trial105 ceph-mon[39442]: 9.4 scrub ok 2026-02-24T08:35:13.304 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:13 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:35:13.304 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:13 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:35:13.304 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:13 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/185728005' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:13.304 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:13 trial105 ceph-mon[39442]: pgmap v533: 17 pgs: 17 active+clean; 2.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 31 MiB/s wr, 3.96k op/s 2026-02-24T08:35:13.304 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:13 trial105 ceph-mon[39442]: 9.5 scrub starts 2026-02-24T08:35:13.379 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:13.376+0000 7f2a83d0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:13.379 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:13.377+0000 7f2a83d0c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:13.527 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:35:13.567 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:35:14.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout:2026-02-24T08:35:14.214971+0000 min lat: 0.00075283 max lat: 0.302561 avg lat: 0.0309562 2026-02-24T08:35:14.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-24T08:35:14.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 80 128 330777 330649 32.2866 24.1953 0.0186491 0.0309562 2026-02-24T08:35:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:14 trial105 ceph-mon[39442]: from='client.15779 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:35:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:14 trial105 ceph-mon[39442]: 9.5 scrub ok 2026-02-24T08:35:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:14 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4102261428' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "321"} : dispatch 2026-02-24T08:35:14.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:14 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:35:14.824 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:35:14.973 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:15.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 81 128 333876 333748 32.1869 24.2109 0.0172363 0.031052 2026-02-24T08:35:15.292 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:15.290+0000 7ff424e11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:15.293 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:15.290+0000 7ff424e11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:15.306 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:15.306 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:15.319 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:15.319 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:15.331 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:15.332 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:15.345 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:15.345 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:15.365 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:15 trial105 ceph-mon[39442]: 9.6 scrub starts 2026-02-24T08:35:15.365 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:15 trial105 ceph-mon[39442]: pgmap v534: 17 pgs: 17 active+clean; 2.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.05k op/s 2026-02-24T08:35:16.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 82 127 337133 337006 32.1048 25.4531 0.0275097 0.0311381 2026-02-24T08:35:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:16 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1067798657' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:16 trial105 ceph-mon[39442]: 9.6 scrub ok 2026-02-24T08:35:16.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:16 trial105 ceph-mon[39442]: 9.2 scrub starts 2026-02-24T08:35:17.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 83 127 340388 340261 32.0243 25.4297 0.0683943 0.0312115 2026-02-24T08:35:17.393 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:35:17.418 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:17 trial105 ceph-mon[39442]: 9.2 scrub ok 2026-02-24T08:35:17.418 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:17 trial105 ceph-mon[39442]: pgmap v535: 17 pgs: 17 active+clean; 2.5 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 20 MiB/s wr, 2.53k op/s 2026-02-24T08:35:17.539 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:17.665 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:17.662+0000 7f00375ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:17.665 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:17.662+0000 7f00375ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:17.680 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:17.680 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:17.695 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:17.695 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:17.709 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:17.709 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:17.723 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:17.724 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:18.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 84 128 343595 343467 31.9412 25.0469 0.0275346 0.0312973 2026-02-24T08:35:18.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:18 trial105 ceph-mon[39442]: osdmap e115: 4 total, 4 up, 4 in 2026-02-24T08:35:18.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:18 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2715058593' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:18.568 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:35:18.568 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:35:18.568 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2026-02-24T08:35:18.569 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 'trim stale osdmaps' 2026-02-24T08:35:18.716 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:18.845 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:18.841+0000 7f916e466640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:18.845 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:18.841+0000 7f916e466640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:18.865 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:35:18.865 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:35:18.865 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:35:18.865 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:35:18.865 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:35:18.865 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:35:18.865 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:35:18.866 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:35:18.866 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:35:18.866 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:35:18.866 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:35:18.866 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:35:18.904 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:35:18.904 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:35:18.905 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 'trim stale osdmaps' 2026-02-24T08:35:19.053 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:19.184 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:19.181+0000 7effc1dc9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:19.185 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:19.183+0000 7effc1dc9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:19.212 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:35:19.212 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:35:19.212 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:35:19.212 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:35:19.212 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:35:19.213 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:35:19.213 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:35:19.213 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:35:19.213 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:35:19.213 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:35:19.213 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:35:19.213 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:35:19.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 85 128 346735 346607 31.854 24.5312 0.0409267 0.0313821 2026-02-24T08:35:19.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:35:19.258 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:35:19.259 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 'trim stale osdmaps' 2026-02-24T08:35:19.414 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:19 trial105 ceph-mon[39442]: 9.f scrub starts 2026-02-24T08:35:19.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:19 trial105 ceph-mon[39442]: pgmap v537: 17 pgs: 17 active+clean; 2.6 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.82k op/s 2026-02-24T08:35:19.540 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:19.537+0000 7f6f24903640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:19.540 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:19.538+0000 7f6f24903640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:19.564 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:35:19.564 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:35:19.564 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:35:19.564 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:35:19.564 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:35:19.564 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:35:19.564 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:35:19.565 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:35:19.565 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:35:19.565 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:35:19.565 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:35:19.565 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:35:19.607 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:35:19.607 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:35:19.608 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 'trim stale osdmaps' 2026-02-24T08:35:19.748 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:35:19 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:35:19] "GET /metrics HTTP/1.1" 200 4217 "" "Prometheus/3.6.0" 2026-02-24T08:35:19.761 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:19.774 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:35:19.908 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:19.905+0000 7fb1266f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:19.908 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:19.905+0000 7fb1266f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:19.931 INFO:teuthology.orchestra.run.trial105.stderr:no valid command found; 10 closest matches: 2026-02-24T08:35:19.931 INFO:teuthology.orchestra.run.trial105.stderr:0 2026-02-24T08:35:19.931 INFO:teuthology.orchestra.run.trial105.stderr:1 2026-02-24T08:35:19.931 INFO:teuthology.orchestra.run.trial105.stderr:2 2026-02-24T08:35:19.931 INFO:teuthology.orchestra.run.trial105.stderr:abort 2026-02-24T08:35:19.931 INFO:teuthology.orchestra.run.trial105.stderr:assert 2026-02-24T08:35:19.931 INFO:teuthology.orchestra.run.trial105.stderr:bench [] [] [] [] 2026-02-24T08:35:19.932 INFO:teuthology.orchestra.run.trial105.stderr:bluefs debug_inject_read_zeros 2026-02-24T08:35:19.932 INFO:teuthology.orchestra.run.trial105.stderr:bluefs files list 2026-02-24T08:35:19.932 INFO:teuthology.orchestra.run.trial105.stderr:bluefs stats 2026-02-24T08:35:19.932 INFO:teuthology.orchestra.run.trial105.stderr:bluestore allocator dump block 2026-02-24T08:35:19.932 INFO:teuthology.orchestra.run.trial105.stderr:Error EINVAL: invalid command 2026-02-24T08:35:19.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:35:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:35:19.550Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:35:19.953 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:19.975 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T08:35:19.975 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2026-02-24T08:35:20.080 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:20.077+0000 7f99ceba9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:20.080 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:20.078+0000 7f99ceba9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:20.096 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:20.096 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:20.111 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:20.111 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:20.124 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:20.124 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:20.138 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:20.139 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:20.216 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 86 128 349857 349729 31.7672 24.3906 0.0241844 0.0314628 2026-02-24T08:35:20.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:20 trial105 ceph-mon[39442]: 9.9 scrub starts 2026-02-24T08:35:20.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:20 trial105 ceph-mon[39442]: 9.9 scrub ok 2026-02-24T08:35:20.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:20 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3565911755' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:21.217 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 87 128 352769 352641 31.6636 22.75 0.0312931 0.0315715 2026-02-24T08:35:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:21 trial105 ceph-mon[39442]: 9.f scrub ok 2026-02-24T08:35:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:21 trial105 ceph-mon[39442]: 9.1 scrub starts 2026-02-24T08:35:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:21 trial105 ceph-mon[39442]: 9.e scrub starts 2026-02-24T08:35:21.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:21 trial105 ceph-mon[39442]: pgmap v538: 17 pgs: 17 active+clean; 2.6 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 18 MiB/s wr, 2.34k op/s 2026-02-24T08:35:22.182 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:35:22.217 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 88 128 355922 355794 31.5837 24.6328 0.0506675 0.0316473 2026-02-24T08:35:22.337 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:22.389 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:22 trial105 ceph-mon[39442]: 9.e scrub ok 2026-02-24T08:35:22.390 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:22 trial105 ceph-mon[39442]: osdmap e116: 4 total, 4 up, 4 in 2026-02-24T08:35:22.465 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:22.462+0000 7f1983b66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:22.466 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:22.462+0000 7f1983b66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:22.482 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:22.483 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:22.498 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:22.498 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:22.511 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:22.511 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:22.526 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:22.526 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:23.217 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 89 127 359147 359020 31.512 25.2031 0.0691566 0.0317242 2026-02-24T08:35:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:23 trial105 ceph-mon[39442]: 9.1 scrub ok 2026-02-24T08:35:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:23 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3900183916' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:23.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:23 trial105 ceph-mon[39442]: pgmap v540: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 30 MiB/s wr, 3.90k op/s 2026-02-24T08:35:24.217 INFO:tasks.radosbench.radosbench.0.trial105.stdout: 90 100 362386 362286 31.4453 25.5156 0.0166933 0.031785 2026-02-24T08:35:24.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:24 trial105 ceph-mon[39442]: 9.b scrub starts 2026-02-24T08:35:24.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:24 trial105 ceph-mon[39442]: 9.b scrub ok 2026-02-24T08:35:24.569 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:35:24.685 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:24.784 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:24.781+0000 7fbcae582640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:24.784 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:24.781+0000 7fbcae582640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:24.796 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:24.796 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:24.807 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:24.807 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:24.819 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:24.819 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:24.830 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:24.830 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:24.976 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:35:24.977 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:35:24.977 INFO:tasks.thrashosds.thrasher:Growing pool unique_pool_7 2026-02-24T08:35:24.977 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:35:25.092 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:25.190 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:25.187+0000 7f513d28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:25.190 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:25.187+0000 7f513d28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:25.217 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total time run: 90.0939 2026-02-24T08:35:25.217 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Total writes made: 362386 2026-02-24T08:35:25.217 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Write size: 8192 2026-02-24T08:35:25.217 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Object size: 65536 2026-02-24T08:35:25.217 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Bandwidth (MB/sec): 31.4243 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Bandwidth: 13.5024 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max bandwidth (MB/sec): 80.0312 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min bandwidth (MB/sec): 18.4531 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average IOPS: 4022 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev IOPS: 1728.3 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max IOPS: 10244 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min IOPS: 2362 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Average Latency(s): 0.0317998 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Stddev Latency(s): 0.0243197 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Max latency(s): 0.302561 2026-02-24T08:35:25.218 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Min latency(s): 0.00075283 2026-02-24T08:35:25.224 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Cleaning up (deleting benchmark objects) 2026-02-24T08:35:25.335 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:35:25.336 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:35:25.370 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:25 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/995772654' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:25.371 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:25 trial105 ceph-mon[39442]: pgmap v541: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.7 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 24 MiB/s wr, 3.04k op/s 2026-02-24T08:35:25.386 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2026-02-24T08:35:25.140196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2911502880,"num_objects":44421,"num_object_clones":0,"num_object_copies":133263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44421,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":355471,"num_write_kb":2844838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160935,"ondisk_log_size":160935,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":14120316,"kb_used_data":8493932,"kb_used_omap":56,"kb_used_meta":5626247,"kb_avail":2921892484,"statfs":{"total":3006477107200,"available":2992017903616,"internally_reserved":0,"allocated":8697786368,"data_stored":8694681308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57856,"internal_metadata":5761277440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,1,0,4,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":167591936,"num_objects":2557,"num_object_clones":0,"num_object_copies":7671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20458,"num_write_kb":163664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.012097"},"pg_stats":[{"pgid":"9.f","version":"115'22097","reported_seq":22154,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:21.684450+0000","last_change":"2026-02-24T08:35:19.847408+0000","last_active":"2026-02-24T08:35:21.684450+0000","last_peered":"2026-02-24T08:35:21.684450+0000","last_clean":"2026-02-24T08:35:21.684450+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:35:21.684450+0000","last_undegraded":"2026-02-24T08:35:21.684450+0000","last_fullsized":"2026-02-24T08:35:21.684450+0000","mapping_epoch":108,"log_start":"110'12000","ondisk_log_start":"110'12000","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'21800","last_scrub_stamp":"2026-02-24T08:35:19.847365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:19.847365+0000","objects_scrubbed":2716,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:21.919813+0000","scrub_duration":1234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181018624,"num_objects":2763,"num_object_clones":0,"num_object_copies":8289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2763,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22097,"num_write_kb":176776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"115'21312","reported_seq":21370,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:21.668999+0000","last_change":"2026-02-24T08:35:21.092424+0000","last_active":"2026-02-24T08:35:21.668999+0000","last_peered":"2026-02-24T08:35:21.668999+0000","last_clean":"2026-02-24T08:35:21.668999+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:35:21.668999+0000","last_undegraded":"2026-02-24T08:35:21.668999+0000","last_fullsized":"2026-02-24T08:35:21.668999+0000","mapping_epoch":108,"log_start":"110'11300","ondisk_log_start":"110'11300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'21216","last_scrub_stamp":"2026-02-24T08:35:21.092374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:21.092374+0000","objects_scrubbed":2650,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.406636+0000","scrub_duration":379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174587904,"num_objects":2664,"num_object_clones":0,"num_object_copies":7992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2664,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21312,"num_write_kb":170496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"115'21848","reported_seq":21901,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:21.420267+0000","last_change":"2026-02-24T08:34:58.389945+0000","last_active":"2026-02-24T08:35:21.420267+0000","last_peered":"2026-02-24T08:35:21.420267+0000","last_clean":"2026-02-24T08:35:21.420267+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:35:21.420267+0000","last_undegraded":"2026-02-24T08:35:21.420267+0000","last_fullsized":"2026-02-24T08:35:21.420267+0000","mapping_epoch":108,"log_start":"110'11800","ondisk_log_start":"110'11800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'17192","last_scrub_stamp":"2026-02-24T08:34:58.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:34:58.389861+0000","objects_scrubbed":2148,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:58.644401+0000","scrub_duration":257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178978816,"num_objects":2731,"num_object_clones":0,"num_object_copies":8193,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2731,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21848,"num_write_kb":174784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"116'22400","reported_seq":22456,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T08:35:22.603803+0000","last_change":"2026-02-24T08:35:07.393024+0000","last_active":"2026-02-24T08:35:22.603803+0000","last_peered":"2026-02-24T08:35:22.603803+0000","last_clean":"2026-02-24T08:35:22.603803+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:35:22.603803+0000","last_undegraded":"2026-02-24T08:35:22.603803+0000","last_fullsized":"2026-02-24T08:35:22.603803+0000","mapping_epoch":108,"log_start":"110'12300","ondisk_log_start":"110'12300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19424","last_scrub_stamp":"2026-02-24T08:35:07.392959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.392959+0000","objects_scrubbed":2411,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:36.340808+0000","scrub_duration":1587,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183500800,"num_objects":2800,"num_object_clones":0,"num_object_copies":8400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2800,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22400,"num_write_kb":179200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"115'22272","reported_seq":22296,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:22.066041+0000","last_change":"2026-02-24T08:33:53.120764+0000","last_active":"2026-02-24T08:35:22.066041+0000","last_peered":"2026-02-24T08:35:22.066041+0000","last_clean":"2026-02-24T08:35:22.066041+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:35:22.066041+0000","last_undegraded":"2026-02-24T08:35:22.066041+0000","last_fullsized":"2026-02-24T08:35:22.066041+0000","mapping_epoch":108,"log_start":"110'12200","ondisk_log_start":"110'12200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182452224,"num_objects":2784,"num_object_clones":0,"num_object_copies":8352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2784,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22272,"num_write_kb":178176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"115'22472","reported_seq":22528,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:21.647716+0000","last_change":"2026-02-24T08:35:05.676793+0000","last_active":"2026-02-24T08:35:21.647716+0000","last_peered":"2026-02-24T08:35:21.647716+0000","last_clean":"2026-02-24T08:35:21.647716+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:35:21.647716+0000","last_undegraded":"2026-02-24T08:35:21.647716+0000","last_fullsized":"2026-02-24T08:35:21.647716+0000","mapping_epoch":108,"log_start":"110'12400","ondisk_log_start":"110'12400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19544","last_scrub_stamp":"2026-02-24T08:35:05.676747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:05.676747+0000","objects_scrubbed":2422,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:12.644183+0000","scrub_duration":1021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184090624,"num_objects":2809,"num_object_clones":0,"num_object_copies":8427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2809,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22472,"num_write_kb":179776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"115'22584","reported_seq":22638,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:22.118805+0000","last_change":"2026-02-24T08:35:19.701731+0000","last_active":"2026-02-24T08:35:22.118805+0000","last_peered":"2026-02-24T08:35:22.118805+0000","last_clean":"2026-02-24T08:35:22.118805+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:35:22.118805+0000","last_undegraded":"2026-02-24T08:35:22.118805+0000","last_fullsized":"2026-02-24T08:35:22.118805+0000","mapping_epoch":108,"log_start":"110'12500","ondisk_log_start":"110'12500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'22032","last_scrub_stamp":"2026-02-24T08:35:19.701673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:19.701673+0000","objects_scrubbed":2749,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:44.465629+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185008128,"num_objects":2823,"num_object_clones":0,"num_object_copies":8469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2823,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22584,"num_write_kb":180672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"115'22416","reported_seq":22473,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:21.664496+0000","last_change":"2026-02-24T08:35:10.336709+0000","last_active":"2026-02-24T08:35:21.664496+0000","last_peered":"2026-02-24T08:35:21.664496+0000","last_clean":"2026-02-24T08:35:21.664496+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:35:21.664496+0000","last_undegraded":"2026-02-24T08:35:21.664496+0000","last_fullsized":"2026-02-24T08:35:21.664496+0000","mapping_epoch":108,"log_start":"110'12400","ondisk_log_start":"110'12400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20120","last_scrub_stamp":"2026-02-24T08:35:10.336675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:10.336675+0000","objects_scrubbed":2508,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:13.094529+0000","scrub_duration":666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183631872,"num_objects":2802,"num_object_clones":0,"num_object_copies":8406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22416,"num_write_kb":179328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"115'22852","reported_seq":22904,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:21.689106+0000","last_change":"2026-02-24T08:35:15.488607+0000","last_active":"2026-02-24T08:35:21.689106+0000","last_peered":"2026-02-24T08:35:21.689106+0000","last_clean":"2026-02-24T08:35:21.689106+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:35:21.689106+0000","last_undegraded":"2026-02-24T08:35:21.689106+0000","last_fullsized":"2026-02-24T08:35:21.689106+0000","mapping_epoch":108,"log_start":"110'12800","ondisk_log_start":"110'12800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'21568","last_scrub_stamp":"2026-02-24T08:35:15.488421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:15.488421+0000","objects_scrubbed":2688,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:40.041525+0000","scrub_duration":1541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187203584,"num_objects":2857,"num_object_clones":0,"num_object_copies":8571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22852,"num_write_kb":182816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"115'22144","reported_seq":22201,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:22.106299+0000","last_change":"2026-02-24T08:35:13.461746+0000","last_active":"2026-02-24T08:35:22.106299+0000","last_peered":"2026-02-24T08:35:22.106299+0000","last_clean":"2026-02-24T08:35:22.106299+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:35:22.106299+0000","last_undegraded":"2026-02-24T08:35:22.106299+0000","last_fullsized":"2026-02-24T08:35:22.106299+0000","mapping_epoch":108,"log_start":"110'12100","ondisk_log_start":"110'12100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'20480","last_scrub_stamp":"2026-02-24T08:35:13.461676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:13.461676+0000","objects_scrubbed":2555,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:14.582913+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181403648,"num_objects":2768,"num_object_clones":0,"num_object_copies":8304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22144,"num_write_kb":177152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"116'21456","reported_seq":21515,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T08:35:22.582764+0000","last_change":"2026-02-24T08:35:12.503082+0000","last_active":"2026-02-24T08:35:22.582764+0000","last_peered":"2026-02-24T08:35:22.582764+0000","last_clean":"2026-02-24T08:35:22.582764+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:35:22.582764+0000","last_undegraded":"2026-02-24T08:35:22.582764+0000","last_fullsized":"2026-02-24T08:35:22.582764+0000","mapping_epoch":108,"log_start":"110'11400","ondisk_log_start":"110'11400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'19704","last_scrub_stamp":"2026-02-24T08:35:12.503048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:12.503048+0000","objects_scrubbed":2454,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.988692+0000","scrub_duration":862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175767552,"num_objects":2682,"num_object_clones":0,"num_object_copies":8046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2682,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21456,"num_write_kb":171648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"115'21830","reported_seq":21884,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:21.612779+0000","last_change":"2026-02-24T08:35:06.741209+0000","last_active":"2026-02-24T08:35:21.612779+0000","last_peered":"2026-02-24T08:35:21.612779+0000","last_clean":"2026-02-24T08:35:21.612779+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:35:21.612779+0000","last_undegraded":"2026-02-24T08:35:21.612779+0000","last_fullsized":"2026-02-24T08:35:21.612779+0000","mapping_epoch":108,"log_start":"110'11800","ondisk_log_start":"110'11800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'18984","last_scrub_stamp":"2026-02-24T08:35:06.741175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:06.741175+0000","objects_scrubbed":2361,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:35.489531+0000","scrub_duration":683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178831360,"num_objects":2729,"num_object_clones":0,"num_object_copies":8187,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2729,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21830,"num_write_kb":174640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"116'21944","reported_seq":22004,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T08:35:22.576627+0000","last_change":"2026-02-24T08:35:16.753717+0000","last_active":"2026-02-24T08:35:22.576627+0000","last_peered":"2026-02-24T08:35:22.576627+0000","last_clean":"2026-02-24T08:35:22.576627+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:35:22.576627+0000","last_undegraded":"2026-02-24T08:35:22.576627+0000","last_fullsized":"2026-02-24T08:35:22.576627+0000","mapping_epoch":108,"log_start":"110'11900","ondisk_log_start":"110'11900","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'20944","last_scrub_stamp":"2026-02-24T08:35:16.753670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:16.753670+0000","objects_scrubbed":2609,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:37.157892+0000","scrub_duration":1144,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179765248,"num_objects":2743,"num_object_clones":0,"num_object_copies":8229,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2743,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21944,"num_write_kb":175552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"115'22909","reported_seq":22950,"reported_epoch":115,"state":"active+clean+scrubbing","last_fresh":"2026-02-24T08:35:22.085686+0000","last_change":"2026-02-24T08:35:20.016871+0000","last_active":"2026-02-24T08:35:22.085686+0000","last_peered":"2026-02-24T08:35:22.085686+0000","last_clean":"2026-02-24T08:35:22.085686+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:35:22.085686+0000","last_undegraded":"2026-02-24T08:35:22.085686+0000","last_fullsized":"2026-02-24T08:35:22.085686+0000","mapping_epoch":108,"log_start":"110'12900","ondisk_log_start":"110'12900","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:33:52.107047+0000","objects_scrubbed":1749,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187670528,"num_objects":2864,"num_object_clones":0,"num_object_copies":8592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2864,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22909,"num_write_kb":183272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"116'22296","reported_seq":22351,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T08:35:22.602905+0000","last_change":"2026-02-24T08:35:11.523813+0000","last_active":"2026-02-24T08:35:22.602905+0000","last_peered":"2026-02-24T08:35:22.602905+0000","last_clean":"2026-02-24T08:35:22.602905+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:35:22.602905+0000","last_undegraded":"2026-02-24T08:35:22.602905+0000","last_fullsized":"2026-02-24T08:35:22.602905+0000","mapping_epoch":108,"log_start":"110'12200","ondisk_log_start":"110'12200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20024","last_scrub_stamp":"2026-02-24T08:35:11.523763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:11.523763+0000","objects_scrubbed":2497,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:37.362898+0000","scrub_duration":841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182648832,"num_objects":2787,"num_object_clones":0,"num_object_copies":8361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2787,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22296,"num_write_kb":178368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"116'22504","reported_seq":22564,"reported_epoch":116,"state":"active+clean","last_fresh":"2026-02-24T08:35:22.562067+0000","last_change":"2026-02-24T08:35:07.912094+0000","last_active":"2026-02-24T08:35:22.562067+0000","last_peered":"2026-02-24T08:35:22.562067+0000","last_clean":"2026-02-24T08:35:22.562067+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:35:22.562067+0000","last_undegraded":"2026-02-24T08:35:22.562067+0000","last_fullsized":"2026-02-24T08:35:22.562067+0000","mapping_epoch":108,"log_start":"110'12500","ondisk_log_start":"110'12500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19608","last_scrub_stamp":"2026-02-24T08:35:07.912046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.912046+0000","objects_scrubbed":2434,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:34.255028+0000","scrub_duration":1089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184352768,"num_objects":2813,"num_object_clones":0,"num_object_copies":8439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2813,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22504,"num_write_kb":180032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":316,"reported_epoch":115,"state":"active+clean","last_fresh":"2026-02-24T08:35:17.129111+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:35:17.129111+0000","last_peered":"2026-02-24T08:35:17.129111+0000","last_clean":"2026-02-24T08:35:17.129111+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:35:17.129111+0000","last_undegraded":"2026-02-24T08:35:17.129111+0000","last_fullsized":"2026-02-24T08:35:17.129111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2910912512,"num_objects":44419,"num_object_clones":0,"num_object_copies":133257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355336,"num_write_kb":2842688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8729952256,"data_stored":8729952256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160836,"ondisk_log_size":160836,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4540,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247990,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3711012,"kb_used_data":2280784,"kb_used_omap":15,"kb_used_meta":1430192,"kb_avail":730292188,"statfs":{"total":751619276800,"available":747819200512,"internally_reserved":0,"allocated":2335522816,"data_stored":2334745663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15983,"internal_metadata":1464517009},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444216,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3393164,"kb_used_data":1949944,"kb_used_omap":10,"kb_used_meta":1443189,"kb_avail":730610036,"statfs":{"total":751619276800,"available":748144676864,"internally_reserved":0,"allocated":1996742656,"data_stored":1995965503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10695,"internal_metadata":1477826105},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,1,0,4,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3788856,"kb_used_data":2478436,"kb_used_omap":14,"kb_used_meta":1310385,"kb_avail":730214344,"statfs":{"total":751619276800,"available":747739488256,"internally_reserved":0,"allocated":2537918464,"data_stored":2537144863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15256,"internal_metadata":1341834344},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705852,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3227284,"kb_used_data":1784768,"kb_used_omap":15,"kb_used_meta":1442480,"kb_avail":730775916,"statfs":{"total":751619276800,"available":748314537984,"internally_reserved":0,"allocated":1827602432,"data_stored":1826825279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15922,"internal_metadata":1477099982},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4540,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1826480128,"data_stored":1826480128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2556551168,"data_stored":2556551168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1996668928,"data_stored":1996668928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2350252032,"data_stored":2350252032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:35:25.388 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:35:25.388 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set unique_pool_7 pg_num 56 2026-02-24T08:35:25.539 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:25.676 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:25.673+0000 7fe0a9bb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:25.680 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:25.677+0000 7fe0a9bb6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:25.842 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:35:25.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:35:26.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:26 trial105 ceph-mon[39442]: osdmap e117: 4 total, 4 up, 4 in 2026-02-24T08:35:26.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:26 trial105 ceph-mon[39442]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:35:26.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:26 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2845469786' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "unique_pool_7", "var": "pg_num", "val": "56"} : dispatch 2026-02-24T08:35:26.866 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:35:27.020 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:27.384 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:27.368+0000 7fcdca4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:27.385 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:27.368+0000 7fcdca4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:27.386 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:27.386 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:27.403 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:27.403 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:27.404 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:27 trial105 ceph-mon[39442]: pgmap v543: 17 pgs: 1 active+clean+scrubbing, 16 active+clean; 2.6 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 127 B/s rd, 19 MiB/s wr, 2.69k op/s 2026-02-24T08:35:27.404 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:27 trial105 ceph-mon[39442]: osdmap e118: 4 total, 4 up, 4 in 2026-02-24T08:35:27.417 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:27.417 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:27.430 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:27.431 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:28.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:28 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2179164957' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:29.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:29 trial105 ceph-mon[39442]: pgmap v545: 17 pgs: 17 active+clean; 2.4 GiB data, 13 GiB used, 2.7 TiB / 2.7 TiB avail; 152 B/s rd, 19 MiB/s wr, 3.26k op/s 2026-02-24T08:35:29.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:29 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:35:29.902 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:35:29.929 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:35:29 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:35:29] "GET /metrics HTTP/1.1" 200 4227 "" "Prometheus/3.6.0" 2026-02-24T08:35:29.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:35:29 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:35:29.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:35:30.059 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:30.193 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:30.188+0000 7efe127ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:30.194 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:30.191+0000 7efe127ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:30.212 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:30.213 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:30.228 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:30.229 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:30.246 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:30.246 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:30.266 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:30.266 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:30.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:30 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3109297294' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:30.889 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:35:30.889 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:35:30.889 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:35:31.041 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:31.175 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:31.172+0000 7fbad4f9f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:31.178 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:31.175+0000 7fbad4f9f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:31.339 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:35:31.340 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:35:31.387 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2026-02-24T08:35:30.816190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2447983160,"num_objects":37348,"num_object_clones":0,"num_object_copies":112044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37348,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":370476,"num_write_kb":2901239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160840,"ondisk_log_size":160840,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":12698784,"kb_used_data":7533776,"kb_used_omap":64,"kb_used_meta":5164863,"kb_avail":2923314016,"statfs":{"total":3006477107200,"available":2993473552384,"internally_reserved":0,"allocated":7714586624,"data_stored":7711390678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":65684,"internal_metadata":5288820588},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,9,8,18,17,21,13,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-463519720,"num_objects":-7073,"num_object_clones":0,"num_object_copies":-21219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7073,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15005,"num_write_kb":56401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001054"},"pg_stats":[{"pgid":"9.f","version":"117'23035","reported_seq":23098,"reported_epoch":117,"state":"active+clean","last_fresh":"2026-02-24T08:35:26.686745+0000","last_change":"2026-02-24T08:35:19.847408+0000","last_active":"2026-02-24T08:35:26.686745+0000","last_peered":"2026-02-24T08:35:26.686745+0000","last_clean":"2026-02-24T08:35:26.686745+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:35:26.686745+0000","last_undegraded":"2026-02-24T08:35:26.686745+0000","last_fullsized":"2026-02-24T08:35:26.686745+0000","mapping_epoch":108,"log_start":"110'13000","ondisk_log_start":"110'13000","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'21800","last_scrub_stamp":"2026-02-24T08:35:19.847365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:19.847365+0000","objects_scrubbed":2716,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:21.919813+0000","scrub_duration":1234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165478400,"num_objects":2525,"num_object_clones":0,"num_object_copies":7575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23035,"num_write_kb":181760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"117'22126","reported_seq":22186,"reported_epoch":117,"state":"active+clean","last_fresh":"2026-02-24T08:35:26.704531+0000","last_change":"2026-02-24T08:35:21.092424+0000","last_active":"2026-02-24T08:35:26.704531+0000","last_peered":"2026-02-24T08:35:26.704531+0000","last_clean":"2026-02-24T08:35:26.704531+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:35:26.704531+0000","last_undegraded":"2026-02-24T08:35:26.704531+0000","last_fullsized":"2026-02-24T08:35:26.704531+0000","mapping_epoch":108,"log_start":"110'12100","ondisk_log_start":"110'12100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'21216","last_scrub_stamp":"2026-02-24T08:35:21.092374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:21.092374+0000","objects_scrubbed":2650,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.406636+0000","scrub_duration":379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160169984,"num_objects":2444,"num_object_clones":0,"num_object_copies":7332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22126,"num_write_kb":174720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"117'22516","reported_seq":22574,"reported_epoch":117,"state":"active+clean","last_fresh":"2026-02-24T08:35:26.628365+0000","last_change":"2026-02-24T08:34:58.389945+0000","last_active":"2026-02-24T08:35:26.628365+0000","last_peered":"2026-02-24T08:35:26.628365+0000","last_clean":"2026-02-24T08:35:26.628365+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:35:26.628365+0000","last_undegraded":"2026-02-24T08:35:26.628365+0000","last_fullsized":"2026-02-24T08:35:26.628365+0000","mapping_epoch":108,"log_start":"110'12500","ondisk_log_start":"110'12500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'17192","last_scrub_stamp":"2026-02-24T08:34:58.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:34:58.389861+0000","objects_scrubbed":2148,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:58.644401+0000","scrub_duration":257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165347352,"num_objects":2524,"num_object_clones":0,"num_object_copies":7572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2524,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":22516,"num_write_kb":178049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"118'23095","reported_seq":23158,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:27.638829+0000","last_change":"2026-02-24T08:35:07.393024+0000","last_active":"2026-02-24T08:35:27.638829+0000","last_peered":"2026-02-24T08:35:27.638829+0000","last_clean":"2026-02-24T08:35:27.638829+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:35:27.638829+0000","last_undegraded":"2026-02-24T08:35:27.638829+0000","last_fullsized":"2026-02-24T08:35:27.638829+0000","mapping_epoch":108,"log_start":"110'13000","ondisk_log_start":"110'13000","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19424","last_scrub_stamp":"2026-02-24T08:35:07.392959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.392959+0000","objects_scrubbed":2411,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:36.340808+0000","scrub_duration":1587,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158007296,"num_objects":2411,"num_object_clones":0,"num_object_copies":7233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2411,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23095,"num_write_kb":181376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"118'23577","reported_seq":23641,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:29.703007+0000","last_change":"2026-02-24T08:35:23.856698+0000","last_active":"2026-02-24T08:35:29.703007+0000","last_peered":"2026-02-24T08:35:29.703007+0000","last_clean":"2026-02-24T08:35:29.703007+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:35:29.703007+0000","last_undegraded":"2026-02-24T08:35:29.703007+0000","last_fullsized":"2026-02-24T08:35:29.703007+0000","mapping_epoch":108,"log_start":"110'13500","ondisk_log_start":"110'13500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22584","last_scrub_stamp":"2026-02-24T08:35:23.856663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:23.856663+0000","objects_scrubbed":2817,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:42.326197+0000","scrub_duration":540,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127008768,"num_objects":1938,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1938,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23577,"num_write_kb":181440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"117'23335","reported_seq":23395,"reported_epoch":117,"state":"active+clean","last_fresh":"2026-02-24T08:35:26.669554+0000","last_change":"2026-02-24T08:35:05.676793+0000","last_active":"2026-02-24T08:35:26.669554+0000","last_peered":"2026-02-24T08:35:26.669554+0000","last_clean":"2026-02-24T08:35:26.669554+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:35:26.669554+0000","last_undegraded":"2026-02-24T08:35:26.669554+0000","last_fullsized":"2026-02-24T08:35:26.669554+0000","mapping_epoch":108,"log_start":"110'13300","ondisk_log_start":"110'13300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19544","last_scrub_stamp":"2026-02-24T08:35:05.676747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:05.676747+0000","objects_scrubbed":2422,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:12.644183+0000","scrub_duration":1021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168230912,"num_objects":2567,"num_object_clones":0,"num_object_copies":7701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2567,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23335,"num_write_kb":184192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"118'23891","reported_seq":23947,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:29.687220+0000","last_change":"2026-02-24T08:35:19.701731+0000","last_active":"2026-02-24T08:35:29.687220+0000","last_peered":"2026-02-24T08:35:29.687220+0000","last_clean":"2026-02-24T08:35:29.687220+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:35:29.687220+0000","last_undegraded":"2026-02-24T08:35:29.687220+0000","last_fullsized":"2026-02-24T08:35:29.687220+0000","mapping_epoch":108,"log_start":"110'13800","ondisk_log_start":"110'13800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'22032","last_scrub_stamp":"2026-02-24T08:35:19.701673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:19.701673+0000","objects_scrubbed":2749,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:44.465629+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125304832,"num_objects":1912,"num_object_clones":0,"num_object_copies":5736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1912,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23891,"num_write_kb":183488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"117'23318","reported_seq":23378,"reported_epoch":117,"state":"active+clean","last_fresh":"2026-02-24T08:35:26.710510+0000","last_change":"2026-02-24T08:35:10.336709+0000","last_active":"2026-02-24T08:35:26.710510+0000","last_peered":"2026-02-24T08:35:26.710510+0000","last_clean":"2026-02-24T08:35:26.710510+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:35:26.710510+0000","last_undegraded":"2026-02-24T08:35:26.710510+0000","last_fullsized":"2026-02-24T08:35:26.710510+0000","mapping_epoch":108,"log_start":"110'13300","ondisk_log_start":"110'13300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20120","last_scrub_stamp":"2026-02-24T08:35:10.336675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:10.336675+0000","objects_scrubbed":2508,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:13.094529+0000","scrub_duration":666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169492480,"num_objects":2587,"num_object_clones":0,"num_object_copies":7761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2587,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23318,"num_write_kb":184208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"117'23702","reported_seq":23753,"reported_epoch":117,"state":"active+clean","last_fresh":"2026-02-24T08:35:26.704553+0000","last_change":"2026-02-24T08:35:15.488607+0000","last_active":"2026-02-24T08:35:26.704553+0000","last_peered":"2026-02-24T08:35:26.704553+0000","last_clean":"2026-02-24T08:35:26.704553+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:35:26.704553+0000","last_undegraded":"2026-02-24T08:35:26.704553+0000","last_fullsized":"2026-02-24T08:35:26.704553+0000","mapping_epoch":108,"log_start":"110'13700","ondisk_log_start":"110'13700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'21568","last_scrub_stamp":"2026-02-24T08:35:15.488421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:15.488421+0000","objects_scrubbed":2688,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:40.041525+0000","scrub_duration":1541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170131456,"num_objects":2596,"num_object_clones":0,"num_object_copies":7788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2596,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23702,"num_write_kb":187008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"118'23551","reported_seq":23606,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:29.702326+0000","last_change":"2026-02-24T08:35:13.461746+0000","last_active":"2026-02-24T08:35:29.702326+0000","last_peered":"2026-02-24T08:35:29.702326+0000","last_clean":"2026-02-24T08:35:29.702326+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:35:29.702326+0000","last_undegraded":"2026-02-24T08:35:29.702326+0000","last_fullsized":"2026-02-24T08:35:29.702326+0000","mapping_epoch":108,"log_start":"110'13500","ondisk_log_start":"110'13500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'20480","last_scrub_stamp":"2026-02-24T08:35:13.461676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:13.461676+0000","objects_scrubbed":2555,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:14.582913+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125173760,"num_objects":1910,"num_object_clones":0,"num_object_copies":5730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1910,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23551,"num_write_kb":181056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"118'22272","reported_seq":22335,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:27.638761+0000","last_change":"2026-02-24T08:35:12.503082+0000","last_active":"2026-02-24T08:35:27.638761+0000","last_peered":"2026-02-24T08:35:27.638761+0000","last_clean":"2026-02-24T08:35:27.638761+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:35:27.638761+0000","last_undegraded":"2026-02-24T08:35:27.638761+0000","last_fullsized":"2026-02-24T08:35:27.638761+0000","mapping_epoch":108,"log_start":"110'12200","ondisk_log_start":"110'12200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'19704","last_scrub_stamp":"2026-02-24T08:35:12.503048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:12.503048+0000","objects_scrubbed":2454,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.988692+0000","scrub_duration":862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148832256,"num_objects":2271,"num_object_clones":0,"num_object_copies":6813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2271,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22272,"num_write_kb":174528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"117'22663","reported_seq":22717,"reported_epoch":117,"state":"active+clean","last_fresh":"2026-02-24T08:35:26.636928+0000","last_change":"2026-02-24T08:35:06.741209+0000","last_active":"2026-02-24T08:35:26.636928+0000","last_peered":"2026-02-24T08:35:26.636928+0000","last_clean":"2026-02-24T08:35:26.636928+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:35:26.636928+0000","last_undegraded":"2026-02-24T08:35:26.636928+0000","last_fullsized":"2026-02-24T08:35:26.636928+0000","mapping_epoch":108,"log_start":"110'12600","ondisk_log_start":"110'12600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'18984","last_scrub_stamp":"2026-02-24T08:35:06.741175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:06.741175+0000","objects_scrubbed":2361,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:35.489531+0000","scrub_duration":683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165675008,"num_objects":2528,"num_object_clones":0,"num_object_copies":7584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2528,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22663,"num_write_kb":179136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"118'22652","reported_seq":22716,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:27.638551+0000","last_change":"2026-02-24T08:35:16.753717+0000","last_active":"2026-02-24T08:35:27.638551+0000","last_peered":"2026-02-24T08:35:27.638551+0000","last_clean":"2026-02-24T08:35:27.638551+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:35:27.638551+0000","last_undegraded":"2026-02-24T08:35:27.638551+0000","last_fullsized":"2026-02-24T08:35:27.638551+0000","mapping_epoch":108,"log_start":"110'12600","ondisk_log_start":"110'12600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'20944","last_scrub_stamp":"2026-02-24T08:35:16.753670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:16.753670+0000","objects_scrubbed":2609,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:37.157892+0000","scrub_duration":1144,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153419776,"num_objects":2341,"num_object_clones":0,"num_object_copies":7023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22652,"num_write_kb":177728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"118'24278","reported_seq":24335,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:29.691571+0000","last_change":"2026-02-24T08:35:22.394425+0000","last_active":"2026-02-24T08:35:29.691571+0000","last_peered":"2026-02-24T08:35:29.691571+0000","last_clean":"2026-02-24T08:35:29.691571+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:35:29.691571+0000","last_undegraded":"2026-02-24T08:35:29.691571+0000","last_fullsized":"2026-02-24T08:35:29.691571+0000","mapping_epoch":108,"log_start":"110'14200","ondisk_log_start":"110'14200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22952","last_scrub_stamp":"2026-02-24T08:35:22.394294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:22.394294+0000","objects_scrubbed":2845,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.376288+0000","scrub_duration":1819,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131792896,"num_objects":2011,"num_object_clones":0,"num_object_copies":6033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24278,"num_write_kb":186944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"118'23115","reported_seq":23178,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:27.669176+0000","last_change":"2026-02-24T08:35:11.523813+0000","last_active":"2026-02-24T08:35:27.669176+0000","last_peered":"2026-02-24T08:35:27.669176+0000","last_clean":"2026-02-24T08:35:27.669176+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:35:27.669176+0000","last_undegraded":"2026-02-24T08:35:27.669176+0000","last_fullsized":"2026-02-24T08:35:27.669176+0000","mapping_epoch":108,"log_start":"110'13100","ondisk_log_start":"110'13100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20024","last_scrub_stamp":"2026-02-24T08:35:11.523763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:11.523763+0000","objects_scrubbed":2497,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:37.362898+0000","scrub_duration":841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157286400,"num_objects":2400,"num_object_clones":0,"num_object_copies":7200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2400,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23115,"num_write_kb":181440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"118'23215","reported_seq":23279,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:27.634086+0000","last_change":"2026-02-24T08:35:07.912094+0000","last_active":"2026-02-24T08:35:27.634086+0000","last_peered":"2026-02-24T08:35:27.634086+0000","last_clean":"2026-02-24T08:35:27.634086+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:35:27.634086+0000","last_undegraded":"2026-02-24T08:35:27.634086+0000","last_fullsized":"2026-02-24T08:35:27.634086+0000","mapping_epoch":108,"log_start":"110'13200","ondisk_log_start":"110'13200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19608","last_scrub_stamp":"2026-02-24T08:35:07.912046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.912046+0000","objects_scrubbed":2434,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:34.255028+0000","scrub_duration":1089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156041216,"num_objects":2381,"num_object_clones":0,"num_object_copies":7143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23215,"num_write_kb":182016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":320,"reported_epoch":117,"state":"active+clean","last_fresh":"2026-02-24T08:35:25.141362+0000","last_change":"2026-02-24T08:34:13.944667+0000","last_active":"2026-02-24T08:35:25.141362+0000","last_peered":"2026-02-24T08:35:25.141362+0000","last_clean":"2026-02-24T08:35:25.141362+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:35:25.141362+0000","last_undegraded":"2026-02-24T08:35:25.141362+0000","last_fullsized":"2026-02-24T08:35:25.141362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:34:13.944622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:34:13.944622+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:34.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":2447392792,"num_objects":37346,"num_object_clones":0,"num_object_copies":112038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37346,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":370341,"num_write_kb":2899089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7443509248,"data_stored":7443497032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160741,"ondisk_log_size":160741,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4556,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247991,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3677560,"kb_used_data":2247332,"kb_used_omap":16,"kb_used_meta":1430191,"kb_avail":730325640,"statfs":{"total":751619276800,"available":747853455360,"internally_reserved":0,"allocated":2301267968,"data_stored":2300471019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17291,"internal_metadata":1464515701},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444217,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3280696,"kb_used_data":1819428,"kb_used_omap":12,"kb_used_meta":1461235,"kb_avail":730722504,"statfs":{"total":751619276800,"available":748259844096,"internally_reserved":0,"allocated":1863094272,"data_stored":1862297323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13303,"internal_metadata":1496304649},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,4,6,13,8,8,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":3474624,"kb_used_data":2128108,"kb_used_omap":16,"kb_used_meta":1346479,"kb_avail":730528576,"statfs":{"total":751619276800,"available":748061261824,"internally_reserved":0,"allocated":2179182592,"data_stored":2178381308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17212,"internal_metadata":1378794692},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2265904,"kb_used_data":1338908,"kb_used_omap":17,"kb_used_meta":926958,"kb_avail":731737296,"statfs":{"total":751619276800,"available":749298991104,"internally_reserved":0,"allocated":1371041792,"data_stored":1370241028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17878,"internal_metadata":949205546},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,5,2,5,9,13,9,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4556,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1279787008,"data_stored":1279787008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2176471040,"data_stored":2176466968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1826770944,"data_stored":1826766872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2160480256,"data_stored":2160476184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:35:31.439 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:31 trial105 ceph-mon[39442]: pgmap v546: 17 pgs: 17 active+clean; 2.3 GiB data, 12 GiB used, 2.7 TiB / 2.7 TiB avail; 127 B/s rd, 6.9 MiB/s wr, 1.88k op/s 2026-02-24T08:35:32.320 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:35:32.472 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:32.591 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:32 trial105 ceph-mon[39442]: from='client.15809 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:35:32.701 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:32.698+0000 7f67373f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:32.701 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:32.698+0000 7f67373f6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:32.717 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:32.717 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:32.735 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:32.735 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:32.748 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:32.748 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:32.765 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:32.765 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:33.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:33 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:35:33.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:33 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:35:33.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:33 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/654577129' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:33.689 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:33 trial105 ceph-mon[39442]: pgmap v547: 17 pgs: 17 active+clean; 1.5 GiB data, 10 GiB used, 2.7 TiB / 2.7 TiB avail; 127 B/s rd, 6.9 MiB/s wr, 3.39k op/s 2026-02-24T08:35:34.811 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:35:34.950 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:35.081 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:35.078+0000 7fc1f942d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:35.081 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:35.079+0000 7fc1f942d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:35.101 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:34 trial105 ceph-mon[39442]: purged_snaps scrub starts 2026-02-24T08:35:35.101 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:34 trial105 ceph-mon[39442]: purged_snaps scrub ok 2026-02-24T08:35:35.101 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:35.102 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:35.125 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:35.125 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:35.143 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:35.143 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:35.157 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:35.157 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:35 trial105 ceph-mon[39442]: pgmap v548: 17 pgs: 17 active+clean; 1.3 GiB data, 9.3 GiB used, 2.7 TiB / 2.7 TiB avail; 105 B/s rd, 5.7 MiB/s wr, 3.23k op/s 2026-02-24T08:35:36.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:35 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2589510337' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:36.390 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:35:36.390 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:35:36.390 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:35:36.390 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:35:36.544 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:36.691 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:36.689+0000 7fd7d6fae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:36.692 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:36.690+0000 7fd7d6fae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:36.853 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:35:36.853 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:35:36.903 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2026-02-24T08:35:36.817056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":906445368,"num_objects":13826,"num_object_clones":0,"num_object_copies":41478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13826,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":393998,"num_write_kb":2901239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160862,"ondisk_log_size":160862,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":8213176,"kb_used_data":3012008,"kb_used_omap":65,"kb_used_meta":5200958,"kb_avail":2927799624,"statfs":{"total":3006477107200,"available":2998066814976,"internally_reserved":0,"allocated":3084296192,"data_stored":3081084472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66982,"internal_metadata":5325781594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,11,10,11,18,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1901240320,"num_objects":-29011,"num_object_clones":0,"num_object_copies":-87033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-29011,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32659,"num_write_kb":25944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001438"},"pg_stats":[{"pgid":"9.f","version":"118'25070","reported_seq":25130,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.734879+0000","last_change":"2026-02-24T08:35:19.847408+0000","last_active":"2026-02-24T08:35:36.734879+0000","last_peered":"2026-02-24T08:35:36.734879+0000","last_clean":"2026-02-24T08:35:36.734879+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:35:36.734879+0000","last_undegraded":"2026-02-24T08:35:36.734879+0000","last_fullsized":"2026-02-24T08:35:36.734879+0000","mapping_epoch":108,"log_start":"110'15000","ondisk_log_start":"110'15000","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'21800","last_scrub_stamp":"2026-02-24T08:35:19.847365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:19.847365+0000","objects_scrubbed":2716,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:21.919813+0000","scrub_duration":1234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25070,"num_write_kb":181760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"118'24077","reported_seq":24139,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.736587+0000","last_change":"2026-02-24T08:35:21.092424+0000","last_active":"2026-02-24T08:35:36.736587+0000","last_peered":"2026-02-24T08:35:36.736587+0000","last_clean":"2026-02-24T08:35:36.736587+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:35:36.736587+0000","last_undegraded":"2026-02-24T08:35:36.736587+0000","last_fullsized":"2026-02-24T08:35:36.736587+0000","mapping_epoch":108,"log_start":"110'14000","ondisk_log_start":"110'14000","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'21216","last_scrub_stamp":"2026-02-24T08:35:21.092374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:21.092374+0000","objects_scrubbed":2650,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.406636+0000","scrub_duration":379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32309248,"num_objects":493,"num_object_clones":0,"num_object_copies":1479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24077,"num_write_kb":174720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"118'24533","reported_seq":24591,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.685046+0000","last_change":"2026-02-24T08:34:58.389945+0000","last_active":"2026-02-24T08:35:36.685046+0000","last_peered":"2026-02-24T08:35:36.685046+0000","last_clean":"2026-02-24T08:35:36.685046+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:35:36.685046+0000","last_undegraded":"2026-02-24T08:35:36.685046+0000","last_fullsized":"2026-02-24T08:35:36.685046+0000","mapping_epoch":108,"log_start":"110'14500","ondisk_log_start":"110'14500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'17192","last_scrub_stamp":"2026-02-24T08:34:58.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:34:58.389861+0000","objects_scrubbed":2148,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:58.644401+0000","scrub_duration":257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33161240,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":507,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24533,"num_write_kb":178049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"118'24154","reported_seq":24210,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:32.685009+0000","last_change":"2026-02-24T08:35:07.393024+0000","last_active":"2026-02-24T08:35:32.685009+0000","last_peered":"2026-02-24T08:35:32.685009+0000","last_clean":"2026-02-24T08:35:32.685009+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:35:32.685009+0000","last_undegraded":"2026-02-24T08:35:32.685009+0000","last_fullsized":"2026-02-24T08:35:32.685009+0000","mapping_epoch":108,"log_start":"110'14100","ondisk_log_start":"110'14100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19424","last_scrub_stamp":"2026-02-24T08:35:07.392959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.392959+0000","objects_scrubbed":2411,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:36.340808+0000","scrub_duration":1587,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88604672,"num_objects":1352,"num_object_clones":0,"num_object_copies":4056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1352,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24154,"num_write_kb":181376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"118'24630","reported_seq":24693,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:34.731201+0000","last_change":"2026-02-24T08:35:23.856698+0000","last_active":"2026-02-24T08:35:34.731201+0000","last_peered":"2026-02-24T08:35:34.731201+0000","last_clean":"2026-02-24T08:35:34.731201+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:35:34.731201+0000","last_undegraded":"2026-02-24T08:35:34.731201+0000","last_fullsized":"2026-02-24T08:35:34.731201+0000","mapping_epoch":108,"log_start":"110'14600","ondisk_log_start":"110'14600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22584","last_scrub_stamp":"2026-02-24T08:35:23.856663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:23.856663+0000","objects_scrubbed":2817,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:42.326197+0000","scrub_duration":540,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57999360,"num_objects":885,"num_object_clones":0,"num_object_copies":2655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":885,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24630,"num_write_kb":181440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"118'25421","reported_seq":25481,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.737254+0000","last_change":"2026-02-24T08:35:05.676793+0000","last_active":"2026-02-24T08:35:36.737254+0000","last_peered":"2026-02-24T08:35:36.737254+0000","last_clean":"2026-02-24T08:35:36.737254+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:35:36.737254+0000","last_undegraded":"2026-02-24T08:35:36.737254+0000","last_fullsized":"2026-02-24T08:35:36.737254+0000","mapping_epoch":108,"log_start":"110'15400","ondisk_log_start":"110'15400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19544","last_scrub_stamp":"2026-02-24T08:35:05.676747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:05.676747+0000","objects_scrubbed":2422,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:12.644183+0000","scrub_duration":1021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25421,"num_write_kb":184192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"118'24927","reported_seq":24992,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:34.719503+0000","last_change":"2026-02-24T08:35:19.701731+0000","last_active":"2026-02-24T08:35:34.719503+0000","last_peered":"2026-02-24T08:35:34.719503+0000","last_clean":"2026-02-24T08:35:34.719503+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:35:34.719503+0000","last_undegraded":"2026-02-24T08:35:34.719503+0000","last_fullsized":"2026-02-24T08:35:34.719503+0000","mapping_epoch":108,"log_start":"110'14900","ondisk_log_start":"110'14900","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'22032","last_scrub_stamp":"2026-02-24T08:35:19.701673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:19.701673+0000","objects_scrubbed":2749,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:44.465629+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":876,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24927,"num_write_kb":183488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"118'25375","reported_seq":25429,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.726204+0000","last_change":"2026-02-24T08:35:10.336709+0000","last_active":"2026-02-24T08:35:36.726204+0000","last_peered":"2026-02-24T08:35:36.726204+0000","last_clean":"2026-02-24T08:35:36.726204+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:35:36.726204+0000","last_undegraded":"2026-02-24T08:35:36.726204+0000","last_fullsized":"2026-02-24T08:35:36.726204+0000","mapping_epoch":108,"log_start":"110'15300","ondisk_log_start":"110'15300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20120","last_scrub_stamp":"2026-02-24T08:35:10.336675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:10.336675+0000","objects_scrubbed":2508,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:13.094529+0000","scrub_duration":666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34684928,"num_objects":530,"num_object_clones":0,"num_object_copies":1590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25375,"num_write_kb":184208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"118'25791","reported_seq":25849,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.746096+0000","last_change":"2026-02-24T08:35:15.488607+0000","last_active":"2026-02-24T08:35:36.746096+0000","last_peered":"2026-02-24T08:35:36.746096+0000","last_clean":"2026-02-24T08:35:36.746096+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:35:36.746096+0000","last_undegraded":"2026-02-24T08:35:36.746096+0000","last_fullsized":"2026-02-24T08:35:36.746096+0000","mapping_epoch":108,"log_start":"110'15700","ondisk_log_start":"110'15700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'21568","last_scrub_stamp":"2026-02-24T08:35:15.488421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:15.488421+0000","objects_scrubbed":2688,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:40.041525+0000","scrub_duration":1541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":507,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25791,"num_write_kb":187008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"118'24555","reported_seq":24618,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:34.722900+0000","last_change":"2026-02-24T08:35:13.461746+0000","last_active":"2026-02-24T08:35:34.722900+0000","last_peered":"2026-02-24T08:35:34.722900+0000","last_clean":"2026-02-24T08:35:34.722900+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:35:34.722900+0000","last_undegraded":"2026-02-24T08:35:34.722900+0000","last_fullsized":"2026-02-24T08:35:34.722900+0000","mapping_epoch":108,"log_start":"110'14500","ondisk_log_start":"110'14500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'20480","last_scrub_stamp":"2026-02-24T08:35:13.461676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:13.461676+0000","objects_scrubbed":2555,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:14.582913+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59375616,"num_objects":906,"num_object_clones":0,"num_object_copies":2718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":906,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24555,"num_write_kb":181056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"118'23247","reported_seq":23307,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:32.689962+0000","last_change":"2026-02-24T08:35:12.503082+0000","last_active":"2026-02-24T08:35:32.689962+0000","last_peered":"2026-02-24T08:35:32.689962+0000","last_clean":"2026-02-24T08:35:32.689962+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:35:32.689962+0000","last_undegraded":"2026-02-24T08:35:32.689962+0000","last_fullsized":"2026-02-24T08:35:32.689962+0000","mapping_epoch":108,"log_start":"110'13200","ondisk_log_start":"110'13200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'19704","last_scrub_stamp":"2026-02-24T08:35:12.503048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:12.503048+0000","objects_scrubbed":2454,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.988692+0000","scrub_duration":862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84934656,"num_objects":1296,"num_object_clones":0,"num_object_copies":3888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1296,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23247,"num_write_kb":174528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"118'24683","reported_seq":24743,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.686454+0000","last_change":"2026-02-24T08:35:06.741209+0000","last_active":"2026-02-24T08:35:36.686454+0000","last_peered":"2026-02-24T08:35:36.686454+0000","last_clean":"2026-02-24T08:35:36.686454+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:35:36.686454+0000","last_undegraded":"2026-02-24T08:35:36.686454+0000","last_fullsized":"2026-02-24T08:35:36.686454+0000","mapping_epoch":108,"log_start":"110'14600","ondisk_log_start":"110'14600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'18984","last_scrub_stamp":"2026-02-24T08:35:06.741175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:06.741175+0000","objects_scrubbed":2361,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:35.489531+0000","scrub_duration":683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24683,"num_write_kb":179136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"118'23719","reported_seq":23783,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:32.675819+0000","last_change":"2026-02-24T08:35:16.753717+0000","last_active":"2026-02-24T08:35:32.675819+0000","last_peered":"2026-02-24T08:35:32.675819+0000","last_clean":"2026-02-24T08:35:32.675819+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:35:32.675819+0000","last_undegraded":"2026-02-24T08:35:32.675819+0000","last_fullsized":"2026-02-24T08:35:32.675819+0000","mapping_epoch":108,"log_start":"110'13700","ondisk_log_start":"110'13700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'20944","last_scrub_stamp":"2026-02-24T08:35:16.753670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:16.753670+0000","objects_scrubbed":2609,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:37.157892+0000","scrub_duration":1144,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83492864,"num_objects":1274,"num_object_clones":0,"num_object_copies":3822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23719,"num_write_kb":177728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"118'25325","reported_seq":25390,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:34.724248+0000","last_change":"2026-02-24T08:35:22.394425+0000","last_active":"2026-02-24T08:35:34.724248+0000","last_peered":"2026-02-24T08:35:34.724248+0000","last_clean":"2026-02-24T08:35:34.724248+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:35:34.724248+0000","last_undegraded":"2026-02-24T08:35:34.724248+0000","last_fullsized":"2026-02-24T08:35:34.724248+0000","mapping_epoch":108,"log_start":"110'15300","ondisk_log_start":"110'15300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22952","last_scrub_stamp":"2026-02-24T08:35:22.394294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:22.394294+0000","objects_scrubbed":2845,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.376288+0000","scrub_duration":1819,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63176704,"num_objects":964,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":964,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25325,"num_write_kb":186944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"118'24117","reported_seq":24178,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:32.678589+0000","last_change":"2026-02-24T08:35:11.523813+0000","last_active":"2026-02-24T08:35:32.678589+0000","last_peered":"2026-02-24T08:35:32.678589+0000","last_clean":"2026-02-24T08:35:32.678589+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:35:32.678589+0000","last_undegraded":"2026-02-24T08:35:32.678589+0000","last_fullsized":"2026-02-24T08:35:32.678589+0000","mapping_epoch":108,"log_start":"110'14100","ondisk_log_start":"110'14100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20024","last_scrub_stamp":"2026-02-24T08:35:11.523763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:11.523763+0000","objects_scrubbed":2497,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:37.362898+0000","scrub_duration":841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91619328,"num_objects":1398,"num_object_clones":0,"num_object_copies":4194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24117,"num_write_kb":181440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"118'24239","reported_seq":24303,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:32.673430+0000","last_change":"2026-02-24T08:35:07.912094+0000","last_active":"2026-02-24T08:35:32.673430+0000","last_peered":"2026-02-24T08:35:32.673430+0000","last_clean":"2026-02-24T08:35:32.673430+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:35:32.673430+0000","last_undegraded":"2026-02-24T08:35:32.673430+0000","last_fullsized":"2026-02-24T08:35:32.673430+0000","mapping_epoch":108,"log_start":"110'14200","ondisk_log_start":"110'14200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19608","last_scrub_stamp":"2026-02-24T08:35:07.912046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.912046+0000","objects_scrubbed":2434,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:34.255028+0000","scrub_duration":1089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88932352,"num_objects":1357,"num_object_clones":0,"num_object_copies":4071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24239,"num_write_kb":182016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":330,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:35.851277+0000","last_change":"2026-02-24T08:35:35.851277+0000","last_active":"2026-02-24T08:35:35.851277+0000","last_peered":"2026-02-24T08:35:35.851277+0000","last_clean":"2026-02-24T08:35:35.851277+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:35:35.851277+0000","last_undegraded":"2026-02-24T08:35:35.851277+0000","last_fullsized":"2026-02-24T08:35:35.851277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:35:35.851234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:35:35.851234+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:01.752760+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":905855000,"num_objects":13824,"num_object_clones":0,"num_object_copies":41472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13824,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":393863,"num_write_kb":2899089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2616389632,"data_stored":2616377416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160763,"ondisk_log_size":160763,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5540,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247993,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2040004,"kb_used_data":573680,"kb_used_omap":17,"kb_used_meta":1466286,"kb_avail":731963196,"statfs":{"total":751619276800,"available":749530312704,"internally_reserved":0,"allocated":587448320,"data_stored":586643484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17937,"internal_metadata":1501477359},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444219,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1853188,"kb_used_data":391920,"kb_used_omap":12,"kb_used_meta":1461235,"kb_avail":732150012,"statfs":{"total":751619276800,"available":749721612288,"internally_reserved":0,"allocated":401326080,"data_stored":400521244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13303,"internal_metadata":1496304649},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,11,10,11,18,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2722688,"kb_used_data":1376108,"kb_used_omap":16,"kb_used_meta":1346479,"kb_avail":731280512,"statfs":{"total":751619276800,"available":748831244288,"internally_reserved":0,"allocated":1409134592,"data_stored":1408333308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17212,"internal_metadata":1378794692},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705855,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1597296,"kb_used_data":670300,"kb_used_omap":18,"kb_used_meta":926957,"kb_avail":732405904,"statfs":{"total":751619276800,"available":749983645696,"internally_reserved":0,"allocated":686387200,"data_stored":685586436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18530,"internal_metadata":949204894},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5540,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":599392256,"data_stored":599392256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1229279232,"data_stored":1229275160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":356077568,"data_stored":356073496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":431640576,"data_stored":431636504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:35:36.904 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 321 2026-02-24T08:35:37.061 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:37.089 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:36 trial105 ceph-mon[39442]: 1.0 scrub starts 2026-02-24T08:35:37.089 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:36 trial105 ceph-mon[39442]: 1.0 scrub ok 2026-02-24T08:35:37.204 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:37.202+0000 7f8057fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:37.205 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:37.203+0000 7f8057fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:37.211 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:35:37.359 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:35:37.359 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:37.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:35:37.481 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:37.478+0000 7f14f5fce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:37.481 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:37.479+0000 7f14f5fce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:37.506 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:37.506 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:37.523 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:37.523 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:37.536 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:37.536 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:37.553 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:37.553 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:37 trial105 ceph-mon[39442]: pgmap v549: 17 pgs: 17 active+clean; 864 MiB data, 7.8 GiB used, 2.7 TiB / 2.7 TiB avail; 2.5 MiB/s wr, 3.27k op/s 2026-02-24T08:35:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:37 trial105 ceph-mon[39442]: from='client.15815 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:35:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3979709236' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "321"} : dispatch 2026-02-24T08:35:38.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:37 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1295674453' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:39.247 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Removed 45299 objects 2026-02-24T08:35:39.247 INFO:tasks.radosbench.radosbench.0.trial105.stdout:Clean up completed and total clean up time :14.0228 2026-02-24T08:35:39.604 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:35:39.719 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:39.817 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:39.814+0000 7fbe766b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:39.817 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:39.815+0000 7fbe766b3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:39.818 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:35:39 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:35:39] "GET /metrics HTTP/1.1" 200 4227 "" "Prometheus/3.6.0" 2026-02-24T08:35:39.829 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:39.829 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:39.840 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:39.840 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:39.841 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:35:39 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:35:39.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:35:39.851 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:39.851 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:39.861 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:39.862 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:40.188 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:39 trial105 ceph-mon[39442]: pgmap v550: 17 pgs: 17 active+clean; 546 MiB data, 6.9 GiB used, 2.7 TiB / 2.7 TiB avail; 2.2 MiB/s wr, 3.23k op/s 2026-02-24T08:35:40.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:39 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/243339609' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:41.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:40 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:35:41.915 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-24T08:35:42.029 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:42.129 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:42.127+0000 7fda23159640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:42.129 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:42.127+0000 7fda23159640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:42.129 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:41 trial105 ceph-mon[39442]: pgmap v551: 17 pgs: 17 active+clean; 319 MiB data, 6.2 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.86k op/s 2026-02-24T08:35:42.129 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:41 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:35:42.129 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:41 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:35:42.129 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:41 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:35:42.129 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:41 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:35:42.142 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:42.142 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:42.152 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:42.152 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:42.164 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:42.164 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:42.175 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:42.175 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:42.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-24T08:35:42.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2026-02-24T08:35:42.403 INFO:tasks.thrashosds.thrasher:Growing pool .mgr 2026-02-24T08:35:42.403 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:35:42.521 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:42.622 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:42.620+0000 7f98bd0ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:42.622 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:42.620+0000 7f98bd0ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:42.731 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:35:42.732 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:35:42.767 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2026-02-24T08:35:40.817631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":334774840,"num_objects":5103,"num_object_clones":0,"num_object_copies":15309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5103,"num_whiteouts":0,"num_read":137,"num_read_kb":241,"num_write":402721,"num_write_kb":2901239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160985,"ondisk_log_size":160985,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":2936012800,"kb_used":6534584,"kb_used_data":1279336,"kb_used_omap":66,"kb_used_meta":5255101,"kb_avail":2929478216,"statfs":{"total":3006477107200,"available":2999785693184,"internally_reserved":0,"allocated":1310040064,"data_stored":1306828344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":67634,"internal_metadata":5381224398},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,3,17,21,17,25,8],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2249064448,"num_objects":-34318,"num_object_clones":0,"num_object_copies":-102954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-34318,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34318,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001712"},"pg_stats":[{"pgid":"9.f","version":"118'25070","reported_seq":25130,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.734879+0000","last_change":"2026-02-24T08:35:19.847408+0000","last_active":"2026-02-24T08:35:36.734879+0000","last_peered":"2026-02-24T08:35:36.734879+0000","last_clean":"2026-02-24T08:35:36.734879+0000","last_became_active":"2026-02-24T08:33:53.121931+0000","last_became_peered":"2026-02-24T08:33:53.121931+0000","last_unstale":"2026-02-24T08:35:36.734879+0000","last_undegraded":"2026-02-24T08:35:36.734879+0000","last_fullsized":"2026-02-24T08:35:36.734879+0000","mapping_epoch":108,"log_start":"110'15000","ondisk_log_start":"110'15000","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'21800","last_scrub_stamp":"2026-02-24T08:35:19.847365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:19.847365+0000","objects_scrubbed":2716,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:21.919813+0000","scrub_duration":1234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":490,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25070,"num_write_kb":181760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"118'24077","reported_seq":24139,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.736587+0000","last_change":"2026-02-24T08:35:21.092424+0000","last_active":"2026-02-24T08:35:36.736587+0000","last_peered":"2026-02-24T08:35:36.736587+0000","last_clean":"2026-02-24T08:35:36.736587+0000","last_became_active":"2026-02-24T08:33:53.121429+0000","last_became_peered":"2026-02-24T08:33:53.121429+0000","last_unstale":"2026-02-24T08:35:36.736587+0000","last_undegraded":"2026-02-24T08:35:36.736587+0000","last_fullsized":"2026-02-24T08:35:36.736587+0000","mapping_epoch":108,"log_start":"110'14000","ondisk_log_start":"110'14000","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'21216","last_scrub_stamp":"2026-02-24T08:35:21.092374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:21.092374+0000","objects_scrubbed":2650,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.406636+0000","scrub_duration":379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32309248,"num_objects":493,"num_object_clones":0,"num_object_copies":1479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24077,"num_write_kb":174720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"118'24533","reported_seq":24591,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.685046+0000","last_change":"2026-02-24T08:34:58.389945+0000","last_active":"2026-02-24T08:35:36.685046+0000","last_peered":"2026-02-24T08:35:36.685046+0000","last_clean":"2026-02-24T08:35:36.685046+0000","last_became_active":"2026-02-24T08:33:53.121280+0000","last_became_peered":"2026-02-24T08:33:53.121280+0000","last_unstale":"2026-02-24T08:35:36.685046+0000","last_undegraded":"2026-02-24T08:35:36.685046+0000","last_fullsized":"2026-02-24T08:35:36.685046+0000","mapping_epoch":108,"log_start":"110'14500","ondisk_log_start":"110'14500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'17192","last_scrub_stamp":"2026-02-24T08:34:58.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:34:58.389861+0000","objects_scrubbed":2148,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:35:58.644401+0000","scrub_duration":257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33161240,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":507,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24533,"num_write_kb":178049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"118'25192","reported_seq":25255,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:37.705202+0000","last_change":"2026-02-24T08:35:07.393024+0000","last_active":"2026-02-24T08:35:37.705202+0000","last_peered":"2026-02-24T08:35:37.705202+0000","last_clean":"2026-02-24T08:35:37.705202+0000","last_became_active":"2026-02-24T08:33:53.120333+0000","last_became_peered":"2026-02-24T08:33:53.120333+0000","last_unstale":"2026-02-24T08:35:37.705202+0000","last_undegraded":"2026-02-24T08:35:37.705202+0000","last_fullsized":"2026-02-24T08:35:37.705202+0000","mapping_epoch":108,"log_start":"110'15100","ondisk_log_start":"110'15100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19424","last_scrub_stamp":"2026-02-24T08:35:07.392959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.392959+0000","objects_scrubbed":2411,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:36.340808+0000","scrub_duration":1587,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20578304,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25192,"num_write_kb":181376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"118'25515","reported_seq":25581,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:39.214794+0000","last_change":"2026-02-24T08:35:23.856698+0000","last_active":"2026-02-24T08:35:39.214794+0000","last_peered":"2026-02-24T08:35:39.214794+0000","last_clean":"2026-02-24T08:35:39.214794+0000","last_became_active":"2026-02-24T08:33:53.120513+0000","last_became_peered":"2026-02-24T08:33:53.120513+0000","last_unstale":"2026-02-24T08:35:39.214794+0000","last_undegraded":"2026-02-24T08:35:39.214794+0000","last_fullsized":"2026-02-24T08:35:39.214794+0000","mapping_epoch":108,"log_start":"110'15500","ondisk_log_start":"110'15500","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22584","last_scrub_stamp":"2026-02-24T08:35:23.856663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:23.856663+0000","objects_scrubbed":2817,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:42.326197+0000","scrub_duration":540,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25515,"num_write_kb":181440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"118'25421","reported_seq":25481,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.737254+0000","last_change":"2026-02-24T08:35:05.676793+0000","last_active":"2026-02-24T08:35:36.737254+0000","last_peered":"2026-02-24T08:35:36.737254+0000","last_clean":"2026-02-24T08:35:36.737254+0000","last_became_active":"2026-02-24T08:33:53.122301+0000","last_became_peered":"2026-02-24T08:33:53.122301+0000","last_unstale":"2026-02-24T08:35:36.737254+0000","last_undegraded":"2026-02-24T08:35:36.737254+0000","last_fullsized":"2026-02-24T08:35:36.737254+0000","mapping_epoch":108,"log_start":"110'15400","ondisk_log_start":"110'15400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19544","last_scrub_stamp":"2026-02-24T08:35:05.676747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:05.676747+0000","objects_scrubbed":2422,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:12.644183+0000","scrub_duration":1021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25421,"num_write_kb":184192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"118'25803","reported_seq":25869,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:39.225804+0000","last_change":"2026-02-24T08:35:19.701731+0000","last_active":"2026-02-24T08:35:39.225804+0000","last_peered":"2026-02-24T08:35:39.225804+0000","last_clean":"2026-02-24T08:35:39.225804+0000","last_became_active":"2026-02-24T08:33:53.119532+0000","last_became_peered":"2026-02-24T08:33:53.119532+0000","last_unstale":"2026-02-24T08:35:39.225804+0000","last_undegraded":"2026-02-24T08:35:39.225804+0000","last_fullsized":"2026-02-24T08:35:39.225804+0000","mapping_epoch":108,"log_start":"110'15800","ondisk_log_start":"110'15800","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'22032","last_scrub_stamp":"2026-02-24T08:35:19.701673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:19.701673+0000","objects_scrubbed":2749,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:44.465629+0000","scrub_duration":651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25803,"num_write_kb":183488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"118'25375","reported_seq":25429,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.726204+0000","last_change":"2026-02-24T08:35:10.336709+0000","last_active":"2026-02-24T08:35:36.726204+0000","last_peered":"2026-02-24T08:35:36.726204+0000","last_clean":"2026-02-24T08:35:36.726204+0000","last_became_active":"2026-02-24T08:33:53.121572+0000","last_became_peered":"2026-02-24T08:33:53.121572+0000","last_unstale":"2026-02-24T08:35:36.726204+0000","last_undegraded":"2026-02-24T08:35:36.726204+0000","last_fullsized":"2026-02-24T08:35:36.726204+0000","mapping_epoch":108,"log_start":"110'15300","ondisk_log_start":"110'15300","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20120","last_scrub_stamp":"2026-02-24T08:35:10.336675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:10.336675+0000","objects_scrubbed":2508,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:13.094529+0000","scrub_duration":666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34684928,"num_objects":530,"num_object_clones":0,"num_object_copies":1590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25375,"num_write_kb":184208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"118'25791","reported_seq":25849,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.746096+0000","last_change":"2026-02-24T08:35:15.488607+0000","last_active":"2026-02-24T08:35:36.746096+0000","last_peered":"2026-02-24T08:35:36.746096+0000","last_clean":"2026-02-24T08:35:36.746096+0000","last_became_active":"2026-02-24T08:33:53.121580+0000","last_became_peered":"2026-02-24T08:33:53.121580+0000","last_unstale":"2026-02-24T08:35:36.746096+0000","last_undegraded":"2026-02-24T08:35:36.746096+0000","last_fullsized":"2026-02-24T08:35:36.746096+0000","mapping_epoch":108,"log_start":"110'15700","ondisk_log_start":"110'15700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'21568","last_scrub_stamp":"2026-02-24T08:35:15.488421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:15.488421+0000","objects_scrubbed":2688,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:40.041525+0000","scrub_duration":1541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":507,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25791,"num_write_kb":187008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"118'25461","reported_seq":25524,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:39.199089+0000","last_change":"2026-02-24T08:35:13.461746+0000","last_active":"2026-02-24T08:35:39.199089+0000","last_peered":"2026-02-24T08:35:39.199089+0000","last_clean":"2026-02-24T08:35:39.199089+0000","last_became_active":"2026-02-24T08:33:53.119764+0000","last_became_peered":"2026-02-24T08:33:53.119764+0000","last_unstale":"2026-02-24T08:35:39.199089+0000","last_undegraded":"2026-02-24T08:35:39.199089+0000","last_fullsized":"2026-02-24T08:35:39.199089+0000","mapping_epoch":108,"log_start":"110'15400","ondisk_log_start":"110'15400","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'20480","last_scrub_stamp":"2026-02-24T08:35:13.461676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:13.461676+0000","objects_scrubbed":2555,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:14.582913+0000","scrub_duration":510,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25461,"num_write_kb":181056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"118'24244","reported_seq":24307,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:37.705119+0000","last_change":"2026-02-24T08:35:12.503082+0000","last_active":"2026-02-24T08:35:37.705119+0000","last_peered":"2026-02-24T08:35:37.705119+0000","last_clean":"2026-02-24T08:35:37.705119+0000","last_became_active":"2026-02-24T08:33:53.119896+0000","last_became_peered":"2026-02-24T08:33:53.119896+0000","last_unstale":"2026-02-24T08:35:37.705119+0000","last_undegraded":"2026-02-24T08:35:37.705119+0000","last_fullsized":"2026-02-24T08:35:37.705119+0000","mapping_epoch":108,"log_start":"110'14200","ondisk_log_start":"110'14200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'19704","last_scrub_stamp":"2026-02-24T08:35:12.503048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:12.503048+0000","objects_scrubbed":2454,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.988692+0000","scrub_duration":862,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":299,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24244,"num_write_kb":174528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"118'24683","reported_seq":24743,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:36.686454+0000","last_change":"2026-02-24T08:35:06.741209+0000","last_active":"2026-02-24T08:35:36.686454+0000","last_peered":"2026-02-24T08:35:36.686454+0000","last_clean":"2026-02-24T08:35:36.686454+0000","last_became_active":"2026-02-24T08:33:53.120774+0000","last_became_peered":"2026-02-24T08:33:53.120774+0000","last_unstale":"2026-02-24T08:35:36.686454+0000","last_undegraded":"2026-02-24T08:35:36.686454+0000","last_fullsized":"2026-02-24T08:35:36.686454+0000","mapping_epoch":108,"log_start":"110'14600","ondisk_log_start":"110'14600","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'18984","last_scrub_stamp":"2026-02-24T08:35:06.741175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:06.741175+0000","objects_scrubbed":2361,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:35.489531+0000","scrub_duration":683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24683,"num_write_kb":179136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"118'24722","reported_seq":24786,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:37.702534+0000","last_change":"2026-02-24T08:35:16.753717+0000","last_active":"2026-02-24T08:35:37.702534+0000","last_peered":"2026-02-24T08:35:37.702534+0000","last_clean":"2026-02-24T08:35:37.702534+0000","last_became_active":"2026-02-24T08:33:53.120458+0000","last_became_peered":"2026-02-24T08:33:53.120458+0000","last_unstale":"2026-02-24T08:35:37.702534+0000","last_undegraded":"2026-02-24T08:35:37.702534+0000","last_fullsized":"2026-02-24T08:35:37.702534+0000","mapping_epoch":108,"log_start":"110'14700","ondisk_log_start":"110'14700","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'20944","last_scrub_stamp":"2026-02-24T08:35:16.753670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:16.753670+0000","objects_scrubbed":2609,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:37.157892+0000","scrub_duration":1144,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17760256,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":271,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24722,"num_write_kb":177728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"118'26289","reported_seq":26356,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:39.231309+0000","last_change":"2026-02-24T08:35:22.394425+0000","last_active":"2026-02-24T08:35:39.231309+0000","last_peered":"2026-02-24T08:35:39.231309+0000","last_clean":"2026-02-24T08:35:39.231309+0000","last_became_active":"2026-02-24T08:33:53.120348+0000","last_became_peered":"2026-02-24T08:33:53.120348+0000","last_unstale":"2026-02-24T08:35:39.231309+0000","last_undegraded":"2026-02-24T08:35:39.231309+0000","last_fullsized":"2026-02-24T08:35:39.231309+0000","mapping_epoch":108,"log_start":"110'16200","ondisk_log_start":"110'16200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22952","last_scrub_stamp":"2026-02-24T08:35:22.394294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:22.394294+0000","objects_scrubbed":2845,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:28.376288+0000","scrub_duration":1819,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26289,"num_write_kb":186944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"118'25155","reported_seq":25217,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:37.702284+0000","last_change":"2026-02-24T08:35:11.523813+0000","last_active":"2026-02-24T08:35:37.702284+0000","last_peered":"2026-02-24T08:35:37.702284+0000","last_clean":"2026-02-24T08:35:37.702284+0000","last_became_active":"2026-02-24T08:33:53.120169+0000","last_became_peered":"2026-02-24T08:33:53.120169+0000","last_unstale":"2026-02-24T08:35:37.702284+0000","last_undegraded":"2026-02-24T08:35:37.702284+0000","last_fullsized":"2026-02-24T08:35:37.702284+0000","mapping_epoch":108,"log_start":"110'15100","ondisk_log_start":"110'15100","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'20024","last_scrub_stamp":"2026-02-24T08:35:11.523763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:11.523763+0000","objects_scrubbed":2497,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:37.362898+0000","scrub_duration":841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25155,"num_write_kb":181440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"118'25255","reported_seq":25318,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:37.702138+0000","last_change":"2026-02-24T08:35:07.912094+0000","last_active":"2026-02-24T08:35:37.702138+0000","last_peered":"2026-02-24T08:35:37.702138+0000","last_clean":"2026-02-24T08:35:37.702138+0000","last_became_active":"2026-02-24T08:33:53.120158+0000","last_became_peered":"2026-02-24T08:33:53.120158+0000","last_unstale":"2026-02-24T08:35:37.702138+0000","last_undegraded":"2026-02-24T08:35:37.702138+0000","last_fullsized":"2026-02-24T08:35:37.702138+0000","mapping_epoch":108,"log_start":"110'15200","ondisk_log_start":"110'15200","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'19608","last_scrub_stamp":"2026-02-24T08:35:07.912046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:33:52.107047+0000","last_clean_scrub_stamp":"2026-02-24T08:35:07.912046+0000","objects_scrubbed":2434,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:36:34.255028+0000","scrub_duration":1089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25255,"num_write_kb":182016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'99","reported_seq":330,"reported_epoch":118,"state":"active+clean","last_fresh":"2026-02-24T08:35:35.851277+0000","last_change":"2026-02-24T08:35:35.851277+0000","last_active":"2026-02-24T08:35:35.851277+0000","last_peered":"2026-02-24T08:35:35.851277+0000","last_clean":"2026-02-24T08:35:35.851277+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:35:35.851277+0000","last_undegraded":"2026-02-24T08:35:35.851277+0000","last_fullsized":"2026-02-24T08:35:35.851277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:35:35.851234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:35:35.851234+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:01.752760+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":334184472,"num_objects":5101,"num_object_clones":0,"num_object_copies":15303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5101,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":402586,"num_write_kb":2899089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1079635968,"data_stored":1079623752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160886,"ondisk_log_size":160886,"up":48,"acting":48,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5540,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247993,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":2040004,"kb_used_data":573680,"kb_used_omap":17,"kb_used_meta":1466286,"kb_avail":731963196,"statfs":{"total":751619276800,"available":749530312704,"internally_reserved":0,"allocated":587448320,"data_stored":586643484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17937,"internal_metadata":1501477359},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444219,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1853188,"kb_used_data":391920,"kb_used_omap":12,"kb_used_meta":1461235,"kb_avail":732150012,"statfs":{"total":751619276800,"available":749721612288,"internally_reserved":0,"allocated":401326080,"data_stored":400521244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13303,"internal_metadata":1496304649},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,2,11,10,11,18,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1697984,"kb_used_data":297324,"kb_used_omap":17,"kb_used_meta":1400622,"kb_avail":732305216,"statfs":{"total":751619276800,"available":749880541184,"internally_reserved":0,"allocated":304459776,"data_stored":303658492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17864,"internal_metadata":1434237496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":943408,"kb_used_data":16412,"kb_used_omap":18,"kb_used_meta":926957,"kb_avail":733059792,"statfs":{"total":751619276800,"available":750653227008,"internally_reserved":0,"allocated":16805888,"data_stored":16005124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18530,"internal_metadata":949204894},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,6,11,6,7,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5540,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":291917824,"data_stored":291913752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":356077568,"data_stored":356073496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":431640576,"data_stored":431636504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T08:35:42.769 INFO:tasks.cephadm.ceph_manager.ceph:increase pool size by 10 2026-02-24T08:35:42.769 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pg_num 331 2026-02-24T08:35:42.887 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:42.996 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:42.994+0000 7f22490d0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:42.996 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:42 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3364630233' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:42.996 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:42.994+0000 7f22490d0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:43.105 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pg_num increase denied for crimson pool 2026-02-24T08:35:43.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:35:43.983 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_7 2026-02-24T08:35:43.983 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2026-02-24T08:35:44.100 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:44.140 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:43 trial105 ceph-mon[39442]: from='client.15825 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:35:44.140 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:43 trial105 ceph-mon[39442]: pgmap v552: 17 pgs: 17 active+clean; 577 KiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 3.11k op/s 2026-02-24T08:35:44.140 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:43 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/568141220' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pg_num", "val": "331"} : dispatch 2026-02-24T08:35:44.200 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:44.198+0000 7fb0bdf14640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:44.200 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:44.198+0000 7fb0bdf14640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:44.211 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-24T08:35:44.327 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:44.422 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:44.420+0000 7fbc4eb20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:44.423 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:44.420+0000 7fbc4eb20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:44.434 INFO:teuthology.orchestra.run.trial105.stdout:osd.0: {} 2026-02-24T08:35:44.435 INFO:teuthology.orchestra.run.trial105.stderr:osd.0: osd_enable_op_tracker = '' 2026-02-24T08:35:44.445 INFO:teuthology.orchestra.run.trial105.stdout:osd.1: {} 2026-02-24T08:35:44.445 INFO:teuthology.orchestra.run.trial105.stderr:osd.1: osd_enable_op_tracker = '' 2026-02-24T08:35:44.455 INFO:teuthology.orchestra.run.trial105.stdout:osd.2: {} 2026-02-24T08:35:44.455 INFO:teuthology.orchestra.run.trial105.stderr:osd.2: osd_enable_op_tracker = '' 2026-02-24T08:35:44.465 INFO:teuthology.orchestra.run.trial105.stdout:osd.3: {} 2026-02-24T08:35:44.466 INFO:teuthology.orchestra.run.trial105.stderr:osd.3: osd_enable_op_tracker = '' 2026-02-24T08:35:44.882 INFO:teuthology.orchestra.run.trial105.stderr:pool 'unique_pool_7' removed 2026-02-24T08:35:44.931 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2026-02-24T08:35:44.943 INFO:tasks.thrashosds:joining thrashosds 2026-02-24T08:35:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:44 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:35:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1487641007' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T08:35:45.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:44 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3582300186' entity='client.admin' cmd={"prefix": "osd ls"} : dispatch 2026-02-24T08:35:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:45 trial105 ceph-mon[39442]: pgmap v553: 17 pgs: 17 active+clean; 577 KiB data, 5.0 GiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 2.10k op/s 2026-02-24T08:35:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:45 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1487641007' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_7", "pool2": "unique_pool_7", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T08:35:46.189 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:45 trial105 ceph-mon[39442]: osdmap e119: 4 total, 4 up, 4 in 2026-02-24T08:35:48.136 INFO:tasks.thrashosds.thrasher:fixing pg num pool .mgr 2026-02-24T08:35:48.136 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd pool set .mgr pgp_num 331 2026-02-24T08:35:48.162 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:47 trial105 ceph-mon[39442]: pgmap v555: 1 pgs: 1 active+clean; 577 KiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:35:48.254 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:48.357 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:48.355+0000 7fd40f82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:48.357 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:48.355+0000 7fd40f82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:48.467 INFO:teuthology.orchestra.run.trial105.stderr:Error EPERM: crimson_allow_pg_split is false; pgp_num increase denied 2026-02-24T08:35:48.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:35:48.501 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2026-02-24T08:35:48.656 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:48.752 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:48.749+0000 7f61148ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:48.752 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:48.750+0000 7f61148ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:48.759 INFO:teuthology.orchestra.run.trial105.stdout:{} 2026-02-24T08:35:48.759 INFO:teuthology.orchestra.run.trial105.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-24T08:35:48.792 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 0 1 2026-02-24T08:35:48.906 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:49.007 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:49.004+0000 7f4b16dd8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:49.007 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:49.004+0000 7f4b16dd8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:49.007 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:48 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3493914247' entity='client.admin' cmd={"prefix": "osd pool set", "pool": ".mgr", "var": "pgp_num", "val": "331"} : dispatch 2026-02-24T08:35:49.007 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:48 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3280234976' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T08:35:49.886 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.0 to 1 (10000) 2026-02-24T08:35:49.887 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:35:49 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:35:49] "GET /metrics HTTP/1.1" 200 4182 "" "Prometheus/3.6.0" 2026-02-24T08:35:49.926 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd primary-affinity 0 1 2026-02-24T08:35:49.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:35:49 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:35:49.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:35:50.040 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:50.142 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:50.139+0000 7fe1122ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:50.142 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:49 trial105 ceph-mon[39442]: pgmap v556: 1 pgs: 1 active+clean; 577 KiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:35:50.142 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:49 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1991020744' entity='client.admin' cmd={"prefix": "osd reweight", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:35:50.143 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:50.140+0000 7fe1122ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:50.893 INFO:teuthology.orchestra.run.trial105.stderr:set osd.0 primary-affinity to 1 (8655362) 2026-02-24T08:35:50.930 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 1 1 2026-02-24T08:35:51.045 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:51.144 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:51.142+0000 7fb21d268640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:51.145 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1991020744' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:35:51.145 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:50 trial105 ceph-mon[39442]: osdmap e120: 4 total, 4 up, 4 in 2026-02-24T08:35:51.145 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:50 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2865425445' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 0, "weight": 1.0} : dispatch 2026-02-24T08:35:51.145 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:51.142+0000 7fb21d268640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:51.895 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.1 to 1 (10000) 2026-02-24T08:35:51.940 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd primary-affinity 1 1 2026-02-24T08:35:52.056 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:52.159 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:52.157+0000 7f8259616640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:52.159 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:52.157+0000 7f8259616640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:52.160 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:51 trial105 ceph-mon[39442]: pgmap v558: 1 pgs: 1 active+clean; 577 KiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:35:52.160 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2865425445' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]': finished 2026-02-24T08:35:52.160 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:51 trial105 ceph-mon[39442]: osdmap e121: 4 total, 4 up, 4 in 2026-02-24T08:35:52.160 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:51 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2614670958' entity='client.admin' cmd={"prefix": "osd reweight", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:35:53.128 INFO:teuthology.orchestra.run.trial105.stderr:set osd.1 primary-affinity to 1 (8655362) 2026-02-24T08:35:53.149 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2614670958' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:35:53.149 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:52 trial105 ceph-mon[39442]: osdmap e122: 4 total, 4 up, 4 in 2026-02-24T08:35:53.149 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:52 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/932748948' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 1, "weight": 1.0} : dispatch 2026-02-24T08:35:53.166 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 2 1 2026-02-24T08:35:53.281 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:53.380 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:53.378+0000 7eff649dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:53.380 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:53.378+0000 7eff649dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:54.128 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.2 to 1 (10000) 2026-02-24T08:35:54.155 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:53 trial105 ceph-mon[39442]: pgmap v561: 1 pgs: 1 active+clean; 577 KiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:35:54.155 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:53 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/932748948' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]': finished 2026-02-24T08:35:54.155 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:53 trial105 ceph-mon[39442]: osdmap e123: 4 total, 4 up, 4 in 2026-02-24T08:35:54.155 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:53 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3807502267' entity='client.admin' cmd={"prefix": "osd reweight", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:35:54.185 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd primary-affinity 2 1 2026-02-24T08:35:54.302 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:54.408 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:54.406+0000 7f242a5ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:54.408 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:54.406+0000 7f242a5ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:55.131 INFO:teuthology.orchestra.run.trial105.stderr:set osd.2 primary-affinity to 1 (8655362) 2026-02-24T08:35:55.172 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd reweight 3 1 2026-02-24T08:35:55.288 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:55.392 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:55.390+0000 7f5eef623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:55.393 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3807502267' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:35:55.393 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:55 trial105 ceph-mon[39442]: osdmap e124: 4 total, 4 up, 4 in 2026-02-24T08:35:55.393 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:55 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2974955136' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 2, "weight": 1.0} : dispatch 2026-02-24T08:35:55.393 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:55 trial105 ceph-mon[39442]: pgmap v564: 1 pgs: 1 active+clean; 577 KiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:35:55.393 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:55.390+0000 7f5eef623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:56.132 INFO:teuthology.orchestra.run.trial105.stderr:reweighted osd.3 to 1 (10000) 2026-02-24T08:35:56.173 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd primary-affinity 3 1 2026-02-24T08:35:56.287 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:56.392 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:56.390+0000 7fcab395c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:56.393 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2974955136' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]': finished 2026-02-24T08:35:56.393 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:56 trial105 ceph-mon[39442]: osdmap e125: 4 total, 4 up, 4 in 2026-02-24T08:35:56.393 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:56 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1032930967' entity='client.admin' cmd={"prefix": "osd reweight", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:35:56.393 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:56.390+0000 7fcab395c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:57.138 INFO:teuthology.orchestra.run.trial105.stderr:set osd.3 primary-affinity to 1 (8655362) 2026-02-24T08:35:57.179 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-24T08:35:57.179 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-24T08:35:57.179 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T08:35:57.296 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:57.395 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:57.392+0000 7fbaa3e0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:57.395 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:57.393+0000 7fbaa3e0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:57.396 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1032930967' entity='client.admin' cmd='[{"prefix": "osd reweight", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:35:57.396 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:57 trial105 ceph-mon[39442]: osdmap e126: 4 total, 4 up, 4 in 2026-02-24T08:35:57.396 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:57 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1643006007' entity='client.admin' cmd={"prefix": "osd primary-affinity", "id": 3, "weight": 1.0} : dispatch 2026-02-24T08:35:57.397 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:57 trial105 ceph-mon[39442]: pgmap v567: 1 pgs: 1 active+clean; 577 KiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:35:57.504 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:35:57.504 INFO:teuthology.orchestra.run.trial105.stdout:{"epoch":127,"fsid":"7561fe62-1159-11f1-9273-d404e6e7d460","created":"2026-02-24T08:19:11.143358+0000","modified":"2026-02-24T08:35:57.134526+0000","last_up_change":"2026-02-24T08:20:20.224900+0000","last_in_change":"2026-02-24T08:20:10.945432+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T08:20:11.141863+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5b6d17b0-c5d6-474b-89bc-48f24734b414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6803","nonce":869632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6805","nonce":869632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6809","nonce":869632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6807","nonce":869632794}]},"public_addr":"10.20.193.105:6803/869632794","cluster_addr":"10.20.193.105:6805/869632794","heartbeat_back_addr":"10.20.193.105:6809/869632794","heartbeat_front_addr":"10.20.193.105:6807/869632794","state":["exists","up"]},{"osd":1,"uuid":"f33507e8-8616-4090-8585-e8a08345165c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6811","nonce":2121156766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6813","nonce":2121156766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6817","nonce":2121156766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6815","nonce":2121156766}]},"public_addr":"10.20.193.105:6811/2121156766","cluster_addr":"10.20.193.105:6813/2121156766","heartbeat_back_addr":"10.20.193.105:6817/2121156766","heartbeat_front_addr":"10.20.193.105:6815/2121156766","state":["exists","up"]},{"osd":2,"uuid":"0b15ff1c-8554-41ad-b1f3-0f878aa73435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6800","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6801","nonce":3063574535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6802","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6803","nonce":3063574535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6806","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6807","nonce":3063574535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6804","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6805","nonce":3063574535}]},"public_addr":"10.20.193.165:6801/3063574535","cluster_addr":"10.20.193.165:6803/3063574535","heartbeat_back_addr":"10.20.193.165:6807/3063574535","heartbeat_front_addr":"10.20.193.165:6805/3063574535","state":["exists","up"]},{"osd":3,"uuid":"6c4b0a9e-7dba-4452-acde-b0f132240d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6808","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6809","nonce":2512845559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6810","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6811","nonce":2512845559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6814","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6815","nonce":2512845559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6812","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6813","nonce":2512845559}]},"public_addr":"10.20.193.165:6809/2512845559","cluster_addr":"10.20.193.165:6811/2512845559","heartbeat_back_addr":"10.20.193.165:6815/2512845559","heartbeat_front_addr":"10.20.193.165:6813/2512845559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:34:25.776372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:34:13.186389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:35:12.648271+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:34:45.696657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.105:0/3562493168":"2026-02-25T08:20:28.681914+0000","10.20.193.105:0/3463864029":"2026-02-25T08:20:28.681914+0000","10.20.193.105:6801/4215880599":"2026-02-25T08:20:28.681914+0000","10.20.193.105:6801/119731213":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/1143914845":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/2664861380":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/4203947306":"2026-02-25T08:20:28.681914+0000","10.20.193.105:6800/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/1156713941":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/3052436975":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6801/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/2356899514":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6800/119731213":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/4198816748":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/1553193359":"2026-02-25T08:20:28.681914+0000","10.20.193.105:6800/4215880599":"2026-02-25T08:20:28.681914+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T08:35:57.539 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-24T08:35:57.540 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T08:35:57.655 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:57.754 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:57.752+0000 7fd0b6ec4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:57.755 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:57.752+0000 7fd0b6ec4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:57.865 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:35:57.866 INFO:teuthology.orchestra.run.trial105.stdout:{"epoch":127,"fsid":"7561fe62-1159-11f1-9273-d404e6e7d460","created":"2026-02-24T08:19:11.143358+0000","modified":"2026-02-24T08:35:57.134526+0000","last_up_change":"2026-02-24T08:20:20.224900+0000","last_in_change":"2026-02-24T08:20:10.945432+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T08:20:11.141863+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5b6d17b0-c5d6-474b-89bc-48f24734b414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6803","nonce":869632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6805","nonce":869632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6809","nonce":869632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":869632794},{"type":"v1","addr":"10.20.193.105:6807","nonce":869632794}]},"public_addr":"10.20.193.105:6803/869632794","cluster_addr":"10.20.193.105:6805/869632794","heartbeat_back_addr":"10.20.193.105:6809/869632794","heartbeat_front_addr":"10.20.193.105:6807/869632794","state":["exists","up"]},{"osd":1,"uuid":"f33507e8-8616-4090-8585-e8a08345165c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6811","nonce":2121156766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6813","nonce":2121156766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6817","nonce":2121156766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":2121156766},{"type":"v1","addr":"10.20.193.105:6815","nonce":2121156766}]},"public_addr":"10.20.193.105:6811/2121156766","cluster_addr":"10.20.193.105:6813/2121156766","heartbeat_back_addr":"10.20.193.105:6817/2121156766","heartbeat_front_addr":"10.20.193.105:6815/2121156766","state":["exists","up"]},{"osd":2,"uuid":"0b15ff1c-8554-41ad-b1f3-0f878aa73435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6800","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6801","nonce":3063574535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6802","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6803","nonce":3063574535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6806","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6807","nonce":3063574535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6804","nonce":3063574535},{"type":"v1","addr":"10.20.193.165:6805","nonce":3063574535}]},"public_addr":"10.20.193.165:6801/3063574535","cluster_addr":"10.20.193.165:6803/3063574535","heartbeat_back_addr":"10.20.193.165:6807/3063574535","heartbeat_front_addr":"10.20.193.165:6805/3063574535","state":["exists","up"]},{"osd":3,"uuid":"6c4b0a9e-7dba-4452-acde-b0f132240d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6808","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6809","nonce":2512845559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6810","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6811","nonce":2512845559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6814","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6815","nonce":2512845559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.165:6812","nonce":2512845559},{"type":"v1","addr":"10.20.193.165:6813","nonce":2512845559}]},"public_addr":"10.20.193.165:6809/2512845559","cluster_addr":"10.20.193.165:6811/2512845559","heartbeat_back_addr":"10.20.193.165:6815/2512845559","heartbeat_front_addr":"10.20.193.165:6813/2512845559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:34:25.776372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:34:13.186389+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:35:12.648271+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T08:34:45.696657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.105:0/3562493168":"2026-02-25T08:20:28.681914+0000","10.20.193.105:0/3463864029":"2026-02-25T08:20:28.681914+0000","10.20.193.105:6801/4215880599":"2026-02-25T08:20:28.681914+0000","10.20.193.105:6801/119731213":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/1143914845":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/2664861380":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/4203947306":"2026-02-25T08:20:28.681914+0000","10.20.193.105:6800/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/1156713941":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/3052436975":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6801/1386409091":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/2356899514":"2026-02-25T08:19:30.935349+0000","10.20.193.105:6800/119731213":"2026-02-25T08:19:21.248828+0000","10.20.193.105:0/4198816748":"2026-02-25T08:19:30.935349+0000","10.20.193.105:0/1553193359":"2026-02-25T08:20:28.681914+0000","10.20.193.105:6800/4215880599":"2026-02-25T08:20:28.681914+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T08:35:57.902 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-24T08:35:57.902 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-24T08:35:57.903 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-24T08:35:57.903 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-24T08:35:58.019 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:58.020 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:58.023 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:58.028 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:58.121 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.119+0000 7f099f69a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.120+0000 7f315d44d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.120+0000 7f423988f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.120+0000 7f099f69a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.120+0000 7f315d44d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.120+0000 7f423988f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.121+0000 7f9927f1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.122+0000 7f9927f1f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.171 INFO:teuthology.orchestra.run.trial105.stdout:73014444224 2026-02-24T08:35:58.172 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T08:35:58.176 INFO:teuthology.orchestra.run.trial105.stdout:38654705860 2026-02-24T08:35:58.176 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T08:35:58.179 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1643006007' entity='client.admin' cmd='[{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]': finished 2026-02-24T08:35:58.179 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:58 trial105 ceph-mon[39442]: osdmap e127: 4 total, 4 up, 4 in 2026-02-24T08:35:58.179 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1607225992' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T08:35:58.179 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:58 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1654551344' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T08:35:58.192 INFO:teuthology.orchestra.run.trial105.stdout:98784247998 2026-02-24T08:35:58.192 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T08:35:58.196 INFO:teuthology.orchestra.run.trial105.stdout:55834575042 2026-02-24T08:35:58.197 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T08:35:58.288 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:58.292 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:58.349 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:58.350 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:58.392 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.390+0000 7f7bc6278640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.393 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.390+0000 7f7bc6278640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.397 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.394+0000 7f68777a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.397 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.395+0000 7f68777a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.456 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.453+0000 7f785bc9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.456 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.454+0000 7f785bc9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.457 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.454+0000 7f75ea937640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.457 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:58.454+0000 7f75ea937640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:58.505 INFO:teuthology.orchestra.run.trial105.stdout:38654705859 2026-02-24T08:35:58.509 INFO:teuthology.orchestra.run.trial105.stdout:73014444223 2026-02-24T08:35:58.549 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705860 got 38654705859 for osd.0 2026-02-24T08:35:58.557 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444224 got 73014444223 for osd.2 2026-02-24T08:35:58.567 INFO:teuthology.orchestra.run.trial105.stdout:55834575040 2026-02-24T08:35:58.572 INFO:teuthology.orchestra.run.trial105.stdout:98784247997 2026-02-24T08:35:58.609 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575042 got 55834575040 for osd.1 2026-02-24T08:35:58.612 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247998 got 98784247997 for osd.3 2026-02-24T08:35:59.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2473945948' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T08:35:59.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1500627840' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T08:35:59.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/3598522105' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T08:35:59.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:59 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4262714777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T08:35:59.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:59 trial105 ceph-mon[39442]: pgmap v569: 1 pgs: 1 active+clean; 577 KiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:35:59.438 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:35:59 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T08:35:59.550 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T08:35:59.558 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T08:35:59.610 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T08:35:59.614 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T08:35:59.668 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:59.710 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:59.753 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:59.758 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:35:59.771 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:59.769+0000 7f3d7a768640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:59.771 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:59.769+0000 7f3d7a768640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:59.807 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:35:59 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: ::ffff:10.20.193.165 - - [24/Feb/2026:08:35:59] "GET /metrics HTTP/1.1" 200 3902 "" "Prometheus/3.6.0" 2026-02-24T08:35:59.819 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:59.816+0000 7f4944316640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:59.819 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:59.817+0000 7f4944316640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:59.859 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:59.857+0000 7f677a936640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:59.860 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:59.857+0000 7facbf01f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:59.860 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:59.857+0000 7f677a936640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:59.860 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:35:59.857+0000 7facbf01f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:35:59.886 INFO:teuthology.orchestra.run.trial105.stdout:38654705860 2026-02-24T08:35:59.927 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705860 got 38654705860 for osd.0 2026-02-24T08:35:59.927 DEBUG:teuthology.parallel:result is None 2026-02-24T08:35:59.933 INFO:teuthology.orchestra.run.trial105.stdout:73014444224 2026-02-24T08:35:59.933 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:35:59 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:35:59.551Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial105:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T08:35:59.972 INFO:teuthology.orchestra.run.trial105.stdout:98784247998 2026-02-24T08:35:59.975 INFO:teuthology.orchestra.run.trial105.stdout:55834575042 2026-02-24T08:35:59.992 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444224 got 73014444224 for osd.2 2026-02-24T08:35:59.992 DEBUG:teuthology.parallel:result is None 2026-02-24T08:36:00.013 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247998 got 98784247998 for osd.3 2026-02-24T08:36:00.013 DEBUG:teuthology.parallel:result is None 2026-02-24T08:36:00.018 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575042 got 55834575042 for osd.1 2026-02-24T08:36:00.018 DEBUG:teuthology.parallel:result is None 2026-02-24T08:36:00.018 INFO:tasks.cephadm.ceph_manager.ceph:waiting for recovery to complete 2026-02-24T08:36:00.018 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:36:00.175 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:36:00.276 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:36:00.273+0000 7f7b41e70640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:36:00.276 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:36:00.274+0000 7f7b41e70640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:36:00.383 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:36:00.384 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:36:00.384 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/4127176369' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T08:36:00.384 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2626755939' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T08:36:00.384 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1204737074' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T08:36:00.384 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:00 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/1964202797' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T08:36:00.420 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2026-02-24T08:35:58.820319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":5332004,"kb_used_data":4564,"kb_used_omap":94,"kb_used_meta":5327265,"kb_avail":2930680796,"statfs":{"total":3006477107200,"available":3001017135104,"internally_reserved":0,"allocated":4673536,"data_stored":2838579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":96378,"internal_metadata":5455120262},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.692956"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":346,"reported_epoch":127,"state":"active+clean","last_fresh":"2026-02-24T08:35:57.575029+0000","last_change":"2026-02-24T08:35:35.851277+0000","last_active":"2026-02-24T08:35:57.575029+0000","last_peered":"2026-02-24T08:35:57.575029+0000","last_clean":"2026-02-24T08:35:57.575029+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:35:57.575029+0000","last_undegraded":"2026-02-24T08:35:57.575029+0000","last_fullsized":"2026-02-24T08:35:57.575029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:35:35.851234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:35:35.851234+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:01.752760+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5688,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1485660,"kb_used_data":1288,"kb_used_omap":24,"kb_used_meta":1484327,"kb_avail":732517540,"statfs":{"total":751619276800,"available":750097960960,"internally_reserved":0,"allocated":1318912,"data_stored":858251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25165,"internal_metadata":1519951283},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444224,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1480596,"kb_used_data":1280,"kb_used_omap":18,"kb_used_meta":1479277,"kb_avail":732522604,"statfs":{"total":751619276800,"available":750103146496,"internally_reserved":0,"allocated":1310720,"data_stored":854194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18519,"internal_metadata":1514780585},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":1419416,"kb_used_data":708,"kb_used_omap":25,"kb_used_meta":1418662,"kb_avail":732583784,"statfs":{"total":751619276800,"available":750165794816,"internally_reserved":0,"allocated":724992,"data_stored":267883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26340,"internal_metadata":1452710172},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":946332,"kb_used_data":1288,"kb_used_omap":25,"kb_used_meta":944998,"kb_avail":733056868,"statfs":{"total":751619276800,"available":750650232832,"internally_reserved":0,"allocated":1318912,"data_stored":858251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26354,"internal_metadata":967678222},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5688,"internal_metadata":0}]}} 2026-02-24T08:36:00.421 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T08:36:00.536 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:36:00.632 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:36:00.629+0000 7f45696fe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:36:00.632 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:36:00.630+0000 7f45696fe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:36:00.741 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-24T08:36:00.742 INFO:teuthology.orchestra.run.trial105.stderr:dumped all 2026-02-24T08:36:00.778 INFO:teuthology.orchestra.run.trial105.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2026-02-24T08:35:58.820319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":5332004,"kb_used_data":4564,"kb_used_omap":94,"kb_used_meta":5327265,"kb_avail":2930680796,"statfs":{"total":3006477107200,"available":3001017135104,"internally_reserved":0,"allocated":4673536,"data_stored":2838579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":96378,"internal_metadata":5455120262},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.692956"},"pg_stats":[{"pgid":"1.0","version":"26'99","reported_seq":346,"reported_epoch":127,"state":"active+clean","last_fresh":"2026-02-24T08:35:57.575029+0000","last_change":"2026-02-24T08:35:35.851277+0000","last_active":"2026-02-24T08:35:57.575029+0000","last_peered":"2026-02-24T08:35:57.575029+0000","last_clean":"2026-02-24T08:35:57.575029+0000","last_became_active":"2026-02-24T08:20:22.231978+0000","last_became_peered":"2026-02-24T08:20:22.231978+0000","last_unstale":"2026-02-24T08:35:57.575029+0000","last_undegraded":"2026-02-24T08:35:57.575029+0000","last_fullsized":"2026-02-24T08:35:57.575029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'99","last_scrub_stamp":"2026-02-24T08:35:35.851234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T08:20:11.945878+0000","last_clean_scrub_stamp":"2026-02-24T08:35:35.851234+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:37:01.752760+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":240,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5688,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":23,"seq":98784247998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1485660,"kb_used_data":1288,"kb_used_omap":24,"kb_used_meta":1484327,"kb_avail":732517540,"statfs":{"total":751619276800,"available":750097960960,"internally_reserved":0,"allocated":1318912,"data_stored":858251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25165,"internal_metadata":1519951283},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444224,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":1480596,"kb_used_data":1280,"kb_used_omap":18,"kb_used_meta":1479277,"kb_avail":732522604,"statfs":{"total":751619276800,"available":750103146496,"internally_reserved":0,"allocated":1310720,"data_stored":854194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18519,"internal_metadata":1514780585},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":1419416,"kb_used_data":708,"kb_used_omap":25,"kb_used_meta":1418662,"kb_avail":732583784,"statfs":{"total":751619276800,"available":750165794816,"internally_reserved":0,"allocated":724992,"data_stored":267883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26340,"internal_metadata":1452710172},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":946332,"kb_used_data":1288,"kb_used_omap":25,"kb_used_meta":944998,"kb_avail":733056868,"statfs":{"total":751619276800,"available":750650232832,"internally_reserved":0,"allocated":1318912,"data_stored":858251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26354,"internal_metadata":967678222},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5688,"internal_metadata":0}]}} 2026-02-24T08:36:00.779 INFO:tasks.cephadm.ceph_manager.ceph:recovered! 2026-02-24T08:36:00.779 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2026-02-24T08:36:00.894 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:36:00.996 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:36:00.994+0000 7fcc1f5e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:36:00.996 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-24T08:36:00.994+0000 7fcc1f5e5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T08:36:01.149 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-24T08:36:01.164 INFO:tasks.cephadm:Teardown begin 2026-02-24T08:36:01.164 DEBUG:teuthology.orchestra.run.trial105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: from='client.15883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: from='client.15885 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: pgmap v570: 1 pgs: 1 active+clean; 577 KiB data, 5.1 GiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2487305251' entity='client.admin' cmd={"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"} : dispatch 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: from='client.? 10.20.193.105:0/2487305251' entity='client.admin' cmd='[{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]': finished 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' 2026-02-24T08:36:01.187 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-mon[39442]: from='mgr.14285 10.20.193.105:0/3556696796' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T08:36:01.190 DEBUG:teuthology.orchestra.run.trial165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:36:01.217 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-24T08:36:01.217 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-24T08:36:01.343 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/mon.a/config 2026-02-24T08:36:01.361 INFO:teuthology.orchestra.run.trial105.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-24T08:36:01.377 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-24T08:36:01.378 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-24T08:36:01.378 DEBUG:teuthology.orchestra.run.trial105:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T08:36:01.395 DEBUG:teuthology.orchestra.run.trial165:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T08:36:01.413 INFO:tasks.cephadm:Stopping all daemons... 2026-02-24T08:36:01.414 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-24T08:36:01.414 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a 2026-02-24T08:36:01.438 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:36:01 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:36:01] ENGINE Bus STOPPING 2026-02-24T08:36:01.655 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a.service' 2026-02-24T08:36:01.718 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:36:01 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:36:01] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-24T08:36:01.718 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:36:01 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: [24/Feb/2026:08:36:01] ENGINE Bus STOPPED 2026-02-24T08:36:01.719 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 systemd[1]: Stopping Ceph mon.a for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:36:01.719 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39438]: 2026-02-24T08:36:01.531+0000 7f3279254640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T08:36:01.719 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a[39438]: 2026-02-24T08:36:01.531+0000 7f3279254640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T08:36:01.719 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 podman[160034]: 2026-02-24 08:36:01.562362494 +0000 UTC m=+0.043233828 container died 45e9473c32d3d84f2c13c2a6ba9063288b7210c18b7c92e95b2ec808fe6b34d7 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_REF=wip-shraddhaag-enable-cephadm-tests) 2026-02-24T08:36:01.719 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 podman[160034]: 2026-02-24 08:36:01.573302684 +0000 UTC m=+0.054174018 container remove 45e9473c32d3d84f2c13c2a6ba9063288b7210c18b7c92e95b2ec808fe6b34d7 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, ceph=True, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T08:36:01.719 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 bash[160034]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mon-a 2026-02-24T08:36:01.719 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 systemd[1]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-24T08:36:01.719 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 systemd[1]: Stopped Ceph mon.a for 7561fe62-1159-11f1-9273-d404e6e7d460. 2026-02-24T08:36:01.719 INFO:journalctl@ceph.mon.a.trial105.stdout:Feb 24 08:36:01 trial105 systemd[1]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mon.a.service: Consumed 9.412s CPU time. 2026-02-24T08:36:01.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:36:01.734 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-24T08:36:01.734 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-24T08:36:01.734 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mgr.x 2026-02-24T08:36:01.989 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:36:01 trial105 systemd[1]: Stopping Ceph mgr.x for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:36:01.990 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:36:01 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x[39779]: 2026-02-24T08:36:01.865+0000 7f69f71b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T08:36:01.990 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:36:01 trial105 podman[160193]: 2026-02-24 08:36:01.906716633 +0000 UTC m=+0.053775877 container died 4b705cc3fc1c43d9e1edec543e057e2b34b1de571da53e30118c9f54f7270c55 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2026-02-24T08:36:01.990 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:36:01 trial105 podman[160193]: 2026-02-24 08:36:01.937562699 +0000 UTC m=+0.084621933 container remove 4b705cc3fc1c43d9e1edec543e057e2b34b1de571da53e30118c9f54f7270c55 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T08:36:01.990 INFO:journalctl@ceph.mgr.x.trial105.stdout:Feb 24 08:36:01 trial105 bash[160193]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-mgr-x 2026-02-24T08:36:02.011 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@mgr.x.service' 2026-02-24T08:36:02.046 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:36:02.046 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-24T08:36:02.046 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-24T08:36:02.046 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.0 2026-02-24T08:36:02.439 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:02 trial105 systemd[1]: Stopping Ceph osd.0 for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:36:02.439 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:02 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0[56181]: 2026-02-24T08:36:02.174+0000 7f6e333b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T08:36:02.439 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:02 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0[56181]: 2026-02-24T08:36:02.174+0000 7f6e333b0640 -1 osd.0 127 *** Got signal Terminated *** 2026-02-24T08:36:02.439 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:02 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0[56181]: 2026-02-24T08:36:02.174+0000 7f6e333b0640 -1 osd.0 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T08:36:07.689 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:07 trial105 podman[160349]: 2026-02-24 08:36:07.406565807 +0000 UTC m=+5.243301360 container died f1ea039550a7ac3bba16433444ff23e7323dfe359b153d5a3479b6e98063eb36 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.schema-version=1.0) 2026-02-24T08:36:07.690 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:07 trial105 podman[160349]: 2026-02-24 08:36:07.418274405 +0000 UTC m=+5.255009948 container remove f1ea039550a7ac3bba16433444ff23e7323dfe359b153d5a3479b6e98063eb36 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T08:36:07.690 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:07 trial105 bash[160349]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0 2026-02-24T08:36:07.690 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:07 trial105 podman[160479]: 2026-02-24 08:36:07.538791655 +0000 UTC m=+0.015805581 container create 61b6920fac087eca04b8ba08d2868f906e4d08caef39d7ec2bce379ab3566475 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T08:36:07.690 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:07 trial105 podman[160479]: 2026-02-24 08:36:07.566168016 +0000 UTC m=+0.043181932 container init 61b6920fac087eca04b8ba08d2868f906e4d08caef39d7ec2bce379ab3566475 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T08:36:07.690 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:07 trial105 podman[160479]: 2026-02-24 08:36:07.568866686 +0000 UTC m=+0.045880612 container start 61b6920fac087eca04b8ba08d2868f906e4d08caef39d7ec2bce379ab3566475 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T08:36:07.690 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:07 trial105 podman[160479]: 2026-02-24 08:36:07.569418643 +0000 UTC m=+0.046432569 container attach 61b6920fac087eca04b8ba08d2868f906e4d08caef39d7ec2bce379ab3566475 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-0-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, OSD_FLAVOR=default) 2026-02-24T08:36:07.690 INFO:journalctl@ceph.osd.0.trial105.stdout:Feb 24 08:36:07 trial105 podman[160479]: 2026-02-24 08:36:07.532429811 +0000 UTC m=+0.009443747 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T08:36:07.754 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.0.service' 2026-02-24T08:36:07.790 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:36:07.790 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-24T08:36:07.791 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-24T08:36:07.791 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.1 2026-02-24T08:36:08.189 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:07 trial105 systemd[1]: Stopping Ceph osd.1 for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:36:08.189 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:07 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1[63979]: 2026-02-24T08:36:07.920+0000 7f9463892640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T08:36:08.189 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:07 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1[63979]: 2026-02-24T08:36:07.920+0000 7f9463892640 -1 osd.1 127 *** Got signal Terminated *** 2026-02-24T08:36:08.189 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:07 trial105 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1[63979]: 2026-02-24T08:36:07.920+0000 7f9463892640 -1 osd.1 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T08:36:13.629 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:13 trial105 podman[160621]: 2026-02-24 08:36:13.374352254 +0000 UTC m=+5.466314380 container died 89ad56081f06de2b1f4cb8a310bd48cb830f568c6c345134ec3c67eb91694cd7 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1, OSD_FLAVOR=default, io.buildah.version=1.33.7, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223) 2026-02-24T08:36:13.629 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:13 trial105 podman[160621]: 2026-02-24 08:36:13.386138537 +0000 UTC m=+5.478100653 container remove 89ad56081f06de2b1f4cb8a310bd48cb830f568c6c345134ec3c67eb91694cd7 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, ceph=True) 2026-02-24T08:36:13.629 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:13 trial105 bash[160621]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1 2026-02-24T08:36:13.629 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:13 trial105 podman[160754]: 2026-02-24 08:36:13.534131122 +0000 UTC m=+0.014112001 container create 8e7d53015c3dda6670781b827a1d2c82f465253c2a6f791d98a12db1a305ce0e (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1-deactivate, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, ceph=True, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T08:36:13.629 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:13 trial105 podman[160754]: 2026-02-24 08:36:13.565626004 +0000 UTC m=+0.045606893 container init 8e7d53015c3dda6670781b827a1d2c82f465253c2a6f791d98a12db1a305ce0e (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-24T08:36:13.629 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:13 trial105 podman[160754]: 2026-02-24 08:36:13.568119883 +0000 UTC m=+0.048100772 container start 8e7d53015c3dda6670781b827a1d2c82f465253c2a6f791d98a12db1a305ce0e (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1-deactivate, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017) 2026-02-24T08:36:13.629 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:13 trial105 podman[160754]: 2026-02-24 08:36:13.568724387 +0000 UTC m=+0.048705276 container attach 8e7d53015c3dda6670781b827a1d2c82f465253c2a6f791d98a12db1a305ce0e (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260223, io.buildah.version=1.33.7) 2026-02-24T08:36:13.629 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 24 08:36:13 trial105 podman[160754]: 2026-02-24 08:36:13.52855495 +0000 UTC m=+0.008535849 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T08:36:13.725 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.1.service' 2026-02-24T08:36:13.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:36:13.763 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-24T08:36:13.763 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-24T08:36:13.763 DEBUG:teuthology.orchestra.run.trial165:> sudo systemctl stop ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.2 2026-02-24T08:36:14.184 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:13 trial165 systemd[1]: Stopping Ceph osd.2 for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:36:14.184 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:13 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2[46860]: 2026-02-24T08:36:13.864+0000 7fbed86c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T08:36:14.184 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:13 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2[46860]: 2026-02-24T08:36:13.864+0000 7fbed86c7640 -1 osd.2 127 *** Got signal Terminated *** 2026-02-24T08:36:14.184 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:13 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2[46860]: 2026-02-24T08:36:13.864+0000 7fbed86c7640 -1 osd.2 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T08:36:19.573 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:19 trial165 podman[68398]: 2026-02-24 08:36:19.257286284 +0000 UTC m=+5.405396520 container died 5dfd16aa814a5ba9e9420fc219effce34fcd0e53e1a89cbb150bf9d57221f3d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7) 2026-02-24T08:36:19.573 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:19 trial165 podman[68398]: 2026-02-24 08:36:19.268883521 +0000 UTC m=+5.416993757 container remove 5dfd16aa814a5ba9e9420fc219effce34fcd0e53e1a89cbb150bf9d57221f3d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.license=GPLv2) 2026-02-24T08:36:19.573 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:19 trial165 bash[68398]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2 2026-02-24T08:36:19.573 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:19 trial165 podman[68531]: 2026-02-24 08:36:19.393983184 +0000 UTC m=+0.015707105 container create a1b5e24f276edf2d40cdc49e83a6e51910793757903454db4dfd090eba6bcaf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, OSD_FLAVOR=default) 2026-02-24T08:36:19.573 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:19 trial165 podman[68531]: 2026-02-24 08:36:19.421906308 +0000 UTC m=+0.043630239 container init a1b5e24f276edf2d40cdc49e83a6e51910793757903454db4dfd090eba6bcaf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T08:36:19.573 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:19 trial165 podman[68531]: 2026-02-24 08:36:19.424968313 +0000 UTC m=+0.046692234 container start a1b5e24f276edf2d40cdc49e83a6e51910793757903454db4dfd090eba6bcaf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.33.7, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017) 2026-02-24T08:36:19.573 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:19 trial165 podman[68531]: 2026-02-24 08:36:19.42544971 +0000 UTC m=+0.047173631 container attach a1b5e24f276edf2d40cdc49e83a6e51910793757903454db4dfd090eba6bcaf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.33.7, org.label-schema.build-date=20260223, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2026-02-24T08:36:19.574 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:19 trial165 podman[68531]: 2026-02-24 08:36:19.387577089 +0000 UTC m=+0.009301010 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T08:36:19.574 INFO:journalctl@ceph.osd.2.trial165.stdout:Feb 24 08:36:19 trial165 podman[68531]: 2026-02-24 08:36:19.571293632 +0000 UTC m=+0.193017543 container died a1b5e24f276edf2d40cdc49e83a6e51910793757903454db4dfd090eba6bcaf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.33.7, org.label-schema.build-date=20260223) 2026-02-24T08:36:19.604 DEBUG:teuthology.orchestra.run.trial165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.2.service' 2026-02-24T08:36:19.644 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:36:19.644 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-24T08:36:19.644 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-24T08:36:19.645 DEBUG:teuthology.orchestra.run.trial165:> sudo systemctl stop ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.3 2026-02-24T08:36:19.934 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:19 trial165 systemd[1]: Stopping Ceph osd.3 for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:36:19.934 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3[54384]: 2026-02-24T08:36:19.784+0000 7f7f7d0ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T08:36:19.934 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3[54384]: 2026-02-24T08:36:19.784+0000 7f7f7d0ac640 -1 osd.3 127 *** Got signal Terminated *** 2026-02-24T08:36:19.934 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:19 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3[54384]: 2026-02-24T08:36:19.784+0000 7f7f7d0ac640 -1 osd.3 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T08:36:25.430 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:25 trial165 podman[68665]: 2026-02-24 08:36:25.12724467 +0000 UTC m=+5.356044232 container died 4e928ddc1455a689f9a50c95f273f77f5bddbbbf1bcf824ec2461451d5bcb20c (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.build-date=20260223, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T08:36:25.430 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:25 trial165 podman[68665]: 2026-02-24 08:36:25.137144554 +0000 UTC m=+5.365944116 container remove 4e928ddc1455a689f9a50c95f273f77f5bddbbbf1bcf824ec2461451d5bcb20c (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, ceph=True, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223) 2026-02-24T08:36:25.430 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:25 trial165 bash[68665]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3 2026-02-24T08:36:25.430 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:25 trial165 podman[68795]: 2026-02-24 08:36:25.257097498 +0000 UTC m=+0.014833306 container create 84a383b35a637972febdd76b738166d4c22a956ef22dca0a06b27e6e5584c58a (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-02-24T08:36:25.430 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:25 trial165 podman[68795]: 2026-02-24 08:36:25.294973475 +0000 UTC m=+0.052709303 container init 84a383b35a637972febdd76b738166d4c22a956ef22dca0a06b27e6e5584c58a (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.33.7, ceph=True) 2026-02-24T08:36:25.430 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:25 trial165 podman[68795]: 2026-02-24 08:36:25.297589269 +0000 UTC m=+0.055325087 container start 84a383b35a637972febdd76b738166d4c22a956ef22dca0a06b27e6e5584c58a (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3-deactivate, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-02-24T08:36:25.430 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:25 trial165 podman[68795]: 2026-02-24 08:36:25.298234631 +0000 UTC m=+0.055970449 container attach 84a383b35a637972febdd76b738166d4c22a956ef22dca0a06b27e6e5584c58a (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3-deactivate, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017) 2026-02-24T08:36:25.430 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:25 trial165 podman[68795]: 2026-02-24 08:36:25.251061813 +0000 UTC m=+0.008797631 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T08:36:25.430 INFO:journalctl@ceph.osd.3.trial165.stdout:Feb 24 08:36:25 trial165 podman[68795]: 2026-02-24 08:36:25.428844611 +0000 UTC m=+0.186580429 container died 84a383b35a637972febdd76b738166d4c22a956ef22dca0a06b27e6e5584c58a (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-osd-3-deactivate, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-02-24T08:36:25.469 DEBUG:teuthology.orchestra.run.trial165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@osd.3.service' 2026-02-24T08:36:25.508 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:36:25.508 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-24T08:36:25.508 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2026-02-24T08:36:25.509 DEBUG:teuthology.orchestra.run.trial165:> sudo systemctl stop ceph-7561fe62-1159-11f1-9273-d404e6e7d460@prometheus.a 2026-02-24T08:36:25.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 systemd[1]: Stopping Ceph prometheus.a for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:36:25.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.649Z level=WARN source=main.go:1076 msg="Received an OS signal, exiting gracefully..." signal=terminated 2026-02-24T08:36:25.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.650Z level=INFO source=main.go:1101 msg="Stopping scrape discovery manager..." 2026-02-24T08:36:25.684 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.650Z level=INFO source=main.go:1115 msg="Stopping notify discovery manager..." 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.650Z level=INFO source=manager.go:190 msg="Stopping rule manager..." component="rule manager" 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.650Z level=INFO source=main.go:1097 msg="Scrape discovery manager stopped" 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.650Z level=INFO source=main.go:1111 msg="Notify discovery manager stopped" 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.650Z level=INFO source=manager.go:206 msg="Rule manager stopped" component="rule manager" 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.650Z level=INFO source=main.go:1152 msg="Stopping scrape manager..." 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.650Z level=INFO source=main.go:1144 msg="Scrape manager stopped" 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.650Z level=INFO source=manager.go:543 msg="Stopping notification manager..." component=notifier 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.651Z level=INFO source=manager.go:285 msg="Draining any remaining notifications..." component=notifier 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.651Z level=INFO source=manager.go:291 msg="Remaining notifications drained" component=notifier 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.651Z level=INFO source=manager.go:218 msg="Notification manager stopped" component=notifier 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.651Z level=INFO source=main.go:1422 msg="Notifier manager stopped" 2026-02-24T08:36:25.685 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a[65761]: time=2026-02-24T08:36:25.651Z level=INFO source=main.go:1436 msg="See you next time!" 2026-02-24T08:36:25.686 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 podman[68930]: 2026-02-24 08:36:25.660220538 +0000 UTC m=+0.022243263 container died d57224ac37b717e1255683ba42ae3bceb81fea28a55dd3d01d74a13ab51963d0 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a, org.opencontainers.image.source=https://github.com/prometheus/prometheus, maintainer=The Prometheus Authors ) 2026-02-24T08:36:25.686 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 podman[68930]: 2026-02-24 08:36:25.669008821 +0000 UTC m=+0.031031546 container remove d57224ac37b717e1255683ba42ae3bceb81fea28a55dd3d01d74a13ab51963d0 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T08:36:25.686 INFO:journalctl@ceph.prometheus.a.trial165.stdout:Feb 24 08:36:25 trial165 bash[68930]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-prometheus-a 2026-02-24T08:36:25.728 DEBUG:teuthology.orchestra.run.trial165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7561fe62-1159-11f1-9273-d404e6e7d460@prometheus.a.service' 2026-02-24T08:36:25.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T08:36:25.762 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2026-02-24T08:36:25.762 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 --force --keep-logs 2026-02-24T08:36:25.881 INFO:teuthology.orchestra.run.trial105.stdout:Deleting cluster with fsid: 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:36:27.140 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 --force --keep-logs 2026-02-24T08:36:27.257 INFO:teuthology.orchestra.run.trial165.stdout:Deleting cluster with fsid: 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:36:28.116 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:36:27 trial165 systemd[1]: Stopping Ceph node-exporter.b for 7561fe62-1159-11f1-9273-d404e6e7d460... 2026-02-24T08:36:28.116 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:36:27 trial165 podman[69245]: 2026-02-24 08:36:27.782037969 +0000 UTC m=+0.022791744 container died 07d4cd3bbba88214a8147c624a36bc24f58cc0584ee9a0e8dc98b4fb0e770d6a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T08:36:28.116 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:36:27 trial165 podman[69245]: 2026-02-24 08:36:27.790347801 +0000 UTC m=+0.031101577 container remove 07d4cd3bbba88214a8147c624a36bc24f58cc0584ee9a0e8dc98b4fb0e770d6a (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T08:36:28.116 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:36:27 trial165 bash[69245]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460-node-exporter-b 2026-02-24T08:36:28.116 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:36:27 trial165 systemd[1]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2026-02-24T08:36:28.116 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:36:27 trial165 systemd[1]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460@node-exporter.b.service: Failed with result 'exit-code'. 2026-02-24T08:36:28.116 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:36:27 trial165 systemd[1]: Stopped Ceph node-exporter.b for 7561fe62-1159-11f1-9273-d404e6e7d460. 2026-02-24T08:36:28.116 INFO:journalctl@ceph.node-exporter.b.trial165.stdout:Feb 24 08:36:27 trial165 systemd[1]: ceph-7561fe62-1159-11f1-9273-d404e6e7d460@node-exporter.b.service: Consumed 2.887s CPU time. 2026-02-24T08:36:28.391 DEBUG:teuthology.orchestra.run.trial105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:36:28.420 DEBUG:teuthology.orchestra.run.trial165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T08:36:28.448 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-24T08:36:28.451 DEBUG:teuthology.misc:Transferring archived files from trial105:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67646/remote/trial105/crash 2026-02-24T08:36:28.452 DEBUG:teuthology.orchestra.run.trial105:> sudo tar c -f - -C /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/crash -- . 2026-02-24T08:36:28.486 INFO:teuthology.orchestra.run.trial105.stderr:tar: /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T08:36:28.486 INFO:teuthology.orchestra.run.trial105.stderr:tar: Error is not recoverable: exiting now 2026-02-24T08:36:28.488 DEBUG:teuthology.misc:Transferring archived files from trial165:/var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67646/remote/trial165/crash 2026-02-24T08:36:28.489 DEBUG:teuthology.orchestra.run.trial165:> sudo tar c -f - -C /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/crash -- . 2026-02-24T08:36:28.514 INFO:teuthology.orchestra.run.trial165.stderr:tar: /var/lib/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T08:36:28.514 INFO:teuthology.orchestra.run.trial165.stderr:tar: Error is not recoverable: exiting now 2026-02-24T08:36:28.515 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-24T08:36:28.516 DEBUG:teuthology.orchestra.run.trial105:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'objects unfound and apparently lost' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | head -n 1 2026-02-24T08:36:28.552 INFO:tasks.cephadm:Compressing logs... 2026-02-24T08:36:28.552 DEBUG:teuthology.orchestra.run.trial105:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T08:36:28.593 DEBUG:teuthology.orchestra.run.trial165:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T08:36:28.617 INFO:teuthology.orchestra.run.trial105.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2026-02-24T08:36:28.617 INFO:teuthology.orchestra.run.trial105.stderr: /var/log/ceph/cephadm.log 2026-02-24T08:36:28.617 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-mon.a.log 2026-02-24T08:36:28.617 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.0.log 2026-02-24T08:36:28.618 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.cephadm.log 2026-02-24T08:36:28.618 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.audit.log 2026-02-24T08:36:28.618 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-volume.log 2026-02-24T08:36:28.618 INFO:teuthology.orchestra.run.trial105.stderr: 82.1% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.cephadm.log.gz 2026-02-24T08:36:28.618 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.1.log 2026-02-24T08:36:28.618 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-mgr.x.log 2026-02-24T08:36:28.618 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.log 2026-02-24T08:36:28.620 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-mgr.x.log: /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.log: 89.6% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.audit.log.gz 2026-02-24T08:36:28.620 INFO:teuthology.orchestra.run.trial105.stderr: 86.3% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph.log.gz 2026-02-24T08:36:28.620 INFO:teuthology.orchestra.run.trial105.stderr: 94.5% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-volume.log.gz 2026-02-24T08:36:28.621 INFO:teuthology.orchestra.run.trial165.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-24T08:36:28.621 INFO:teuthology.orchestra.run.trial165.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T08:36:28.621 INFO:teuthology.orchestra.run.trial165.stderr:gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.2.log 2026-02-24T08:36:28.621 INFO:teuthology.orchestra.run.trial165.stderr:gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.3.log 2026-02-24T08:36:28.621 INFO:teuthology.orchestra.run.trial165.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-volume.log 2026-02-24T08:36:28.622 INFO:teuthology.orchestra.run.trial165.stderr:/var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.3.log: /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-volume.log: 83.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T08:36:28.622 INFO:teuthology.orchestra.run.trial165.stderr: 94.2% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-volume.log.gz 2026-02-24T08:36:28.622 INFO:teuthology.orchestra.run.trial105.stderr: 95.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T08:36:28.711 INFO:teuthology.orchestra.run.trial105.stderr: 90.4% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-24T08:36:28.935 INFO:teuthology.orchestra.run.trial105.stderr: 89.8% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-mon.a.log.gz 2026-02-24T08:44:47.232 INFO:teuthology.orchestra.run.trial165.stderr: 94.3% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.2.log.gz 2026-02-24T08:44:49.137 INFO:teuthology.orchestra.run.trial165.stderr: 94.3% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.3.log.gz 2026-02-24T08:44:49.141 INFO:teuthology.orchestra.run.trial165.stderr: 2026-02-24T08:44:49.141 INFO:teuthology.orchestra.run.trial165.stderr:real 8m20.530s 2026-02-24T08:44:49.141 INFO:teuthology.orchestra.run.trial165.stderr:user 15m25.463s 2026-02-24T08:44:49.141 INFO:teuthology.orchestra.run.trial165.stderr:sys 1m7.794s 2026-02-24T08:44:58.802 INFO:teuthology.orchestra.run.trial105.stderr: 94.3% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.0.log.gz 2026-02-24T08:46:05.247 INFO:teuthology.orchestra.run.trial105.stderr: 94.2% -- replaced with /var/log/ceph/7561fe62-1159-11f1-9273-d404e6e7d460/ceph-osd.1.log.gz 2026-02-24T08:46:05.249 INFO:teuthology.orchestra.run.trial105.stderr: 2026-02-24T08:46:05.249 INFO:teuthology.orchestra.run.trial105.stderr:real 9m36.644s 2026-02-24T08:46:05.249 INFO:teuthology.orchestra.run.trial105.stderr:user 16m37.233s 2026-02-24T08:46:05.249 INFO:teuthology.orchestra.run.trial105.stderr:sys 1m22.989s 2026-02-24T08:46:05.249 INFO:tasks.cephadm:Archiving logs... 2026-02-24T08:46:05.249 DEBUG:teuthology.misc:Transferring archived files from trial105:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67646/remote/trial105/log 2026-02-24T08:46:05.251 DEBUG:teuthology.orchestra.run.trial105:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T08:47:17.076 DEBUG:teuthology.misc:Transferring archived files from trial165:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67646/remote/trial165/log 2026-02-24T08:47:17.079 DEBUG:teuthology.orchestra.run.trial165:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T08:48:23.389 INFO:tasks.cephadm:Removing cluster... 2026-02-24T08:48:23.389 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 --force 2026-02-24T08:48:23.518 INFO:teuthology.orchestra.run.trial105.stdout:Deleting cluster with fsid: 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:48:25.047 DEBUG:teuthology.orchestra.run.trial165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7561fe62-1159-11f1-9273-d404e6e7d460 --force 2026-02-24T08:48:25.202 INFO:teuthology.orchestra.run.trial165.stdout:Deleting cluster with fsid: 7561fe62-1159-11f1-9273-d404e6e7d460 2026-02-24T08:48:26.683 INFO:tasks.cephadm:Removing cephadm ... 2026-02-24T08:48:26.684 DEBUG:teuthology.orchestra.run.trial105:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T08:48:26.702 DEBUG:teuthology.orchestra.run.trial165:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T08:48:26.720 INFO:tasks.cephadm:Teardown complete 2026-02-24T08:48:26.721 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T08:48:26.736 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T08:48:26.736 DEBUG:teuthology.orchestra.run.trial105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T08:48:26.746 DEBUG:teuthology.orchestra.run.trial165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T08:48:26.950 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T08:48:26.962 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T08:48:26.962 DEBUG:teuthology.orchestra.run.trial105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T08:48:26.964 DEBUG:teuthology.orchestra.run.trial165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T08:48:26.978 INFO:teuthology.orchestra.run.trial105.stderr:bash: line 1: ntpq: command not found 2026-02-24T08:48:26.979 INFO:teuthology.orchestra.run.trial165.stderr:bash: line 1: ntpq: command not found 2026-02-24T08:48:26.990 INFO:teuthology.orchestra.run.trial105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T08:48:26.990 INFO:teuthology.orchestra.run.trial105.stdout:=============================================================================== 2026-02-24T08:48:26.990 INFO:teuthology.orchestra.run.trial105.stdout:^+ h134-215-155-177.mdtnwi.> 2 7 377 86 -2624us[-2398us] +/- 23ms 2026-02-24T08:48:26.990 INFO:teuthology.orchestra.run.trial105.stdout:^+ wdc1.us.ntp.li 3 7 377 80 -9450ns[ +218us] +/- 31ms 2026-02-24T08:48:26.990 INFO:teuthology.orchestra.run.trial105.stdout:^* 216-144-228-179-host.col> 2 7 377 16 +970us[+1210us] +/- 11ms 2026-02-24T08:48:26.990 INFO:teuthology.orchestra.run.trial105.stdout:^- 173.249.203.227 2 6 377 14 +2290us[+2290us] +/- 31ms 2026-02-24T08:48:27.009 INFO:teuthology.orchestra.run.trial165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T08:48:27.009 INFO:teuthology.orchestra.run.trial165.stdout:=============================================================================== 2026-02-24T08:48:27.009 INFO:teuthology.orchestra.run.trial165.stdout:^* ntp0.alb1.inoc.net 2 6 377 21 +32us[ +122us] +/- 3855us 2026-02-24T08:48:27.009 INFO:teuthology.orchestra.run.trial165.stdout:^- ntp.maxhost.io 2 7 357 138 +90us[ +263us] +/- 55ms 2026-02-24T08:48:27.009 INFO:teuthology.orchestra.run.trial165.stdout:^- 23.186.168.130 2 7 373 79 +258us[ +342us] +/- 55ms 2026-02-24T08:48:27.009 INFO:teuthology.orchestra.run.trial165.stdout:^- rn-03.koehn.com 2 7 377 82 +232us[ +315us] +/- 37ms 2026-02-24T08:48:27.009 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T08:48:27.020 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T08:48:27.020 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T08:48:27.033 DEBUG:teuthology.orchestra.run.trial105:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T08:48:27.110 DEBUG:teuthology.orchestra.run.trial165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T08:48:27.168 DEBUG:teuthology.orchestra.run.trial105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T08:48:27.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:48:27.197 DEBUG:teuthology.orchestra.run.trial165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T08:48:27.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:48:27.225 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T08:48:27.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T08:48:27.257 INFO:teuthology.task.internal:Duration was 2733.526620 seconds 2026-02-24T08:48:27.257 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T08:48:27.282 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T08:48:27.283 DEBUG:teuthology.orchestra.run.trial105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T08:48:27.286 DEBUG:teuthology.orchestra.run.trial165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T08:48:27.319 INFO:teuthology.orchestra.run.trial105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T08:48:27.323 INFO:teuthology.orchestra.run.trial165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T08:48:27.722 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T08:48:27.722 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial105.front.sepia.ceph.com 2026-02-24T08:48:27.722 DEBUG:teuthology.orchestra.run.trial105:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T08:48:27.779 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial165.front.sepia.ceph.com 2026-02-24T08:48:27.780 DEBUG:teuthology.orchestra.run.trial165:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T08:48:27.801 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T08:48:27.801 DEBUG:teuthology.orchestra.run.trial105:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T08:48:27.822 DEBUG:teuthology.orchestra.run.trial165:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T08:48:28.207 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T08:48:28.207 DEBUG:teuthology.orchestra.run.trial105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T08:48:28.209 DEBUG:teuthology.orchestra.run.trial165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T08:48:28.230 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T08:48:28.231 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T08:48:28.231 INFO:teuthology.orchestra.run.trial105.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T08:48:28.231 INFO:teuthology.orchestra.run.trial105.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T08:48:28.231 INFO:teuthology.orchestra.run.trial105.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T08:48:28.235 INFO:teuthology.orchestra.run.trial165.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T08:48:28.236 INFO:teuthology.orchestra.run.trial165.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T08:48:28.236 INFO:teuthology.orchestra.run.trial165.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T08:48:28.236 INFO:teuthology.orchestra.run.trial165.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T08:48:28.236 INFO:teuthology.orchestra.run.trial165.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T08:48:28.251 INFO:teuthology.orchestra.run.trial165.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 86.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T08:48:28.337 INFO:teuthology.orchestra.run.trial105.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T08:48:28.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T08:48:28.360 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T08:48:28.360 DEBUG:teuthology.orchestra.run.trial105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T08:48:28.405 DEBUG:teuthology.orchestra.run.trial165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T08:48:28.431 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T08:48:28.448 DEBUG:teuthology.orchestra.run.trial105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T08:48:28.451 DEBUG:teuthology.orchestra.run.trial165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T08:48:28.472 INFO:teuthology.orchestra.run.trial105.stdout:kernel.core_pattern = core 2026-02-24T08:48:28.498 INFO:teuthology.orchestra.run.trial165.stdout:kernel.core_pattern = core 2026-02-24T08:48:28.510 DEBUG:teuthology.orchestra.run.trial105:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T08:48:28.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:48:28.540 DEBUG:teuthology.orchestra.run.trial165:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T08:48:28.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:48:28.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T08:48:28.582 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T08:48:28.583 DEBUG:teuthology.misc:Transferring archived files from trial105:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67646/remote/trial105 2026-02-24T08:48:28.583 DEBUG:teuthology.orchestra.run.trial105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T08:48:28.628 DEBUG:teuthology.misc:Transferring archived files from trial165:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67646/remote/trial165 2026-02-24T08:48:28.628 DEBUG:teuthology.orchestra.run.trial165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T08:48:28.664 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T08:48:28.664 DEBUG:teuthology.orchestra.run.trial105:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T08:48:28.666 DEBUG:teuthology.orchestra.run.trial165:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T08:48:28.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T08:48:28.737 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T08:48:28.737 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T08:48:28.754 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T08:48:28.754 DEBUG:teuthology.orchestra.run.trial105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T08:48:28.757 DEBUG:teuthology.orchestra.run.trial165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T08:48:28.772 INFO:teuthology.orchestra.run.trial105.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 08:48 /home/ubuntu/cephtest 2026-02-24T08:48:28.773 INFO:teuthology.orchestra.run.trial165.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 08:48 /home/ubuntu/cephtest 2026-02-24T08:48:28.775 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T08:48:28.793 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T08:48:28.828 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/radosbench-high-concurrency} duration: 2733.526619911194 flavor: debug owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com success: true 2026-02-24T08:48:28.828 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T08:48:28.937 INFO:teuthology.run:pass